RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

3 weeks, 1 day ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark Azure CI/CD Dagster Databricks dbt Git MLflow MLOps Python Scrum SQL
Apply Now
Protective Life

Protective Life

Protective Life Insurance Company offers financial security through insurance and investment products, serving people and protecting families for over a century.

Insurance
1K-5K
Founded 1907
View All Jobs 24

Description

  • Lead end-to-end data product design across Voyager’s Raw, Prep, and Prod medallion layers.
  • Own dimensional modeling, including grain, keys, Type 2 history, facts, bridges, and conformed dimensions.
  • Define and enforce ODCS data contracts, quality rules, freshness expectations, and breaking-change processes.
  • Set engineering standards for Python, SQL, dbt, testing, repository structure, and CI/CD practices.
  • Lead code reviews and ensure quality, observability, alerting, and SLA/SLO compliance.
  • Own pipeline operations, including incident triage, backfills, performance and cost tuning, on-call coverage, root-cause analysis, and runbooks.
  • Partner with Product Owners, Scrum Masters, platform teams, ML engineering, architecture, governance, and DataOps/MLOps.
  • Mentor engineers through design reviews, pairing, and code reviews while reducing knowledge silos.
  • Develop reusable frameworks, templates, and patterns to improve delivery consistency and speed.
  • Ensure delivery meets regulated-industry controls, including change management, least privilege, segregation of duties, and auditability.

Requirements

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field; equivalent practical experience considered.
  • 6+ years building and operating production data pipelines and consumer-facing data models.
  • Strong hands-on Python and SQL skills, with willingness to write and review production code.
  • Experience with Databricks or a comparable Spark-based lakehouse, including Delta Lake, MERGE, incremental processing, and performance tuning.
  • Deep experience with dimensional modeling, including grain, keys, slowly changing dimensions, facts, dimensions, and conformed dimensions.
  • Demonstrated technical leadership in design, engineering standards, code review, and mentoring.
  • Experience owning data products used by other teams, including breaking changes and production incidents.
  • Experience with orchestration tools such as Dagster, Databricks Workflows, or Airflow; Git, code review, and CI/CD platforms such as Azure DevOps.
  • Experience defining data observability, SLAs/SLOs, incident response, and stakeholder communication.
  • Preferred: Databricks certification, Unity Catalog, dbt, Dagster Cloud, ODCS/data contracts, dlt, data quality tooling, MLOps, Azure, regulated-industry experience, or disciplined AI-assisted development.

Benefits

  • Comprehensive health, dental, and vision insurance.
  • Mental health benefits and an employee assistance program.
  • Paid time off, paid parental leave, short-term disability, and a cultural observance day.
  • Healthcare account contributions, a pension plan, and a 401(k) plan with company matching.
  • ProHealth Rewards wellness program with opportunities to earn cash rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job - 32120] Principal Data Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior Data Platform Engineer/Architect to build a new Databricks lakehouse platform for a legal-services client, transforming historical legal records into reliable data for analytics, machine learning, and business intelligence.

Brazil Full-time Lead Data Engineer
AWS AWS CDK Azure Databricks Machine Learning Terraform
4 hours, 56 minutes ago
N-iX

Senior Data Engineer

N-iX 1K-5K Internet Software & Services

A Senior Data Engineer will architect and operate high-performance GCP-based ingestion, CDC, and delivery pipelines that support large-scale metadata, feature extraction, and licensable asset datasets for downstream AI/ML systems.

Europe Full-time Senior Data Engineer
Apache Airflow AWS Azure CI/CD ClickHouse GCP GitHub Actions Go Java Python Scala Snowflake SQL
5 hours, 26 minutes ago
N-iX

Senior Data Engineer

N-iX 1K-5K Internet Software & Services

A Senior Data Engineer will design, scale, and maintain GCP-based ingestion, CDC, and delivery pipelines that process large-scale metadata and asset datasets for downstream AI/ML systems.

Ukraine Full-time Senior Data Engineer
Apache Airflow AWS Azure CI/CD ClickHouse GCP GitHub Actions Go Java Kubernetes Python Scala Serverless Snowflake SQL
5 hours, 41 minutes ago
Zip

Senior Data Engineer

Zip 1K-5K Banks

Zip is seeking a Senior Data Engineer to build and operate scalable cloud data platforms, pipelines, and trusted data products supporting analytics, risk, finance, product, and AI initiatives.

United States Full-time Senior Data Engineer
$134k-$175k
Apache Airflow AWS Azure CI/CD Dagster Databricks dbt Git Kafka Machine Learning Python Snowflake SQL
5 hours, 56 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers