RemoteLeaf Logo
Log in Sign up

Principal Data Platform Engineer (Databricks)

1 month, 2 weeks ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt GCP Python SQL
Apply Now
Prominence

Prominence

Prominence is a top healthcare advisory firm that maximizes data utilization, improving patient care, efficiency, and cost-effectiveness for hospitals.

Professional Services
51-250
View All Jobs 14

Description

  • Own the end-to-end architecture and delivery of scalable data solutions on Databricks and modern cloud ecosystems.
  • Lead the design and implementation of data pipelines, data models, and transformation frameworks for analytics, reporting, and advanced use cases.
  • Serve as a primary client-facing technical leader and guide stakeholders through complex data challenges and solution decisions.
  • Translate ambiguous business requirements into clear technical architectures and delivery plans.
  • Establish and enforce best practices for data ingestion, pipeline orchestration, testing, optimization, and DevOps.
  • Drive platform strategy and architecture decisions, including lakehouse design, medallion architecture, and governance frameworks.
  • Lead and mentor delivery teams through technical guidance, code reviews, and hands-on support.
  • Collaborate with data architects, analysts, and client stakeholders to align on scope and value delivery.
  • Identify risks, proactively resolve challenges, and ensure high-quality, timely delivery across engagements.
  • Contribute to reusable frameworks, accelerators, thought leadership, and business development efforts.

Requirements

  • 7+ years of experience in data engineering, with progression into technical leadership and architecture ownership.
  • Deep expertise in Databricks and modern lakehouse architectures, including Delta Lake and Spark-based processing.
  • Advanced proficiency in SQL and Python, with experience building and optimizing large-scale data pipelines.
  • Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including data services and infrastructure design.
  • Strong understanding of data modeling, ETL/ELT patterns, and distributed data processing.
  • Experience with orchestration tools such as Airflow and transformation frameworks such as dbt.
  • Proven ability to lead technical delivery while remaining hands-on when needed.
  • Strong client-facing experience, including requirements gathering, solution design, and executive communication.
  • Ability to navigate ambiguity, prioritize effectively, and drive clarity in complex environments.
  • Healthcare data experience such as Epic, HL7, FHIR, or claims data is strongly preferred.
  • Experience with CI/CD, DevOps practices, and infrastructure-as-code tools is a plus.
  • Must be legally authorized to work in the United States without sponsorship.
  • Ability to work remotely from a personal home office, travel for onsite meetings as needed, and flex across time zones.

Benefits

  • Competitive salaried and hybrid compensation plans.
  • Health care coverage including medical, HSA, dental, and vision.
  • Retirement plan with 401(k).
  • Life insurance, including basic, voluntary, and AD&D coverage.
  • Dependent care and health savings accounts.
  • Short-term and long-term disability coverage.
  • Paid time off, including vacation, sick leave, and public holidays.
  • Training and development fund.
  • Work-from-home support.
  • Charitable giving opportunities to causes you believe in.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dan.com - a GoDaddy brand

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

United States Contract Lead Data Engineer
AWS
13 hours, 2 minutes ago
Xebia

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Romania Bulgaria Poland Europe Senior Data Engineer
Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
13 hours, 2 minutes ago
Coupang

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

South Korea Full-time Lead Data Engineer
Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
13 hours, 17 minutes ago
Cresteo

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

Latin America Full-time Senior Database Administrator Data Engineer
JSON SQL Server
13 hours, 17 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers