RemoteLeaf Logo
Log in Sign up

Principal Data Platform Engineer (Databricks)

3 weeks, 3 days ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt GCP Python SQL
Apply Now
Prominence

Prominence

Prominence is a top healthcare advisory firm that maximizes data utilization, improving patient care, efficiency, and cost-effectiveness for hospitals.

Professional Services
51-250
View All Jobs 23

Description

  • Own the end-to-end architecture and delivery of scalable data solutions on Databricks and modern cloud ecosystems.
  • Lead the design and implementation of data pipelines, data models, and transformation frameworks for analytics, reporting, and advanced use cases.
  • Serve as a primary client-facing technical leader and guide stakeholders through complex data challenges and solution decisions.
  • Translate ambiguous business requirements into clear technical architectures and delivery plans.
  • Establish and enforce best practices for data ingestion, pipeline orchestration, testing, optimization, and DevOps.
  • Drive platform strategy and architecture decisions, including lakehouse design, medallion architecture, and governance frameworks.
  • Lead and mentor delivery teams through technical guidance, code reviews, and hands-on support.
  • Collaborate with data architects, analysts, and client stakeholders to align on scope and value delivery.
  • Identify risks, proactively resolve challenges, and ensure high-quality, timely delivery across engagements.
  • Contribute to reusable frameworks, accelerators, thought leadership, and business development efforts.

Requirements

  • 7+ years of experience in data engineering, with progression into technical leadership and architecture ownership.
  • Deep expertise in Databricks and modern lakehouse architectures, including Delta Lake and Spark-based processing.
  • Advanced proficiency in SQL and Python, with experience building and optimizing large-scale data pipelines.
  • Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including data services and infrastructure design.
  • Strong understanding of data modeling, ETL/ELT patterns, and distributed data processing.
  • Experience with orchestration tools such as Airflow and transformation frameworks such as dbt.
  • Proven ability to lead technical delivery while remaining hands-on when needed.
  • Strong client-facing experience, including requirements gathering, solution design, and executive communication.
  • Ability to navigate ambiguity, prioritize effectively, and drive clarity in complex environments.
  • Healthcare data experience such as Epic, HL7, FHIR, or claims data is strongly preferred.
  • Experience with CI/CD, DevOps practices, and infrastructure-as-code tools is a plus.
  • Must be legally authorized to work in the United States without sponsorship.
  • Ability to work remotely from a personal home office, travel for onsite meetings as needed, and flex across time zones.

Benefits

  • Competitive salaried and hybrid compensation plans.
  • Health care coverage including medical, HSA, dental, and vision.
  • Retirement plan with 401(k).
  • Life insurance, including basic, voluntary, and AD&D coverage.
  • Dependent care and health savings accounts.
  • Short-term and long-term disability coverage.
  • Paid time off, including vacation, sick leave, and public holidays.
  • Training and development fund.
  • Work-from-home support.
  • Charitable giving opportunities to causes you believe in.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Marqeta

Senior Staff Software Engineer - Data Platform

Marqeta 251-1K Diversified Financial Services

Marqeta is hiring a software engineer to own the company’s data platform foundation, building the lakehouse and streaming ingestion systems that power its broader data and ML organization.

United States Full-time Lead Data Engineer
$200k-$275k
Apache Airflow Apache Spark AWS Go Java Kafka Python
13 hours, 9 minutes ago
Affirm

Software Engineer II, Machine Learning (Feature Platform)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a software engineer for its ML Feature Platform team to build the self-serve data and feature infrastructure that powers machine learning and decisioning across the company.

United States Full-time Junior Data Engineer Machine Learning Engineer
$146k-$225k
AWS Kotlin Kubernetes Machine Learning MySQL Python
13 hours, 24 minutes ago
Samsara

Senior Data Engineer

Samsara 1K-5K IT Services

Samsara is hiring a Senior Data Engineer in Canada to build and evolve its enterprise data platform, powering analytics, automation, and AI-enabled data workflows across the company.

Canada Full-time Lead Data Engineer
$89k-$105k
Agile Apache Spark API Gateway AWS Azure Databricks Datadog dbt GCP LLM MySQL PostgreSQL Python Serverless Snowflake Splunk SQL SQL Server
13 hours, 24 minutes ago
Penumbra

Clinical Data Analyst II

Penumbra 1K-5K Health Care Providers & Services

Penumbra, Inc. is hiring a Clinical Data Analyst II to support clinical study data analysis, reporting, and data management activities that improve operational processes.

United States Full-time Junior Data Analyst Data Engineer
C# MATLAB Python R SQL
13 hours, 39 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers