RemoteLeaf Logo
Log in Sign up

Principal Data Platform Engineer (Databricks)

3 hours, 11 minutes ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt GCP Python SQL
Apply Now
Prominence

Prominence

Prominence is a top healthcare advisory firm that maximizes data utilization, improving patient care, efficiency, and cost-effectiveness for hospitals.

Professional Services
51-250
View All Jobs 19

Description

  • Own the end-to-end architecture and delivery of scalable data solutions on Databricks and modern cloud ecosystems.
  • Lead the design and implementation of data pipelines, data models, and transformation frameworks for analytics, reporting, and advanced use cases.
  • Serve as a primary client-facing technical leader and guide stakeholders through complex data challenges and solution decisions.
  • Translate ambiguous business requirements into clear technical architectures and delivery plans.
  • Establish and enforce best practices for data ingestion, pipeline orchestration, testing, optimization, and DevOps.
  • Drive platform strategy and architecture decisions, including lakehouse design, medallion architecture, and governance frameworks.
  • Lead and mentor delivery teams through technical guidance, code reviews, and hands-on support.
  • Collaborate with data architects, analysts, and client stakeholders to align on scope and value delivery.
  • Identify risks, proactively resolve challenges, and ensure high-quality, timely delivery across engagements.
  • Contribute to reusable frameworks, accelerators, thought leadership, and business development efforts.

Requirements

  • 7+ years of experience in data engineering, with progression into technical leadership and architecture ownership.
  • Deep expertise in Databricks and modern lakehouse architectures, including Delta Lake and Spark-based processing.
  • Advanced proficiency in SQL and Python, with experience building and optimizing large-scale data pipelines.
  • Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including data services and infrastructure design.
  • Strong understanding of data modeling, ETL/ELT patterns, and distributed data processing.
  • Experience with orchestration tools such as Airflow and transformation frameworks such as dbt.
  • Proven ability to lead technical delivery while remaining hands-on when needed.
  • Strong client-facing experience, including requirements gathering, solution design, and executive communication.
  • Ability to navigate ambiguity, prioritize effectively, and drive clarity in complex environments.
  • Healthcare data experience such as Epic, HL7, FHIR, or claims data is strongly preferred.
  • Experience with CI/CD, DevOps practices, and infrastructure-as-code tools is a plus.
  • Must be legally authorized to work in the United States without sponsorship.
  • Ability to work remotely from a personal home office, travel for onsite meetings as needed, and flex across time zones.

Benefits

  • Competitive salaried and hybrid compensation plans.
  • Health care coverage including medical, HSA, dental, and vision.
  • Retirement plan with 401(k).
  • Life insurance, including basic, voluntary, and AD&D coverage.
  • Dependent care and health savings accounts.
  • Short-term and long-term disability coverage.
  • Paid time off, including vacation, sick leave, and public holidays.
  • Training and development fund.
  • Work-from-home support.
  • Charitable giving opportunities to causes you believe in.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Spotify

Data Engineer - Wrapped - Fixed Term

Spotify Media

Spotify’s Personalization team is hiring a fixed-term Data Engineer for the Timeturners squad to build the data systems behind Wrapped and other personalized experiences for hundreds of millions of listeners.

United States Europe Middle East Africa Contract Mid Level Data Engineer
Apache Spark GCP Java Python Scala
1 hour ago
Mindrift.ai: Be the “I” in AI

Senior Python Data Scraping Engineer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote Senior Python Data Scraping Engineer for the Tendem project to support hybrid AI + human data extraction workflows and deliver accurate structured datasets.

Bulgaria Czech Republic Hungary Poland Romania Slovakia Part-time Senior Backend Engineer Data Engineer
Up to $0k
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
1 hour, 30 minutes ago
Magna Legal Services

Senior Manager - Data Engineering

Magna Legal Services 251-1K Specialized Consumer Services

Magna Legal Services is hiring a Senior Manager of Data Engineering to lead and mature its Snowflake- and Azure-based data platform, with responsibility for turning raw data into trusted, well-modeled assets for analytics, product, and operations teams.

United States Full-time Lead Data Architect Data Engineer
$140k-$170k
Azure CI/CD dbt Python Snowflake SQL
1 hour, 54 minutes ago
Intellectsoft

Senior Data Engineer (part-time) (IR-523)

Intellectsoft 251-1K Internet Software & Services

Intellectsoft is hiring a data engineering professional to build and maintain reporting data warehouse and Power BI datasets that support operational analytics and business decision-making across multiple data sources.

Ukraine Part-time Senior Data Engineer
Apache Airflow CRM Dagster dbt ERP PostgreSQL Power BI Prefect SQL
3 hours, 11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers