Lead Data Engineer - Databricks

4 weeks ago
Full-time
Lead
Software Development
OZ Digital,

OZ Digital,

OZ Digital Consulting Unlock growth opportunities with OZ Digital Consulting. Our expert solutions drive innovation, transformation, and success for your business. OZ is a consulting and technology solutions leader focused on increasing customer engage...

Internet Software & Services
251-1K
Founded 1997

Description

  • Serve as the technical lead for the project, owning solution design decisions and implementation standards.
  • Mentor other engineers through coaching, code reviews, and knowledge sharing.
  • Design, develop, and maintain complex ETL pipelines in Databricks.
  • Implement and optimize medallion architecture with raw, curated, and trusted data zones.
  • Develop dimensional data models that support analytics-ready reporting and KPI frameworks.
  • Collaborate with data stewards, IT, and business stakeholders to translate requirements into technical solutions.
  • Contribute to architectural decisions and recommend best practices for platform durability and flexibility.
  • Identify and resolve integration issues, data quality problems, and process bottlenecks early.
  • Provide documentation and support knowledge transfer so teams can maintain and evolve solutions independently.
  • Push back constructively on risks, assumptions, and inefficiencies to improve project outcomes.

Requirements

  • 3–5 years of hands-on Databricks development experience.
  • Relevant Databricks certifications, with proof required.
  • Proven ability to build, optimize, and troubleshoot production-grade ETL pipelines.
  • Demonstrated experience designing and implementing medallion data models in Databricks environments.
  • Strong experience developing dimensional models for business intelligence, reporting, and single source of truth use cases.
  • Advanced proficiency orchestrating data ingestion, transformation, and integration workflows across multiple systems and formats.
  • Ability to translate operational requirements into technical deliverables and communicate the business impact of engineering decisions.
  • Demonstrated ability to work independently, take initiative, and drive work forward in ambiguous or evolving environments.
  • Experience with Azure Data Lake, Data Factory, or related Azure services is a strong advantage but not required.
  • Experience with human-centric data visualization design principles and tools such as Power BI, Qlik, or Tableau is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Clinical Data Manager (Senior)

Bioptimus 11-50 research

Bioptimus is seeking a Senior Clinical Data Manager to help structure and harmonize real-world clinical data for its STELA program and support the development of AI-ready biomedical datasets.

AWS GCP Git NumPy Pandas Python Statistics
6 hours, 15 minutes ago

Manager, Data/ML Platform

Inspiren 11-50 Internet Software & Services

Inspiren is seeking a Senior Manager to lead its Data + ML Platform group, building the core infrastructure that turns multimodal resident and care data into real-time insights and powers analytics, ML, and next-generation product capabilities.

LLM Machine Learning MLOps
6 hours, 15 minutes ago

Senior Data Engineer

Exadel 1K-5K Internet Software & Services

Exadel is hiring a Senior Data Engineer to help build and lead scalable data ingestion and curation platforms for an international transportation technology client modernizing rail operations.

Agile Apache Airflow Apache Spark AWS Cassandra CI/CD Elasticsearch GCP Hadoop Hive Java MySQL PostgreSQL Python Scala SQL Teradata
6 hours, 30 minutes ago

Intermediate Data Engineer

AB InBev 100K+ Beverages

An early-career Data Engineer role focused on supporting the development, reliability, and governance of data pipelines and analytics workflows at the company.

Apache Spark AWS Azure CI/CD Databricks dbt GCP Git GitHub Actions JSON Python Secrets Management SQL
6 hours, 30 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers