Lead / Principal Data Engineer - DBT & Databricks

2 weeks, 6 days ago
Lead
Software Development
Coforge

Coforge

Coforge is a global digital services provider specializing in transforming businesses through technology and industry expertise, powering growth with innovative solutions and platforms.

IT Services
10K-50K
Founded 1992

Description

  • Design, build, and maintain DBT models on Azure Databricks using Delta Lake, Unity Catalog, and Medallion Architecture principles.
  • Deliver curated Gold-layer data domains to production standards in regulated enterprise environments.
  • Use AI-assisted development tools for model generation, refactoring, documentation, debugging, and engineering acceleration.
  • Establish DBT testing strategies, including schema validation, data quality testing, unit testing, and automated quality controls.
  • Work in CI/CD-driven delivery environments using pull request workflows and automated quality gates.
  • Curate datasets, semantic definitions, and business terminology for Databricks Genie and natural-language analytics initiatives.
  • Define and enforce data contracts, domain ownership, and governance standards.
  • Implement data observability, monitoring, and root-cause analysis practices across data platforms.
  • Drive modernization and migration initiatives through AI-assisted data engineering approaches.
  • Contribute to engineering playbooks, standards, and enablement programs for DBT, Databricks, and AI-powered development.

Requirements

  • 5+ years of experience in Data Engineering.
  • At least 2 years of hands-on experience building and operating production-grade DBT projects, including models, tests, macros, snapshots, and large-scale refactoring.
  • Strong SQL skills and solid Python programming experience.
  • Hands-on experience with Azure Databricks, including Delta Lake, Unity Catalog, and Medallion Architecture.
  • Strong knowledge of DBT testing frameworks, data validation, and quality assurance best practices.
  • Familiarity with dbt-expectations, Great Expectations, or Delta Live Tables expectations.
  • Experience working with Git-based pull request workflows, code reviews, and CI/CD deployment pipelines.
  • Experience using AI-powered development tools such as Claude Code, GitHub Copilot, Cursor, or similar solutions.
  • Ability to independently own data domains and collaborate directly with business stakeholders.
  • Strong communication, analytical, and problem-solving skills.
  • Experience curating Databricks Genie environments or building semantic layers for natural-language analytics (preferred).
  • Experience within Insurance or Financial Services domains (preferred).
  • Experience working with policy, claims, exposure, or regulatory reporting data (preferred).
  • Hands-on experience with PySpark for large-scale data transformations (preferred).
  • Experience with Databricks Workflows, Airflow, or similar orchestration platforms (preferred).
  • DBT and/or Databricks certifications (preferred).
  • Experience implementing AI-driven modernization and migration programs (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Software Engineer IV, Datastore

Beacon Biosignals 11-50 Biotechnology

Beacon Biosignals is hiring a Software Engineer IV for its Datastore team to design and scale backend data infrastructure supporting brain-data clinical studies, scientific workflows, and digital health products.

AWS GraphQL Helm JavaScript Julia Kafka Kubernetes Node.js PostgreSQL Python RabbitMQ SQL Terraform TypeScript
15 hours, 52 minutes ago

Data Governance and Platform Manager

LawnStarter 11-50 Professional Services

LawnStarter is hiring a Data Governance Platform Manager to build and operate the governance systems that keep data, analytics, AI, and reporting trustworthy across its home-services marketplace.

Apache Airflow dbt Metabase Segment SQL Tableau
16 hours, 22 minutes ago

(1560) Senior Adobe Analytics Developer

Nortal 251-1K Internet Software & Services

Nortal is seeking a Senior Adobe Analytics Developer to join its global delivery team, leading client-facing web and mobile analytics implementations that produce accurate, governed, and actionable data.

Agile Android iOS JavaScript JSON
16 hours, 22 minutes ago

Senior Data Engineer

Buyers Edge Platform 251-1K IT Services

Senior Data Engineer at RealTime Solutions, a Buyers Edge Platform brand, will lead the design and operation of the data platform supporting foodservice products, analytics, and reporting.

Apache Airflow Databricks Git JavaScript Python Snowflake SQL SQL Server
1 day, 14 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers