Senior Data Engineer - Azure Databricks

1 month, 1 week ago
Full-time
Senior
DevOps and Infrastructure
Coforge

Coforge

Coforge is a global digital services provider specializing in transforming businesses through technology and industry expertise, powering growth with innovative solutions and platforms.

IT Services
10K-50K
Founded 1992

Description

  • Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.
  • Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
  • Support large-scale data migrations from Snowflake on AWS to Azure Databricks.
  • Build and manage infrastructure-as-code solutions using Terraform.
  • Ensure seamless integration across enterprise data platforms and environments.
  • Implement data quality frameworks, testing, and validation processes.
  • Enable observability through monitoring, logging, and alerting solutions.
  • Contribute to the design of scalable data architectures aligned with Lakehouse principles.
  • Monitor and support production environments to ensure performance and reliability.
  • Collaborate with cross-functional teams and mentor junior engineers through best practices and code reviews.

Requirements

  • 5 to 8+ years of experience in Data Engineering within enterprise-scale environments.
  • Strong hands-on expertise with Azure Databricks, DBT, and Snowflake.
  • Strong proficiency in Python and SQL.
  • Proven experience building and managing large-scale data pipelines and transformations.
  • Experience working with high-volume datasets and complex data models.
  • Solid understanding of data modeling, ETL/ELT frameworks, distributed systems, and Lakehouse architectures.
  • Experience with Terraform and Infrastructure as Code (IaC) principles.
  • Strong experience with CI/CD pipelines and Git-based version control.
  • Experience supporting production systems, including monitoring, alerting, and incident resolution.
  • Knowledge of data quality, testing, and observability frameworks.
  • Excellent analytical, problem-solving, and communication skills.
  • Experience in insurance or financial services environments (preferred).
  • Experience with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables (preferred).
  • Knowledge of security, compliance, and data protection standards in regulated industries (preferred).
  • Experience with cloud cost optimization and performance tuning (preferred).
  • Exposure to multi-cloud or hybrid architectures (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer

CodeRoad 51-250 Internet Software & Services

CodeRoad is hiring a Senior Data Engineer in Latin America to build and optimize secure, agent-ready data foundations that support real-time analytics, RAG applications, and AI agent workflows.

Apache Airflow AWS Dagster dbt Kafka PostgreSQL Prefect SQL Terraform
22 hours, 16 minutes ago

Vendor Integration Engineer

Quantum Health 1K-5K Professional Services

Quantum Health is seeking a Vendor Integration Engineer to design, deliver, and support partner data exchanges and APIs that enable reliable healthcare operations for its members.

Apache Airflow AWS GCP HIPAA JSON REST API SFTP SOAP SQL XML
23 hours, 16 minutes ago

Staff Data Engineer - US Remote

PerfectServe 251-1K Internet Software & Services

PerfectServe is hiring a senior data platform engineer to turn its unified healthcare data platform strategy into a production-ready system that supports trusted analytics and business decisions across its product portfolio.

Apache Airflow AWS Dagster Databricks dbt GCP Prefect Snowflake SQL
23 hours, 16 minutes ago

Data Engineer

UJET 251-1K Professional Services

UJET is hiring a Data Engineer to own and modernize the end-to-end data platform powering customer analytics, operational reporting, and trusted business metrics.

CI/CD dbt GCP Git Go Kubernetes Looker MySQL Python Ruby on Rails SQL Terraform
1 day, 22 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers