Senior Data Engineer - Azure Databricks

5 hours, 22 minutes ago
Full-time
Senior
DevOps and Infrastructure
Coforge

Coforge

Coforge is a global digital services provider specializing in transforming businesses through technology and industry expertise, powering growth with innovative solutions and platforms.

IT Services
10K-50K
Founded 1992

Description

  • Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.
  • Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
  • Support large-scale data migrations from Snowflake on AWS to Azure Databricks.
  • Build and manage infrastructure-as-code solutions using Terraform.
  • Ensure seamless integration across enterprise data platforms and environments.
  • Implement data quality frameworks, testing, and validation processes.
  • Enable observability through monitoring, logging, and alerting solutions.
  • Contribute to the design of scalable data architectures aligned with Lakehouse principles.
  • Monitor and support production environments to ensure performance and reliability.
  • Collaborate with cross-functional teams and mentor junior engineers through best practices and code reviews.

Requirements

  • 5 to 8+ years of experience in Data Engineering within enterprise-scale environments.
  • Strong hands-on expertise with Azure Databricks, DBT, and Snowflake.
  • Strong proficiency in Python and SQL.
  • Proven experience building and managing large-scale data pipelines and transformations.
  • Experience working with high-volume datasets and complex data models.
  • Solid understanding of data modeling, ETL/ELT frameworks, distributed systems, and Lakehouse architectures.
  • Experience with Terraform and Infrastructure as Code (IaC) principles.
  • Strong experience with CI/CD pipelines and Git-based version control.
  • Experience supporting production systems, including monitoring, alerting, and incident resolution.
  • Knowledge of data quality, testing, and observability frameworks.
  • Excellent analytical, problem-solving, and communication skills.
  • Experience in insurance or financial services environments (preferred).
  • Experience with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables (preferred).
  • Knowledge of security, compliance, and data protection standards in regulated industries (preferred).
  • Experience with cloud cost optimization and performance tuning (preferred).
  • Exposure to multi-cloud or hybrid architectures (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

[Job-31034] Engenheiro de Dados (Azure/Databrics) Sênior , Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Data Engineer to ensure data model integrity, consistency, efficiency, and governance across an Azure-based ecosystem.

Apache Spark Azure CI/CD Databricks GitHub MLflow Python SQL
5 hours, 37 minutes ago

Head of Fund Analytics & Automation — Credit Fund

Xsolla 251-1K Internet Software & Services

Xsolla is hiring a Head of Fund Analytics & Automation to build and own the data, automation, and reporting stack for its Credit Fund, supporting underwriting, investor reporting, and portfolio operations.

Apache Airflow PostgreSQL Power BI Python React SQL Tableau TypeScript
5 hours, 52 minutes ago

Associate Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring an Associate Data Engineer to support healthcare data distribution and client delivery on its cloud-based data management platform.

Apache Spark AWS Azure Databricks Snowflake SQL
5 hours, 52 minutes ago

[Job - 31058] Senior Data Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T busca um(a) Desenvolvedor(a) de Dados Sênior para atuar na estratégia de dados de um cliente de mídia e entretenimento, integrando sistemas críticos e entregando uma visão unificada e confiável das informações corporativas.

CRM ERP GCP Salesforce SQL
5 hours, 52 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers