Senior Data Engineer - Azure Databricks

2 weeks, 6 days ago
Full-time
Senior
DevOps and Infrastructure
Coforge

Coforge

Coforge is a global digital services provider specializing in transforming businesses through technology and industry expertise, powering growth with innovative solutions and platforms.

IT Services
10K-50K
Founded 1992

Description

  • Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.
  • Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
  • Support large-scale data migrations from Snowflake on AWS to Azure Databricks.
  • Build and manage infrastructure-as-code solutions using Terraform.
  • Ensure seamless integration across enterprise data platforms and environments.
  • Implement data quality frameworks, testing, and validation processes.
  • Enable observability through monitoring, logging, and alerting solutions.
  • Contribute to the design of scalable data architectures aligned with Lakehouse principles.
  • Monitor and support production environments to ensure performance and reliability.
  • Collaborate with cross-functional teams and mentor junior engineers through best practices and code reviews.

Requirements

  • 5 to 8+ years of experience in Data Engineering within enterprise-scale environments.
  • Strong hands-on expertise with Azure Databricks, DBT, and Snowflake.
  • Strong proficiency in Python and SQL.
  • Proven experience building and managing large-scale data pipelines and transformations.
  • Experience working with high-volume datasets and complex data models.
  • Solid understanding of data modeling, ETL/ELT frameworks, distributed systems, and Lakehouse architectures.
  • Experience with Terraform and Infrastructure as Code (IaC) principles.
  • Strong experience with CI/CD pipelines and Git-based version control.
  • Experience supporting production systems, including monitoring, alerting, and incident resolution.
  • Knowledge of data quality, testing, and observability frameworks.
  • Excellent analytical, problem-solving, and communication skills.
  • Experience in insurance or financial services environments (preferred).
  • Experience with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables (preferred).
  • Knowledge of security, compliance, and data protection standards in regulated industries (preferred).
  • Experience with cloud cost optimization and performance tuning (preferred).
  • Exposure to multi-cloud or hybrid architectures (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Software Engineer IV, Datastore

Beacon Biosignals 11-50 Biotechnology

Beacon Biosignals is hiring a Software Engineer IV for its Datastore team to design and scale backend data infrastructure supporting brain-data clinical studies, scientific workflows, and digital health products.

AWS GraphQL Helm JavaScript Julia Kafka Kubernetes Node.js PostgreSQL Python RabbitMQ SQL Terraform TypeScript
15 hours, 52 minutes ago

Data Governance and Platform Manager

LawnStarter 11-50 Professional Services

LawnStarter is hiring a Data Governance Platform Manager to build and operate the governance systems that keep data, analytics, AI, and reporting trustworthy across its home-services marketplace.

Apache Airflow dbt Metabase Segment SQL Tableau
16 hours, 22 minutes ago

Senior Data Engineer

Buyers Edge Platform 251-1K IT Services

Senior Data Engineer at RealTime Solutions, a Buyers Edge Platform brand, will lead the design and operation of the data platform supporting foodservice products, analytics, and reporting.

Apache Airflow Databricks Git JavaScript Python Snowflake SQL SQL Server
1 day, 14 hours ago

SR Data Engineer (AWS)

Coderio 51-250 Internet Software & Services

Coderio is seeking a Senior Data Engineer in Argentina, Brazil, or Uruguay to build and optimize scalable data platforms for high-volume financial and transactional systems.

Apache Airflow Apache Spark AWS CI/CD Databricks dbt Docker GCP Git GitHub Actions GitLab CI Java Kafka Microservices Python Scala Snowflake SQL Terraform
1 day, 15 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers