Coforge

Coforge

Coforge is a global digital services provider specializing in transforming businesses through technology and industry expertise, powering growth with innovative solutions and platforms.

IT Services
10K-50K
Founded 1992

Description

  • Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.
  • Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
  • Execute and support migration of data from Snowflake on AWS to Azure using Databricks, DBT, and Lakebridge.
  • Build and manage infrastructure as code using Terraform to enable repeatable deployments.
  • Implement data quality frameworks, including DBT testing and validation rules, to ensure trusted pipelines.
  • Enable observability through logging, monitoring, and alerting across pipelines and data workflows.
  • Support data governance standards, including lineage, consistency, and compliance requirements.
  • Contribute to the design and architecture of scalable lakehouse-based data solutions.
  • Monitor and maintain production pipelines to ensure high availability and performance, and troubleshoot incidents with root cause analysis.
  • Work with cross-functional teams and mentor junior engineers through code reviews, guidance, and documentation.

Requirements

  • Strong hands-on experience with Azure Databricks, DBT, Snowflake, Python, and SQL.
  • Proven experience building and managing large-scale data pipelines and transformations.
  • Experience working with high-volume datasets, including terabytes, complex data models, and multiple pipelines.
  • Solid understanding of data modeling and ETL/ELT frameworks.
  • Experience with distributed data systems and lakehouse architectures.
  • Experience with Terraform and infrastructure-as-code principles.
  • Strong experience with CI/CD pipelines and Git-based version control.
  • Experience supporting production systems, including monitoring, alerting, and incident resolution.
  • Knowledge of data quality, testing, and observability frameworks.
  • Strong problem-solving and analytical skills, with excellent communication across technical and non-technical stakeholders.
  • Experience in insurance or financial services domains is highly desirable.
  • Experience with real-time or streaming technologies such as Kafka, Event Hubs, or Delta Live Tables is preferred.
  • Knowledge of security, compliance, and data protection standards in regulated industries is preferred.
  • Experience with cost optimization and performance tuning in cloud environments is preferred.
  • Exposure to multi-cloud or hybrid architectures is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer (Data Architecture)

Wpromote 251-1K Media

Wpromote is seeking a Senior Data Engineer (Data Architecture) to build and evolve the data infrastructure behind its Polaris technology platform, creating reliable, standardized, and scalable shared data products alongside client solutions.

Apache Airflow CI/CD CRM Dagster dbt Facebook Ads GCP Git Google Ads Google Analytics Python SQL
29 minutes ago

Senior Data Engineer

Capital Bank 51-250 Banks

Capital Bank N.A. is seeking a Senior Data Engineer to own enterprise data platforms, pipelines, integrations, and governance across its commercial, consumer card, and mortgage banking businesses.

Agile Apache Airflow Apache Spark Azure CI/CD Encryption GitLab Java Jenkins Kafka Power BI Python SFTP Sisense Snowflake SQL SQL Server Tableau
29 minutes ago

[job-31118] Engenheiro(a) de Dados e Analytics PLENO, Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Engenheiro(a) de Dados Pleno para desenvolver e evoluir soluções escaláveis de Data Engineering e Analytics em projetos globais de dados e inteligência artificial.

AWS Azure CI/CD Docker Git Kubernetes MLflow Power BI Python SQL
29 minutes ago

Manager, Data Platform

ZoomInfo 1K-5K Professional Services

ZoomInfo is seeking a Manager, Data Platform to lead the architecture, delivery, and reliability of enterprise data infrastructure supporting analytics, machine learning, operational systems, and AI applications while managing and developing a team of platform engineers.

Apache Airflow Apache Spark AWS Databricks dbt Prototyping Python Snowflake SQL
2 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers