RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 week, 3 days ago
Brazil
Senior
Data Engineer
Software Development
Apache Airflow Azure CI/CD Databricks dbt Git Kafka Python Snowflake SQL Terraform
Apply Now
Coforge

Coforge

Coforge is a global digital services provider specializing in transforming businesses through technology and industry expertise, powering growth with innovative solutions and platforms.

IT Services
10K-50K
Founded 1992
View All Jobs 68

Description

  • Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.
  • Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
  • Execute and support migration of data from Snowflake on AWS to Azure using Databricks, DBT, and Lakebridge.
  • Build and manage infrastructure as code using Terraform to enable repeatable deployments.
  • Implement data quality frameworks, including DBT testing and validation rules, to ensure trusted pipelines.
  • Enable observability through logging, monitoring, and alerting across pipelines and data workflows.
  • Support data governance standards, including lineage, consistency, and compliance requirements.
  • Contribute to the design and architecture of scalable lakehouse-based data solutions.
  • Monitor and maintain production pipelines to ensure high availability and performance, and troubleshoot incidents with root cause analysis.
  • Work with cross-functional teams and mentor junior engineers through code reviews, guidance, and documentation.

Requirements

  • Strong hands-on experience with Azure Databricks, DBT, Snowflake, Python, and SQL.
  • Proven experience building and managing large-scale data pipelines and transformations.
  • Experience working with high-volume datasets, including terabytes, complex data models, and multiple pipelines.
  • Solid understanding of data modeling and ETL/ELT frameworks.
  • Experience with distributed data systems and lakehouse architectures.
  • Experience with Terraform and infrastructure-as-code principles.
  • Strong experience with CI/CD pipelines and Git-based version control.
  • Experience supporting production systems, including monitoring, alerting, and incident resolution.
  • Knowledge of data quality, testing, and observability frameworks.
  • Strong problem-solving and analytical skills, with excellent communication across technical and non-technical stakeholders.
  • Experience in insurance or financial services domains is highly desirable.
  • Experience with real-time or streaming technologies such as Kafka, Event Hubs, or Delta Live Tables is preferred.
  • Knowledge of security, compliance, and data protection standards in regulated industries is preferred.
  • Experience with cost optimization and performance tuning in cloud environments is preferred.
  • Exposure to multi-cloud or hybrid architectures is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

D

Cyber Data Engineer

D2 Technical Services 11-50 IT services and consulting

D2 Technical Services is hiring a systems engineer to support national security cybersecurity operations by managing infrastructure, data pipelines, and SIEM environments.

United States Full-time Senior Data Engineer Security Engineer
$140k-$145k
AWS Bash Cybersecurity DHCP DNS Elasticsearch GCP Linux PowerShell Python SIEM Splunk
17 hours, 16 minutes ago
Voyager

Senior DataOps Engineer

Voyager Life Sciences Tools & Services

Voyager Technologies is hiring a remote US-based DataOps Engineer to own cloud-to-data platform migration and operations for mission-critical analytics in a regulated national security environment.

United States Full-time Senior Data Engineer
$150k-$180k
Ansible Apache Airflow Apache Spark AWS Azure Cassandra CloudFormation dbt Docker Git GitHub GitHub Actions GitLab GitLab CI Kafka Kubernetes MongoDB Pandas PostgreSQL PowerShell Python Redis Scala SQLAlchemy SQL Server Terraform
17 hours, 46 minutes ago
Dragos

Data Engineering Manager

Dragos 251-1K Professional Services

Dragos is seeking a Data Engineering Manager to lead the team building the core data layer that supports its cybersecurity products and threat-focused engineering work.

United States Full-time Lead Data Engineer Engineering Manager
$220k-$220k
Agile Apache Airflow ClickHouse Cybersecurity dbt Docker Kubernetes PostgreSQL Rust SOC
17 hours, 46 minutes ago
Movement Labs

Senior Data Engineers

Movement Labs 11-50 Media

Movement Labs is hiring Senior and Mid-level Data Engineers to support its progressive political data platform, with a focus on building and operating systems for voter outreach, experimentation, and election readiness.

United States Contract Senior Data Engineer
$90k-$119k
Apache Airflow Dagster dbt GCP Python SQL
18 hours, 1 minute ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers