RemoteLeaf Logo
Log in Sign up

[Job-29175] Engenheiro(a) de Dados SENIOR, Brasil

11 hours, 34 minutes ago
Brazil
Full-time
Senior
Data Engineer
Data Science and Analytics
Apache Airflow Apache Spark Azure CI/CD Databricks dbt GCP Git GitHub Actions Kafka Python SQL Terraform
Apply Now
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995
View All Jobs 149

Description

  • Analyze and migrate existing Spark/Databricks pipelines and notebooks to the new platform.
  • Refactor or rewrite legacy processes using SQL, Dataform, and Dataflow.
  • Build ETL/ELT transformations in BigQuery and Dataform.
  • Develop Silver and Gold data layers with quality, deduplication, and standardization controls.
  • Implement batch and streaming ingestion using Dataflow, Datastream, and Apache Beam.
  • Support raw-layer persistence using Iceberg tables managed by BigLake.
  • Provision infrastructure with Terraform and manage delivery through CI/CD pipelines using GitHub Actions.
  • Implement Dataform tests and strengthen cataloging, lineage, and secure data sharing.
  • Work within a Data Mesh model organized by domain and supported by modern data technologies.
  • Contribute to the decommissioning of the legacy environment while enabling new AI and analytics capabilities.

Requirements

  • Advanced SQL experience, preferably with BigQuery.
  • Hands-on experience with GCP services including BigQuery, GCS, Dataflow, and Cloud Composer (Airflow).
  • Experience with Python and Apache Spark.
  • Knowledge of data lakehouse concepts and data modeling.
  • Experience with partitioning and file formats such as Parquet, Avro, and Iceberg.
  • Experience with Git and CI/CD practices.
  • Experience with Dataform or DBT is a plus.
  • Experience with Databricks is a plus.
  • Experience with Terraform and Infrastructure as Code is a plus.
  • Experience with streaming and event platforms such as Kafka or Event Hubs is a plus.
  • Knowledge of data governance and security tools such as Dataplex, IAM, and VPC Service Controls is a plus.

Benefits

  • Health and dental insurance.
  • Food and meal allowances.
  • Childcare assistance.
  • Extended parental leave.
  • Gym and wellness partnerships through Wellhub (Gympass) and TotalPass.
  • Profit sharing (PLR).
  • Life insurance.
  • Continuous learning platform through CI&T University.
  • Discount club and free online physical, mental, and well-being support platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Censys

Senior Security Data Engineer

Censys 51-250 IT Services

Censys is hiring a Senior Security Data Engineer to transform large-scale Internet telemetry into labeled, model-ready security data that powers AI/ML classification and security insights for its platform.

United States Full-time Senior Data Engineer
$153k-$212k
DNS Go HTTP Machine Learning Python SQL SSH TLS
3 hours, 31 minutes ago
ALTEN Technology

Software Engineer – Data Pipelines / ETL / MLOps

ALTEN Technology 251-1K Construction & Engineering

ALTEN Technology USA is hiring a Software Engineer to build and support data pipelines, ETL, and MLOps systems that help production machine learning models run reliably at scale.

United States Full-time Mid Level Data Engineer Machine Learning Engineer
$90k-$130k
Apache Airflow Apache Spark GCP Kafka Kubeflow MLflow MLOps Python Scala Snowflake SQL
4 hours, 41 minutes ago
qode

Data Engineer

qode Internet Software & Services

CoderPush is hiring a Data Engineer for its Data Platform team to build scalable data pipelines and support analytics and data-driven decision-making across the organization.

Vietnam Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS Databricks dbt Docker EC2 GitHub Actions Kubernetes Python SQL Terraform
8 hours, 20 minutes ago
A2Z Sync

Head of Data Platform

A2Z Sync 51-250 Internet Software & Services

A2Z Sync is hiring a data platform architect to design the governed, tenant-isolated data substrate that turns its automotive SaaS platform into a closed-loop dealer intelligence and optimization engine.

United States Full-time Lead Data Engineer
Apache Airflow AWS CircleCI CloudFormation DynamoDB JSON MySQL OpenSearch OpenTelemetry REST API SOAP SQL XML
14 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers