[Job-32192] Senior Data Engineer - Databricks

4 hours, 36 minutes ago
Full-time
Senior
Software Development
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5001+
Founded 1995

Description

  • Develop and maintain large-scale data pipelines.
  • Design and implement data integration and transformation workflows for APIs, relational databases, files, and other sources.
  • Collaborate with business and analytics teams to define and meet data requirements.
  • Ensure the quality, reliability, security, and governance of ingested data.
  • Apply DataOps practices including code versioning, data testing, and CI/CD.
  • Document data engineering processes and best practices.
  • Provide technical guidance and mentor peers.
  • Collaborate with data scientists, analysts, and platform engineers.

Requirements

  • Experience building and managing large-scale data pipelines in Databricks using PySpark, Delta Lake, and SQL.
  • Strong Python and SQL programming skills for data processing and transformation.
  • Deep understanding of ETL/ELT frameworks, data warehousing, and distributed data processing.
  • Hands-on experience with Git, CI/CD pipelines, automated testing, and infrastructure as code.
  • Familiarity with AWS, Azure, or GCP and related data services.
  • Ability to troubleshoot data platform performance, scalability, and reliability issues.
  • Advanced English proficiency.
  • Experience with data contracts, schema evolution, and cross-service compatibility (preferred).
  • Experience with data quality frameworks such as Great Expectations, Soda, dbt tests, or custom solutions (preferred).
  • Experience integrating with Power BI (preferred).

Benefits

  • Health, dental, and life insurance.
  • Meal and food allowance.
  • Childcare assistance and extended paternity leave.
  • Profit sharing and results participation (PLR).
  • Gym and wellness partnerships through Wellhub (Gympass) and TotalPass.
  • Continuous learning through CI&T University, online learning partnerships, and a language-learning platform.
  • Free physical, mental, and overall well-being platform.
  • Discount club and pregnancy and responsible parenting course.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior DBA / Data Modeler / Data Engineer

Pingwind 51-200 Internet Software & Services

PingWind is seeking a remote DBA / Data Modeler / Data Engineer to lead secure data migration, modeling, integration, and database operations for the modernization of FSA IAM systems.

Cybersecurity
4 hours, 21 minutes ago

DBA / Data Modeler / Data Engineer

Pingwind 51-200 Internet Software & Services

PingWind is seeking a remote DBA / Data Modeler / Data Engineer to manage and optimize data for FSA IAM systems, enabling secure identity management, reporting, fraud analysis, and system integrations.

Cybersecurity
4 hours, 21 minutes ago

Senior Data Engineer AWS

Coderio 201-500 Internet Software & Services

Coderio is hiring a Senior Data Engineer in Argentina, Brazil, or Uruguay to build and optimize scalable data platforms for high-volume financial and transactional systems supporting international clients.

Apache Airflow Apache Spark AWS CI/CD Cybersecurity Databricks dbt Docker GCP Git GitHub Actions GitLab CI Java Kafka Python Scala Snowflake SQL Terraform
4 hours, 21 minutes ago

Senior Data Engineer - USA

Coderio 201-500 Internet Software & Services

Coderio is seeking a US-based Senior Data Engineer to build and operate scalable cloud data pipelines that power data products and ML workflows for global software projects.

Apache Spark AWS CI/CD Docker GCP Generative AI Git Linux MLOps Python REST API SQL Terraform Unix
4 hours, 21 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers