RemoteLeaf Logo
Log in Sign up

[Job-32197] Tech Lead Data - Databricks

57 minutes ago
Brazil
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark Azure CI/CD Databricks dbt Git Kafka Python SQL
Apply Now
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995
View All Jobs 116

Description

  • Provide technical leadership to Data Engineering squads through design reviews, technical decisions, and delivery support.
  • Define technical standards, coding practices, modeling conventions, and Lakehouse best practices with the Data Architect.
  • Design and oversee Databricks pipelines across Bronze, Silver, and Gold layers.
  • Implement DataOps practices including Git version control, CI/CD, automated testing, and documentation.
  • Optimize Spark jobs and pipelines for performance, cost, reliability, observability, and alerting.
  • Ensure security, access control, and data policies across Azure and Databricks.
  • Translate business and analytics requirements into scalable solutions and realistic delivery plans.
  • Mentor engineers and create templates, playbooks, and technical references.

Requirements

  • Strong Data Engineering experience, including technical and operational leadership as a Tech Lead or Senior Engineer.
  • Hands-on Databricks experience with PySpark, Spark SQL, and batch pipelines; streaming knowledge is beneficial.
  • Mastery of Delta Lake and practical experience with Medallion architecture.
  • Experience with Azure data services, including Azure Databricks, ADLS, and Azure Active Directory or equivalent identity services.
  • Strong Python and SQL skills, with knowledge of dimensional modeling, consumption models, contracts, and schemas.
  • Experience with DataOps, including Git, CI/CD, automated testing, and technical documentation.
  • Ability to review designs and code, resolve performance and scalability issues, and guide engineering teams.
  • Advanced English for stakeholder collaboration and technical documentation.
  • Experience with Unity Catalog, Databricks Workflows or Repos, and Delta Live Tables is preferred.
  • Experience with data quality tools, dbt, Airflow, streaming or CDC technologies, consulting, international clients, or Databricks/Azure certifications is preferred.

Benefits

  • Health and dental insurance, life insurance, meal and food allowances, and childcare assistance.
  • Extended paternity leave and pregnancy and responsible parenting support.
  • Profit Sharing and Results Participation (PLR).
  • Gym and wellness partnerships through Wellhub/Gympass and TotalPass.
  • Physical, mental, and overall well-being programs.
  • Continuous learning through CI&T University, online learning partnerships, and a language learning platform.
  • Discount club and additional employee benefits.
  • Inclusion support, health and well-being specialists, and affinity groups.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Trility Consulting

Senior Data Consultant (Microsoft Fabric)

Trility Consulting 51-250 Internet Software & Services

Trility Consulting is seeking a remote Senior Data Consultant to help modernize a client’s Azure Synapse platform and migrate prioritized workloads to Microsoft Fabric.

United States Full-time Senior Cloud Engineer Data Engineer
Apache Spark Azure CI/CD Databricks Git GitHub Actions Oracle REST API SQL
1 hour, 11 minutes ago
Arcadia

Principal Software Engineer - Platform

Arcadia 251-1K IT Services

Arcadia is hiring a platform engineering leader to own the developer platform spanning its petabyte-scale lakehouse and Kubernetes applications, enabling engineers to deliver secure, reliable, cost-effective healthcare software independently.

United States Full-time Lead Platform Engineer Technical Lead
$250k-$350k
CI/CD Encryption HIPAA Kubernetes
1 hour, 11 minutes ago
Aker Systems

Senior Data Platform Engineer

Aker Systems 51-250 IT Services

Aker Systems is hiring a Senior Data Platform Engineer to build and operate secure, scalable cloud-native data platforms for public-sector and utilities clients.

United Kingdom Full-time Senior Data Engineer
Agile Ansible Apache Airflow Apache Spark Argo CD AWS Azure Bash CI/CD Datadog dbt Docker Elasticsearch ELK Stack Git GitHub GitHub Actions GitLab GitLab CI Grafana Helm Java Jenkins Kafka Kubernetes OpenSearch Packer Prometheus Python SQL Terraform
1 day ago
Capco

Engenheiro de Dados Senior - Remoto

Capco 5K-10K Internet Software & Services

A Capco é uma consultoria global de tecnologia e negócios que atua nos setores financeiro e de energia, oferecendo oportunidades de carreira em um ambiente colaborativo, inclusivo e orientado à inovação.

Brazil Full-time Senior Data Engineer
1 day ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers