RemoteLeaf Logo
Log in Sign up

[Job - 30813] Senior Data Developer (Databricks), Brazil

1 week, 2 days ago
Brazil
Full-time
Senior
Data Engineer
Software Development
Apache Spark Azure CI/CD Databricks Git Pytest Secrets Management
Apply Now
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995
View All Jobs 82

Description

  • Work on assigned tickets and bugs while proactively identifying tech debt, refactoring opportunities, and automation gaps.
  • Own and evolve notebooks across the Stage, Bronze, Silver, and Gold layers of the data platform.
  • Design and implement dimensional modeling artifacts, including facts, dimensions, and slowly changing dimensions.
  • Modify data processing jobs and workflows to support changing business requirements.
  • Review pull requests and enforce code quality, performance, and architectural consistency.
  • Deploy and promote changes across Dev, QA, UAT, and PROD environments while maintaining deployment tracking.
  • Monitor and troubleshoot production jobs using diagnostic tools, job logs, and table history.
  • Maintain and improve automated testing, including CI/CD workflows and the underlying test framework.
  • Keep technical documentation current as pipelines and integrations evolve.
  • Act as the primary technical reference for the team and support stakeholders on data architecture and pipeline design.

Requirements

  • Solid hands-on production experience with Databricks.
  • Strong proficiency in PySpark and Databricks SQL, including performance tuning and query optimization.
  • Practical experience with Delta Lake, including MERGE/upsert patterns, ACID transactions, time travel, and maintenance operations.
  • Experience implementing Slowly Changing Dimensions Type 1 and Type 2 and working with dimensional modeling concepts.
  • Experience with medallion or comparable layered architecture, Unity Catalog, jobs/workflows, secrets management, and notebook-based development.
  • Experience with Git and Azure DevOps or equivalent CI/CD tooling, plus Microsoft Azure services such as Key Vault, Service Principal/Managed Identity, and Data Lake Storage.
  • Ability to read and navigate a large, established codebase and ramp up quickly in a business-rule-heavy environment.
  • Advanced English communication skills (C1 or above) for direct work with US-based client stakeholders.
  • Experience with Databricks Asset Bundles or other Infrastructure-as-Code approaches (preferred).
  • Familiarity with Delta Live Tables and Databricks Genie / AI/BI Genie (preferred).
  • Familiarity with data quality frameworks such as Great Expectations or Soda Core (preferred).
  • Experience with pytest and databricks-connect for automated testing of Spark pipelines (preferred).
  • Familiarity with Pydantic, schema migration/versioning tools, or similar approaches (preferred).
  • Comfort using AI-assisted development tools such as GitHub Copilot or Cursor (preferred).

Benefits

  • Health and dental insurance.
  • Meal and food allowance.
  • Childcare assistance.
  • Extended paternity leave.
  • Gym and wellness partnerships through Wellhub (Gympass) and TotalPass.
  • Profit Sharing and Results Participation (PLR).
  • Life insurance.
  • Continuous learning through CI&T University and partnerships with online learning and language platforms.
  • Free online platform for physical, mental, and overall well-being.
  • Pregnancy and responsible parenting course.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cortex

Senior Data Engineer

Cortex 11-50 Internet Software & Services

Cortex is hiring a Senior Data Engineer to own internal data systems and pipelines that power company-wide reporting, product analytics, and AI-driven operations from a fully remote US-based team.

United States Full-time Senior Data Engineer
$175k-$205k
ClickHouse dbt GCP OpenTelemetry Python Segment SQL
16 hours, 7 minutes ago
Standard Metrics

Data Solutions Engineer

Standard Metrics 11-50 Capital Markets

Standard Metrics is hiring a Data Solutions Engineer to own customer-facing data workflows, integrations, and AI-driven automation for a financial data platform serving investors and portfolio companies.

United States Mid Level Data Engineer Solutions Engineer
dbt LLM Python REST API Snowflake SQL
1 day, 16 hours ago
Oportun

Senior Data Engineer (R13923)

Oportun 1K-5K Banks

Oportun is hiring a Senior Data Engineer to design and deliver scalable data platforms and solutions that support business and analytical needs across cross-functional initiatives.

Mexico Full-time Senior Data Engineer
Agile Apache Airflow Apache Spark AWS Azure Databricks GCP Hadoop Java Jenkins Kafka Kanban MariaDB PostgreSQL Python Scala Scrum SQL
2 days, 16 hours ago
Xebia

AWS Senior DevOps Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring a Senior DevOps Engineer to provision and operate a multi-region AWS environment for a US expansion while maintaining parity with the existing EU setup and supporting analytics and security operations.

Bulgaria Romania Senior Data Engineer DevOps Engineer
AWS CI/CD Penetration Testing PostgreSQL
2 days, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers