RemoteLeaf Logo
Log in Sign up

[Job - 30813] Senior Data Developer (Databricks), Colombia

1 week, 2 days ago
Colombia
Full-time
Senior
Data Engineer
Software Development
Apache Spark Azure CI/CD Databricks Git Pytest Secrets Management
Apply Now
CI&T

CI&T

CI&T is a global digital technology agency empowering agile growth for leading companies through advanced technologies with a team of 2000 experts worldwide.

Internet Software & Services
5K-10K
Founded 1995
View All Jobs 82

Description

  • Work on assigned tickets and bugs while proactively identifying technical debt, refactoring opportunities, and automation gaps.
  • Own and evolve Databricks notebooks across the Stage, Bronze, Silver, and Gold layers from ingestion through the dimensional model.
  • Design and implement dimensional modeling artifacts, including facts, dimensions, and slowly changing dimensions.
  • Update data processing jobs and workflows to support changing business requirements.
  • Review pull requests and enforce code quality, performance, and architectural consistency.
  • Deploy and promote changes across Dev, QA, UAT, and PROD environments and keep deployment tracking current.
  • Monitor and troubleshoot production jobs using logs, table history, and platform-native diagnostic tools.
  • Maintain and improve automated testing, including CI/CD workflows and the underlying test framework.
  • Keep technical documentation current as the platform and integrations evolve.
  • Act as the team’s primary technical reference for Databricks platform expertise and support stakeholders on data architecture decisions.

Requirements

  • Solid hands-on production experience with the Databricks platform.
  • Strong proficiency in PySpark and Databricks SQL, including performance tuning techniques.
  • Practical experience with Delta Lake, including MERGE/upsert patterns, ACID transactions, time travel, and table maintenance.
  • Experience implementing Slowly Changing Dimensions Type 1 and Type 2 and working with dimensional modeling concepts.
  • Experience with medallion or similar layered architecture, Unity Catalog, jobs/workflows, secrets management, and notebook-based development.
  • Experience with Git and Azure DevOps or equivalent CI/CD tooling.
  • Experience with Microsoft Azure services such as Key Vault, Service Principal/Managed Identity, and Data Lake Storage.
  • Ability to navigate a large established codebase and ramp up quickly in a business-rule-heavy environment.
  • Advanced English (C1 or above) for direct communication with US-based stakeholders.
  • Preferred: experience with Databricks Asset Bundles or other Infrastructure-as-Code approaches.
  • Preferred: familiarity with Delta Live Tables and Databricks Genie.
  • Preferred: familiarity with data quality frameworks such as Great Expectations or Soda Core.
  • Preferred: experience with pytest and databricks-connect for pipeline testing.
  • Preferred: familiarity with Pydantic and schema migration/versioning tools such as Flyway or Liquibase.
  • Preferred: comfort using AI-assisted development tools such as GitHub Copilot or Cursor.

Benefits

  • Premium healthcare.
  • Meal voucher.
  • Maternity and parental leave.
  • Mobile services subsidy.
  • Sick pay and life insurance.
  • CI&T University for learning and development.
  • Colombian holidays.
  • Paid vacations.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cortex

Senior Data Engineer

Cortex 11-50 Internet Software & Services

Cortex is hiring a Senior Data Engineer to own internal data systems and pipelines that power company-wide reporting, product analytics, and AI-driven operations from a fully remote US-based team.

United States Full-time Senior Data Engineer
$175k-$205k
ClickHouse dbt GCP OpenTelemetry Python Segment SQL
16 hours, 7 minutes ago
Standard Metrics

Data Solutions Engineer

Standard Metrics 11-50 Capital Markets

Standard Metrics is hiring a Data Solutions Engineer to own customer-facing data workflows, integrations, and AI-driven automation for a financial data platform serving investors and portfolio companies.

United States Mid Level Data Engineer Solutions Engineer
dbt LLM Python REST API Snowflake SQL
1 day, 16 hours ago
Oportun

Senior Data Engineer (R13923)

Oportun 1K-5K Banks

Oportun is hiring a Senior Data Engineer to design and deliver scalable data platforms and solutions that support business and analytical needs across cross-functional initiatives.

Mexico Full-time Senior Data Engineer
Agile Apache Airflow Apache Spark AWS Azure Databricks GCP Hadoop Java Jenkins Kafka Kanban MariaDB PostgreSQL Python Scala Scrum SQL
2 days, 16 hours ago
Xebia

AWS Senior DevOps Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring a Senior DevOps Engineer to provision and operate a multi-region AWS environment for a US expansion while maintaining parity with the existing EU setup and supporting analytics and security operations.

Bulgaria Romania Senior Data Engineer DevOps Engineer
AWS CI/CD Penetration Testing PostgreSQL
2 days, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers