RemoteLeaf Logo
Log in Sign up

Senior Data Architect - Databricks Platform

1 month, 3 weeks ago
Brazil
Full-time
Senior
Data Architect
Data Science and Analytics
Apache Spark AWS CI/CD Databricks Terraform
Apply Now
Caylent

Caylent

Caylent is a cloud native services company that simplifies AWS cloud adoption with a user-friendly DevOps platform for scalable cloud environments.

IT Services
251-1K
Founded 2015
$16M raised
View All Jobs 15

Description

  • Lead architectural design for Databricks-based data platforms and modernization programs.
  • Design workspace consolidation, permissioning/persona models, and configuration-as-code patterns.
  • Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming.
  • Integrate Databricks Unity Catalog with third-party metadata repositories.
  • Design and implement automation, CI/CD, and guardrail patterns for governed platform extension.
  • Build and maintain certified data products, semantic layers, and lineage/metadata exposure.
  • Ensure platform components are technically viable, scalable, and production-ready.
  • Communicate architectural decisions, trade-offs, assessments, and roadmaps to technical and business stakeholders.
  • Partner with client business and engineering teams to translate use-case needs into platform capabilities and guardrails.
  • Develop and enforce architecture standards and implementation roadmaps.

Requirements

  • 6+ years of experience in data engineering, database engineering, or architecture roles.
  • 3+ years of experience designing cloud-based data solutions.
  • 3+ years of experience in the AWS data landscape.
  • 3+ years of hands-on Databricks experience.
  • Experience with end-to-end modern data platform architecture, including lakehouse, ingestion, processing, and access layers.
  • Hands-on experience with Databricks workspace/persona architecture, Unity Catalog, job orchestration, governance tooling, Spark tuning, and Delta Lake storage.
  • Experience architecting scalable cloud-native systems on AWS.
  • Experience with advanced distributed processing and streaming architectures.
  • Experience with platform security, networking, automation, cost estimation, and performance optimization.
  • Experience with Terraform and IaC/automation strategy.
  • Experience leading multi-database migration and modernization initiatives, including onto Databricks, is preferred.
  • Deep expertise in OLTP/OLAP system design, schema evolution, HA/DR, and migration planning is preferred.
  • Ability to lead technical discussions and develop Databricks and implementation roadmaps.
  • High business acumen and ability to work directly with client stakeholders.
  • Advanced English (minimum C1).
  • Ability to travel up to 25% as needed.
  • No visa sponsorship available now or in the future.

Benefits

  • 100% remote work from home or a shared workspace.
  • Generous holidays and unlimited flexible PTO.
  • Paid exams and certifications.
  • Peer bonus awards.
  • State-of-the-art laptop and tools.
  • Equipment and office stipend.
  • Individual professional development plan.
  • Opportunity to work with a global team and strong company culture.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Capco

Arquiteto de Dados - Remoto

Capco 5K-10K Internet Software & Services

A Capco busca um(a) especialista em Integração de Dados para arquitetar e desenvolver soluções escaláveis com Informatica IDMC/CDI em projetos de tecnologia para serviços financeiros e energia.

Brazil Full-time Senior Data Architect
Apache Spark Azure CI/CD Databricks dbt Git Kafka Python REST API Snowflake SQL Terraform
1 hour, 31 minutes ago
NTT DATA

Solution Architect - Databricks

NTT DATA 100K+ IT Services

NTT DATA is seeking a remote Solution Architect – Databricks in LATAM to support Ovintiv’s enterprise Databricks migration by translating requirements into consistent, buildable solutions across Databricks and Azure.

Latin America Contract Senior Data Architect
Azure Databricks
2 hours, 16 minutes ago
DaCodes

Senior Data Architect - Azure & Lakehouse | México&LATAM Only | English Required

DaCodes 51-250 Internet Software & Services

DaCodes is seeking a Senior Data Architect to lead the modernization of legacy ETL workloads into scalable Azure cloud lakehouse architectures for clients across Latin America and the United States.

Mexico Argentina Chile Colombia Peru Uruguay Full-time Senior Data Architect
Apache Spark Azure CI/CD Databricks Git Kafka SQL Server
2 hours, 46 minutes ago
SSC Egypt

Senior Data Architect (Telco)

SSC Egypt 11-50 IT Services

Senior Telco Data Modeler responsible for designing telecommunications data models and Customer 360 structures that unify customer, account, service, billing, and usage data.

Egypt Mid Level Data Architect
SQL
3 days, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers