RemoteLeaf Logo
Log in Sign up

Senior Data Architect - Databricks Platform

1 month, 3 weeks ago
Mexico
Full-time
Senior
Data Architect
Data Science and Analytics
Apache Spark AWS CI/CD Databricks Microservices SQL Terraform
Apply Now
Caylent

Caylent

Caylent is a cloud native services company that simplifies AWS cloud adoption with a user-friendly DevOps platform for scalable cloud environments.

IT Services
251-1K
Founded 2015
$16M raised
View All Jobs 15

Description

  • Lead architectural design for Databricks-based data platforms and modernization programs.
  • Design workspace consolidation, permissioning/persona models, and configuration-as-code patterns.
  • Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming.
  • Design and integrate Unity Catalog with third-party metadata repositories such as AWS Glue Catalog and Snowflake Horizon.
  • Implement automation, CI/CD, and guardrail patterns to support safe platform extension.
  • Build and maintain certified data products, a semantic layer, and lineage and metadata exposure.
  • Ensure platform components are technically viable, scalable, and production ready.
  • Communicate architectural decisions, trade-offs, assessments, and roadmaps to technical and business stakeholders.
  • Partner with client business and engineering teams to translate use cases into platform capabilities and guardrails.
  • Develop Databricks roadmaps and implementation roadmaps, and help lead and mentor delivery teams.

Requirements

  • 6+ years of experience in data engineering, database engineering, or architecture roles.
  • 3+ years of experience designing cloud-based data solutions.
  • 3+ years of experience in the AWS data landscape.
  • 3+ years of hands-on Databricks experience.
  • End-to-end modern data platform architecture experience across lakehouse, ingestion, processing, and access layers.
  • Hands-on Databricks expertise with workspace/persona architecture, Unity Catalog, job orchestration, governance tooling, Spark tuning, clusters, and Delta Lake storage.
  • Experience architecting scalable cloud-native systems on AWS.
  • Experience with advanced distributed processing and streaming architectures.
  • Experience with platform security, networking, automation, cost estimation, and performance optimization.
  • Experience with Terraform and infrastructure-as-code strategy.
  • Ability to lead technical discussions with business, technology, and knowledge stakeholders.
  • Advanced English proficiency (minimum C1).
  • Experience leading multi-database migration and modernization initiatives, including to Databricks (preferred).
  • Deep expertise in OLTP/OLAP system design, schema evolution, HA/DR, and security patterns (preferred).
  • Experience in leading, developing, and mentoring delivery teams (preferred).
  • No visa sponsorship available now or in the future.

Benefits

  • 100% remote work.
  • Medical insurance for you and eligible dependents.
  • Generous holidays and flexible PTO.
  • Competitive phantom equity.
  • Paid exams and certifications.
  • Peer bonus awards.
  • State-of-the-art laptop and tools, plus equipment and office stipend.
  • Individual professional development plan and annual learning and development stipend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Capco

Arquiteto de Dados - Remoto

Capco 5K-10K Internet Software & Services

A Capco busca um(a) especialista em Integração de Dados para arquitetar e desenvolver soluções escaláveis com Informatica IDMC/CDI em projetos de tecnologia para serviços financeiros e energia.

Brazil Full-time Senior Data Architect
Apache Spark Azure CI/CD Databricks dbt Git Kafka Python REST API Snowflake SQL Terraform
1 hour, 30 minutes ago
NTT DATA

Solution Architect - Databricks

NTT DATA 100K+ IT Services

NTT DATA is seeking a remote Solution Architect – Databricks in LATAM to support Ovintiv’s enterprise Databricks migration by translating requirements into consistent, buildable solutions across Databricks and Azure.

Latin America Contract Senior Data Architect
Azure Databricks
2 hours, 15 minutes ago
DaCodes

Senior Data Architect - Azure & Lakehouse | México&LATAM Only | English Required

DaCodes 51-250 Internet Software & Services

DaCodes is seeking a Senior Data Architect to lead the modernization of legacy ETL workloads into scalable Azure cloud lakehouse architectures for clients across Latin America and the United States.

Mexico Argentina Chile Colombia Peru Uruguay Full-time Senior Data Architect
Apache Spark Azure CI/CD Databricks Git Kafka SQL Server
2 hours, 45 minutes ago
SSC Egypt

Senior Data Architect (Telco)

SSC Egypt 11-50 IT Services

Senior Telco Data Modeler responsible for designing telecommunications data models and Customer 360 structures that unify customer, account, service, billing, and usage data.

Egypt Mid Level Data Architect
SQL
3 days, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers