RemoteLeaf Logo
Log in Sign up

Senior Data Architect - Databricks Platform

4 hours, 46 minutes ago
Mexico
Full-time
Senior
Data Architect
Data Science and Analytics
Apache Spark AWS CI/CD Databricks Microservices SQL Terraform
Apply Now
Caylent

Caylent

Caylent is a cloud native services company that simplifies AWS cloud adoption with a user-friendly DevOps platform for scalable cloud environments.

IT Services
251-1K
Founded 2015
$16M raised
View All Jobs 21

Description

  • Lead architectural design for Databricks-based data platforms and modernization programs.
  • Design workspace consolidation, permissioning/persona models, and configuration-as-code patterns.
  • Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming.
  • Design and integrate Unity Catalog with third-party metadata repositories such as AWS Glue Catalog and Snowflake Horizon.
  • Implement automation, CI/CD, and guardrail patterns to support safe platform extension.
  • Build and maintain certified data products, a semantic layer, and lineage and metadata exposure.
  • Ensure platform components are technically viable, scalable, and production ready.
  • Communicate architectural decisions, trade-offs, assessments, and roadmaps to technical and business stakeholders.
  • Partner with client business and engineering teams to translate use cases into platform capabilities and guardrails.
  • Develop Databricks roadmaps and implementation roadmaps, and help lead and mentor delivery teams.

Requirements

  • 6+ years of experience in data engineering, database engineering, or architecture roles.
  • 3+ years of experience designing cloud-based data solutions.
  • 3+ years of experience in the AWS data landscape.
  • 3+ years of hands-on Databricks experience.
  • End-to-end modern data platform architecture experience across lakehouse, ingestion, processing, and access layers.
  • Hands-on Databricks expertise with workspace/persona architecture, Unity Catalog, job orchestration, governance tooling, Spark tuning, clusters, and Delta Lake storage.
  • Experience architecting scalable cloud-native systems on AWS.
  • Experience with advanced distributed processing and streaming architectures.
  • Experience with platform security, networking, automation, cost estimation, and performance optimization.
  • Experience with Terraform and infrastructure-as-code strategy.
  • Ability to lead technical discussions with business, technology, and knowledge stakeholders.
  • Advanced English proficiency (minimum C1).
  • Experience leading multi-database migration and modernization initiatives, including to Databricks (preferred).
  • Deep expertise in OLTP/OLAP system design, schema evolution, HA/DR, and security patterns (preferred).
  • Experience in leading, developing, and mentoring delivery teams (preferred).
  • No visa sponsorship available now or in the future.

Benefits

  • 100% remote work.
  • Medical insurance for you and eligible dependents.
  • Generous holidays and flexible PTO.
  • Competitive phantom equity.
  • Paid exams and certifications.
  • Peer bonus awards.
  • State-of-the-art laptop and tools, plus equipment and office stipend.
  • Individual professional development plan and annual learning and development stipend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job -31071] Data Architect, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Data Architect to design and govern scalable, secure enterprise data architecture that supports business objectives and modern data platforms.

Brazil Full-time Lead Data Architect
AWS Azure GCP Machine Learning Microservices MLOps
5 hours, 16 minutes ago
Coupa Software

Lead Data Management Specialist

Coupa Software 1K-5K Internet Software & Services

Coupa is hiring a Technical Lead, AI Data Governance to define and operationalize the governance layer for the company’s AI data, policies, and gateway controls across GenAI and agentic applications.

Canada Full-time Lead Data Architect Program Manager
$74k-$104k
API Gateway LLM Microservices Snowflake SQL
5 hours, 16 minutes ago
CI&T

[Job - 31058] Senior Data Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T busca um(a) Desenvolvedor(a) de Dados Sênior para atuar na estratégia de dados de um cliente de mídia e entretenimento, integrando sistemas críticos e entregando uma visão unificada e confiável das informações corporativas.

Brazil Full-time Senior Data Architect Data Engineer
CRM ERP GCP Salesforce SQL
5 hours, 31 minutes ago
Alpaca

Lead, Data Governance

Alpaca 51-250 Capital Markets

Alpaca is hiring a Lead, Data Governance to build and operate its data governance and data security program across a rapidly growing global analytics environment.

Remote
Full-time Lead Data Architect
Apache Airflow dbt GCP Metabase SQL Trino
2 days, 4 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers