RemoteLeaf Logo
Log in Sign up

Senior Data Architect - Databricks Platform

1 day, 1 hour ago
Brazil
Full-time
Senior
Data Architect
Data Science and Analytics
Apache Spark AWS CI/CD Databricks Terraform
Apply Now
Caylent

Caylent

Caylent is a cloud native services company that simplifies AWS cloud adoption with a user-friendly DevOps platform for scalable cloud environments.

IT Services
251-1K
Founded 2015
$16M raised
View All Jobs 22

Description

  • Lead architectural design for Databricks-based data platforms and modernization programs.
  • Design workspace consolidation, permissioning/persona models, and configuration-as-code patterns.
  • Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming.
  • Integrate Databricks Unity Catalog with third-party metadata repositories.
  • Design and implement automation, CI/CD, and guardrail patterns for governed platform extension.
  • Build and maintain certified data products, semantic layers, and lineage/metadata exposure.
  • Ensure platform components are technically viable, scalable, and production-ready.
  • Communicate architectural decisions, trade-offs, assessments, and roadmaps to technical and business stakeholders.
  • Partner with client business and engineering teams to translate use-case needs into platform capabilities and guardrails.
  • Develop and enforce architecture standards and implementation roadmaps.

Requirements

  • 6+ years of experience in data engineering, database engineering, or architecture roles.
  • 3+ years of experience designing cloud-based data solutions.
  • 3+ years of experience in the AWS data landscape.
  • 3+ years of hands-on Databricks experience.
  • Experience with end-to-end modern data platform architecture, including lakehouse, ingestion, processing, and access layers.
  • Hands-on experience with Databricks workspace/persona architecture, Unity Catalog, job orchestration, governance tooling, Spark tuning, and Delta Lake storage.
  • Experience architecting scalable cloud-native systems on AWS.
  • Experience with advanced distributed processing and streaming architectures.
  • Experience with platform security, networking, automation, cost estimation, and performance optimization.
  • Experience with Terraform and IaC/automation strategy.
  • Experience leading multi-database migration and modernization initiatives, including onto Databricks, is preferred.
  • Deep expertise in OLTP/OLAP system design, schema evolution, HA/DR, and migration planning is preferred.
  • Ability to lead technical discussions and develop Databricks and implementation roadmaps.
  • High business acumen and ability to work directly with client stakeholders.
  • Advanced English (minimum C1).
  • Ability to travel up to 25% as needed.
  • No visa sponsorship available now or in the future.

Benefits

  • 100% remote work from home or a shared workspace.
  • Generous holidays and unlimited flexible PTO.
  • Paid exams and certifications.
  • Peer bonus awards.
  • State-of-the-art laptop and tools.
  • Equipment and office stipend.
  • Individual professional development plan.
  • Opportunity to work with a global team and strong company culture.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job - 31053] Senior Data Architect (GCP, Salesforce Data Cloud), Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma Pessoa Arquiteta de Dados Sênior para liderar a transformação do ecossistema analítico de um cliente de varejo, conectando Salesforce Data Cloud e GCP em uma solução escalável e orientada a resultados de negócio.

Brazil Full-time Senior Data Architect
Apache Spark AWS Azure Databricks GCP Kubernetes Snowflake
1 hour, 29 minutes ago
Lighthouse

Staff Technical Data Architect, Integrations

Lighthouse Hotels, Restaurants & Leisure

Lighthouse is hiring a Staff Technical Data Architect for its Integrations team in Spain to shape the architecture of large-scale hospitality data systems that power its AI-driven platform.

Spain Full-time Lead Data Architect
Apache Airflow Databricks GCP Kubernetes Python Snowflake
1 day ago
CI&T

[Job -31071] Data Architect, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Data Architect to design and govern scalable, secure enterprise data architecture that supports business objectives and modern data platforms.

Brazil Full-time Lead Data Architect
AWS Azure GCP Machine Learning Microservices MLOps
2 days, 1 hour ago
Coupa Software

Lead Data Management Specialist

Coupa Software 1K-5K Internet Software & Services

Coupa is hiring a Technical Lead, AI Data Governance to define and operationalize the governance layer for the company’s AI data, policies, and gateway controls across GenAI and agentic applications.

Canada Full-time Lead Data Architect Program Manager
$74k-$104k
API Gateway LLM Microservices Snowflake SQL
2 days, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers