RemoteLeaf Logo
Log in Sign up

Senior Data Architect - Databricks Platform

3 weeks, 4 days ago
Mexico
Full-time
Senior
Data Architect
Data Science and Analytics
Apache Spark AWS CI/CD Databricks Microservices SQL Terraform
Apply Now
Caylent

Caylent

Caylent is a cloud native services company that simplifies AWS cloud adoption with a user-friendly DevOps platform for scalable cloud environments.

IT Services
251-1K
Founded 2015
$16M raised
View All Jobs 27

Description

  • Lead architectural design for Databricks-based data platforms and modernization programs.
  • Design workspace consolidation, permissioning/persona models, and configuration-as-code patterns.
  • Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming.
  • Design and integrate Unity Catalog with third-party metadata repositories such as AWS Glue Catalog and Snowflake Horizon.
  • Implement automation, CI/CD, and guardrail patterns to support safe platform extension.
  • Build and maintain certified data products, a semantic layer, and lineage and metadata exposure.
  • Ensure platform components are technically viable, scalable, and production ready.
  • Communicate architectural decisions, trade-offs, assessments, and roadmaps to technical and business stakeholders.
  • Partner with client business and engineering teams to translate use cases into platform capabilities and guardrails.
  • Develop Databricks roadmaps and implementation roadmaps, and help lead and mentor delivery teams.

Requirements

  • 6+ years of experience in data engineering, database engineering, or architecture roles.
  • 3+ years of experience designing cloud-based data solutions.
  • 3+ years of experience in the AWS data landscape.
  • 3+ years of hands-on Databricks experience.
  • End-to-end modern data platform architecture experience across lakehouse, ingestion, processing, and access layers.
  • Hands-on Databricks expertise with workspace/persona architecture, Unity Catalog, job orchestration, governance tooling, Spark tuning, clusters, and Delta Lake storage.
  • Experience architecting scalable cloud-native systems on AWS.
  • Experience with advanced distributed processing and streaming architectures.
  • Experience with platform security, networking, automation, cost estimation, and performance optimization.
  • Experience with Terraform and infrastructure-as-code strategy.
  • Ability to lead technical discussions with business, technology, and knowledge stakeholders.
  • Advanced English proficiency (minimum C1).
  • Experience leading multi-database migration and modernization initiatives, including to Databricks (preferred).
  • Deep expertise in OLTP/OLAP system design, schema evolution, HA/DR, and security patterns (preferred).
  • Experience in leading, developing, and mentoring delivery teams (preferred).
  • No visa sponsorship available now or in the future.

Benefits

  • 100% remote work.
  • Medical insurance for you and eligible dependents.
  • Generous holidays and flexible PTO.
  • Competitive phantom equity.
  • Paid exams and certifications.
  • Peer bonus awards.
  • State-of-the-art laptop and tools, plus equipment and office stipend.
  • Individual professional development plan and annual learning and development stipend.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Attain Partners

Senior Snowflake Architect / Developer – Higher Education

Attain Partners 251-1K Media

Attain Partners is seeking a Senior Snowflake Architect/Developer to lead and build optimized Snowflake data solutions for higher education clients, from discovery and architecture through implementation.

United States Full-time Lead Data Architect Data Engineer
$120k-$188k
AWS Azure dbt GCP Power BI Snowflake SQL Tableau
3 hours, 19 minutes ago
SysLogic

Data Analytics Architect

SysLogic 51-250 Internet Software & Services

The company is seeking a Data Analytics Architect to design, implement, and optimize Microsoft-based analytics solutions that transform complex data into actionable business insights across the full data software development lifecycle.

United States Full-time Lead Data Architect
Agile Azure Git JIRA Kanban Power BI Python R Scrum SQL Server SVN
4 hours, 34 minutes ago
Virtru

Data Warehouse & Analytics Architect

Virtru 51-250 IT Services

Virtru is hiring a Data Warehouse & Analytics Architect to provide technical leadership, design, and operational oversight for scalable data infrastructure supporting its digital privacy and zero-trust products.

United States Full-time Senior Data Architect
$180k-$220k
CI/CD Databricks Datadog DevSecOps Encryption GCP Grafana Kubernetes MLOps Prometheus Snowflake Terraform
3 days, 3 hours ago
Capco

Data Modelling Consultant (Insurance)

Capco 5K-10K Internet Software & Services

Capco is hiring a data consultant to design and deliver data solutions for insurance and reinsurance clients, supporting business transformation projects across financial services.

Czech Republic Full-time Senior Data Architect
Agile
3 days, 4 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers