Principal Data Architect — Databricks Enablement

2 weeks, 6 days ago
Full-time
Lead
Data Science and Analytics
Caylent

Caylent

Caylent is a cloud native services company that simplifies AWS cloud adoption with a user-friendly DevOps platform for scalable cloud environments.

IT Services
251-1K
Founded 2015
$16M raised

Description

  • Define strategic Databricks adoption roadmaps, guardrails, self-service maturity models, and use-case prioritization plans for clients.
  • Embed with client business and engineering teams to implement high-priority use cases hands-on and progressively transition them to self-service.
  • Translate client needs into feature requests and guardrail requirements for the platform and foundation team.
  • Act as a data engineering subject matter expert in pre-sales and scoping discussions.
  • Coach and upskill client architects, engineers, and business technologists on Databricks best practices and self-service tooling.
  • Oversee the development of data standards, operating procedures, and semantic and lineage layers for scalable governance.
  • Perform technical interviews for Architect and Engineer candidates and provide mentorship across the practice.
  • Build trusted relationships with client technical and business leadership while balancing governance, speed, and autonomy.

Requirements

  • 10 years of experience designing and building complex data systems.
  • Experience with relational database design, optimization, and migration.
  • Experience with data modeling for transactional and analytics systems, including industry-standard data models.
  • Experience with BI dashboards and visualizations.
  • Experience with data governance and MDM.
  • Experience with big data processing using Spark, streaming solutions, and NoSQL.
  • Experience with machine learning and MLOps.
  • Experience with GenAI foundational models and related approaches and frameworks.
  • Experience with DataOps practices such as Infrastructure as Code, data testing, and data versioning.
  • Deep, hands-on Databricks experience, including workspace/persona architecture, Unity Catalog, lakehouse design patterns, job orchestration, and Databricks-native governance and AI/ML tooling.
  • Experience working in a forward-deployed or embedded delivery model.
  • Experience with at least two of the following: Terraform, CI/CD pipelines and tools, or Python for analytics and automation.
  • Strong drive to standardize and document solutions.
  • Excellent written and verbal communication skills with high tolerance for ambiguity.
  • At least 4 years of experience in the AWS data landscape.
  • 5+ years of deep, hands-on Databricks experience.
  • Ability to translate ambiguous business requests into scoped technical work and communicate trade-offs to engineers and VP-level leadership.
  • Preferred: prior experience in a platform plus use-case hub-and-spoke delivery model.
  • Preferred: background in consulting, systems integration, or professional services.
  • Preferred: familiarity with SOW-based, time-and-materials delivery and scope management.

Benefits

  • 100% remote work.
  • Generous holidays and flexible PTO.
  • Competitive phantom equity.
  • Paid exams and certifications.
  • Peer bonus awards.
  • State-of-the-art laptop and tools.
  • Equipment and office stipend.
  • Individual professional development plan.
  • Annual learning and development stipend.
  • Up to 25% travel depending on business needs.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Governance Lead (São Paulo, Brasil)

B Lab 51-250 Diversified Consumer Services

B Lab is hiring a Data Governance Lead in São Paulo to own data standards, classification, compliance, and literacy across its data platform while helping teams adopt trustworthy data practices.

SQL
15 hours, 32 minutes ago

(PR0065) Data Architect

Nortal 251-1K Internet Software & Services

Nortal is seeking a Senior Data Architect to design and optimize secure, governed, and cost-efficient GCP and BigQuery data architectures that support enterprise analytics and business needs.

GCP
16 hours, 17 minutes ago

[Job-31439] Data Architect (Databricks), Brasil

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Data Architect (Databricks) Sênior no Brasil para liderar a migração de dados on-premise para a nuvem e definir arquiteturas robustas, escaláveis e seguras.

Agile Apache Spark Azure Databricks DB2 Oracle Python SQL SQL Server
1 day, 15 hours ago

[Job - 31210] Senior Data Architect (Azure), Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior Data Architect to lead the evolution of a client’s data platform, including migration to Microsoft Fabric and delivery of secure, scalable, business-ready data systems.

Azure
1 day, 15 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers