Data Architect (Databricks Scalability)

1 month ago
Full-time
Senior
Data Science and Analytics
Exadel

Exadel

Exadel is an enterprise software development and consulting company that provides custom software solutions and digital transformation services to Fortune 500 clients worldwide.

Internet Software & Services
1K-5K
Founded 1998

Description

  • Assess the current Databricks environment, including workspace design, compute usage, workloads, dependencies, and data processing patterns.
  • Document current-state and target-state architecture to improve scalability, resilience, and operational efficiency.
  • Identify performance bottlenecks, scalability constraints, cost inefficiencies, and architectural gaps across pipelines, clusters, storage, and consumption layers.
  • Define scalable platform patterns for ingestion, transformation, orchestration, and data serving aligned with enterprise standards.
  • Establish recommendations for workload optimization, autoscaling, compute governance, and performance tuning to support increasing data volumes and concurrency.
  • Design and enable AI-ready Databricks capabilities, including reusable patterns for GenAI, retrieval, vector search, model serving, and enterprise knowledge workflows.
  • Define integration and deployment approaches that improve reliability, maintainability, and release consistency across environments.
  • Work with architecture, engineering, data, security, and operations stakeholders to translate business and platform needs into technical decisions.
  • Contribute to implementation planning, technical governance, and execution sequencing for Databricks scalability initiatives.
  • Produce architecture documentation, engineering guidance, and dependency views to support execution teams and platform sustainability.

Requirements

  • Strong experience in Databricks architecture, data engineering, or platform engineering roles.
  • Hands-on expertise in Apache Spark, Delta Lake, cluster tuning, workload optimization, and scalable lakehouse design.
  • Proven ability to design and optimize high-scale data platforms with a focus on performance, reliability, cost efficiency, and operational excellence.
  • Experience enabling AI/ML and Generative AI solutions on Databricks, including AI-ready data foundations and production deployment patterns.
  • Working knowledge of governance and secure platform design, including workspace strategy, access controls, and enterprise data management practices.
  • Ability to work across technical and business teams and communicate clearly.
  • Intermediate/Upper-Intermediate English level.

Benefits

  • International projects.
  • In-office, hybrid, or remote flexibility.
  • Medical healthcare.
  • Recognition program.
  • Ongoing learning reimbursement.
  • Well-being program.
  • Team events and local benefits.
  • Sports compensation.
  • Referral bonuses.
  • Top-tier equipment provision.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Architect

Electrosoft 51-250 Internet Software & Services

Electrosoft Services, LLC is seeking a Data Architect to lead enterprise geospatial data architecture and modernization efforts supporting federal mission-critical data platforms and analytics environments.

AWS Azure Cybersecurity Machine Learning PostgreSQL SQL Server
1 hour, 54 minutes ago

[Job-30735] Data Architect (Databricks), Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Data and Platform Architect (Databricks) to lead the design of data solutions for EMEA clients and translate business needs into scalable, production-ready platforms.

Apache Spark AWS Azure CI/CD Databricks Hadoop Machine Learning MLOps Python
2 hours, 9 minutes ago

Lead Data Security Engineer (Vaga Afirmativa para Mulheres)

iFood 5K-10K Air Freight & Logistics

A iFood is hiring a Data Security Specialist to protect corporate and production data across its technology ecosystem while shaping security strategy for a leadership-track role.

Databricks Encryption Salesforce
1 day, 1 hour ago

[Job - 30583] Senior Data MDM Architect, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a senior Data MDM Architect for an embedded engagement with a U.S.-based ESG advisory and carbon credit trading client to define and govern a unified master data architecture across a complex multi-platform ecosystem.

Azure CRM ERP NetSuite Salesforce
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers