Data Architect (Databricks Scalability)

2 hours, 37 minutes ago
Full-time
Senior
Data Science and Analytics
Exadel

Exadel

Exadel is an enterprise software development and consulting company that provides custom software solutions and digital transformation services to Fortune 500 clients worldwide.

Internet Software & Services
1K-5K
Founded 1998

Description

  • Assess the current Databricks environment, including workspace design, compute usage, workloads, dependencies, and data processing patterns.
  • Document current-state and target-state architecture to improve scalability, resilience, and operational efficiency.
  • Identify performance bottlenecks, scalability constraints, cost inefficiencies, and architectural gaps across pipelines, clusters, storage, and consumption layers.
  • Define scalable platform patterns for ingestion, transformation, orchestration, and data serving aligned with enterprise standards.
  • Establish recommendations for workload optimization, autoscaling, compute governance, and performance tuning to support increasing data volumes and concurrency.
  • Design and enable AI-ready Databricks capabilities, including reusable patterns for GenAI, retrieval, vector search, model serving, and enterprise knowledge workflows.
  • Define integration and deployment approaches that improve reliability, maintainability, and release consistency across environments.
  • Work with architecture, engineering, data, security, and operations stakeholders to translate business and platform needs into technical decisions.
  • Contribute to implementation planning, technical governance, and execution sequencing for Databricks scalability initiatives.
  • Produce architecture documentation, engineering guidance, and dependency views to support execution teams and platform sustainability.

Requirements

  • Strong experience in Databricks architecture, data engineering, or platform engineering roles.
  • Hands-on expertise in Apache Spark, Delta Lake, cluster tuning, workload optimization, and scalable lakehouse design.
  • Proven ability to design and optimize high-scale data platforms with a focus on performance, reliability, cost efficiency, and operational excellence.
  • Experience enabling AI/ML and Generative AI solutions on Databricks, including AI-ready data foundations and production deployment patterns.
  • Working knowledge of governance and secure platform design, including workspace strategy, access controls, and enterprise data management practices.
  • Ability to work across technical and business teams and communicate clearly.
  • Intermediate/Upper-Intermediate English level.

Benefits

  • International projects.
  • In-office, hybrid, or remote flexibility.
  • Medical healthcare.
  • Recognition program.
  • Ongoing learning reimbursement.
  • Well-being program.
  • Team events and local benefits.
  • Sports compensation.
  • Referral bonuses.
  • Top-tier equipment provision.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

LA Galaxy, Sr Director, Data & Analytics

AEG 1K-5K Media

AEG is seeking a Sr Director, Data & Analytics to lead the LA Galaxy’s data strategy and build the analytics capabilities that inform fan growth, engagement, retention, and revenue across the organization.

CRM
2 hours, 22 minutes ago

Staff - Software Engineering

Convera 1K-5K Diversified Financial Services

Convera is seeking a Staff Software Engineer – Data Architect to design, build, and scale banking data platforms that support analytics, reporting, and regulatory use cases.

Agile Apache Airflow AWS CI/CD Git Kafka Looker Power BI Python Snowflake SQL Tableau
2 hours, 53 minutes ago

Principal Collibra Architect

Attain Partners 251-1K Media

Attain Partners is hiring a Principal Collibra Architect (Ranger) to lead enterprise data governance and data intelligence implementations for clients across higher education, nonprofit, public sector, and commercial environments.

AWS Azure CRM Databricks ERP GCP Snowflake
1 day, 3 hours ago

Sr. Data Architect - Remote

TWO95 International 51-250 Internet Software & Services

Sr. Data Architect for a contract-to-hire remote role focused on data architecture and graph data solutions within an AWS-based environment.

AWS GitLab IoT Java Kafka Kubernetes Neo4j Node.js
3 days, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers