Databricks Architect

1 month, 3 weeks ago
Full-time
Lead
DevOps and Infrastructure
Tiger Analytics

Tiger Analytics

Tiger Analytics is a leading advanced analytics consulting firm partnering with Fortune 100 companies to drive business value through expertise in marketing science, customer analytics, and operations analytics.

Professional Services
1K-5K
Founded 2011

Description

  • Design and implement scalable end-to-end data solutions for ETL, real-time streaming, and machine learning workloads on Databricks.
  • Provide technical leadership and strategic guidance on Databricks adoption by developing reference architectures and best practices.
  • Tune Spark jobs, optimize data pipelines, and resolve complex performance and technical issues.
  • Architect, develop, and debug PySpark jobs and data models.
  • Integrate Databricks with AWS services such as S3, EMR, and Lambda.
  • Implement and enforce data governance, security, encryption, auditing, and access control policies in the Databricks environment.
  • Support performance initiatives by identifying tuning opportunities and building performance environments.
  • Help build monitoring tools for Databricks and data operations.

Requirements

  • 12+ years of experience in architecture, design, and data engineering development for large-scale data ecosystems.
  • Strong hands-on experience as a Databricks/DataOps Architect.
  • Experience designing scalable, secure, high-performance Databricks solutions with attention to cost and reliability.
  • Good exposure to AWS.
  • Experience with Spark Streaming pipeline design.
  • Experience with Hadoop environments.
  • Exposure to Unity Catalog migration implementation.
  • Strong communication and leadership skills.
  • Ability to work independently and be self-driven.

Benefits

  • Significant career development opportunities as the company grows.
  • Opportunity to work in a small, fast-growing, challenging, entrepreneurial environment.
  • High degree of individual responsibility.
  • Equal employment opportunity regardless of protected characteristics.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Databricks Architect

Stitch 11-50 Internet Software & Services

Stitch is hiring a Senior Databricks Architect to lead enterprise Lakehouse and martech data architecture work for Fortune 1000 clients, building Databricks-Braze solutions that improve customer data foundations, segmentation, and AI-driven analytics.

Apache Airflow Apache Spark AWS Azure CRM Databricks GCP Git MLflow Scala Snowflake SQL Terraform
6 hours, 32 minutes ago

[Job - 29428] Arquiteto(a) Sênior de Dados — Governança, FinOps e Segurança

CI&T 5K-10K Internet Software & Services

CI&T está contratando um(a) Arquiteto(a) Sênior de Dados para liderar a evolução de uma plataforma corporativa híbrida em Azure e on-premise, com foco em governança, FinOps, segurança e conformidade em ambiente SOX.

Apache Spark Azure Databricks SQL Server
6 hours, 47 minutes ago

Senior Manger, Data Engineering

AssistRx 251-1K Pharmaceuticals

AssistRx is hiring a Senior Manager, Data Engineering to lead a team building and operating scalable data pipelines, architectures, and platforms for client implementations and internal data programs.

Apache Spark AWS Azure dbt Hadoop Salesforce Snowflake SQL
1 day, 6 hours ago

Salesforce Data Architect, Revenue Solutions

NeuraFlash 251-1K IT Services

NeuraFlash, Part of Accenture is hiring a Data Architect – Revenue Solutions to lead Salesforce Revenue Cloud data migration work focused on CPQ and Billing for quote-to-cash transformations.

Agile Confluence ERP GitHub JIRA NetSuite Oracle Salesforce SAP SQL SQL Server
1 day, 18 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers