Databricks Architect

1 week, 5 days ago
Full-time
Lead
DevOps and Infrastructure
Tiger Analytics

Tiger Analytics

Tiger Analytics is a leading advanced analytics consulting firm partnering with Fortune 100 companies to drive business value through expertise in marketing science, customer analytics, and operations analytics.

Professional Services
1K-5K
Founded 2011

Description

  • Design and implement scalable end-to-end data solutions for ETL, real-time streaming, and machine learning workloads on Databricks.
  • Provide technical leadership and strategic guidance on Databricks adoption by developing reference architectures and best practices.
  • Tune Spark jobs, optimize data pipelines, and resolve complex performance and technical issues.
  • Architect, develop, and debug PySpark jobs and data models.
  • Integrate Databricks with AWS services such as S3, EMR, and Lambda.
  • Implement and enforce data governance, security, encryption, auditing, and access control policies in the Databricks environment.
  • Support performance initiatives by identifying tuning opportunities and building performance environments.
  • Help build monitoring tools for Databricks and data operations.

Requirements

  • 12+ years of experience in architecture, design, and data engineering development for large-scale data ecosystems.
  • Strong hands-on experience as a Databricks/DataOps Architect.
  • Experience designing scalable, secure, high-performance Databricks solutions with attention to cost and reliability.
  • Good exposure to AWS.
  • Experience with Spark Streaming pipeline design.
  • Experience with Hadoop environments.
  • Exposure to Unity Catalog migration implementation.
  • Strong communication and leadership skills.
  • Ability to work independently and be self-driven.

Benefits

  • Significant career development opportunities as the company grows.
  • Opportunity to work in a small, fast-growing, challenging, entrepreneurial environment.
  • High degree of individual responsibility.
  • Equal employment opportunity regardless of protected characteristics.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Solution Architect - Data Analytics

Your Business Internet Software & Services

NRI North America is hiring a remote Azure Data and Analytics Solution Architect to design and deliver end-to-end enterprise data and analytics solutions for clients across North America.

Agile Apache Spark Azure CI/CD GCP HDFS .NET Power BI PowerShell Python R Scala Snowflake SQL Server
19 hours ago

Principal Data Architect - Battery Storage

Plus Power 51-250 Electric Utilities

Plus Power is hiring a Principal Data Architect to shape and operationalize a trusted enterprise data architecture for its fast-growing energy storage business.

AWS dbt InfluxDB PostgreSQL Prototyping Python Snowflake SQL TimescaleDB
21 hours, 6 minutes ago

Lead Data Architect

GOBI Technologies 11-50 Internet Software & Services

GOBI Technologies is seeking a Lead Data Architect to guide enterprise data strategy and architecture for Microsoft Data & AI client engagements as the practice scales.

Azure Databricks
23 hours, 48 minutes ago

Databricks Architect

Stitch 11-50 Internet Software & Services

Stitch is hiring a Databricks Architect to design enterprise-grade Lakehouse and martech data solutions for Fortune 1000 clients, with a focus on improving Braze-driven CRM and customer analytics outcomes.

Agile Apache Spark AWS Azure CI/CD Databricks GCP Git MLflow Scala SQL Terraform
1 day, 7 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers