Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537)

7 hours, 6 minutes ago
Full-time
Lead
DevOps and Infrastructure
Bitly

Bitly

Bitly is a link management platform offering URL shortening, QR codes, and a Link in Bio solution for brands to optimize customer experience.

Internet Software & Services
201-500
Founded 2008
$92M raised

Description

  • Own Databricks platform operational excellence, including monitoring, alerting, observability, incident-response support, and production runbooks.
  • Define and maintain CI/CD, deployment automation, and dev-to-production promotion standards for Databricks assets.
  • Design platform standards for job orchestration, compute and cluster policies, service principals, environment isolation, and reliable production execution.
  • Create reusable onboarding templates and operational enablement patterns for teams adopting Databricks.
  • Partner with data engineering to ensure ingestion and medallion patterns are observable, recoverable, cost-aware, and secure.
  • Collaborate with cloud and infrastructure teams to align Databricks configurations with enterprise cloud standards across commercial and future government-hosted environments.
  • Enforce controls for data segregation, access boundaries, and operational compliance.
  • Track and improve job success rates, incident trends, pipeline reliability, cost efficiency, and environment drift.
  • Document platform standards, support models, and operational expectations.
  • Mentor engineers developing Databricks platform responsibilities.

Requirements

  • 12+ years of relevant experience in data platform engineering, platform operations, site reliability engineering, or modern cloud data infrastructure.
  • Hands-on production experience with Databricks or a related cloud data platform.
  • Experience designing or operating CI/CD, environment promotion, version control, and deployment automation for data platforms and pipelines.
  • Strong knowledge of observability, monitoring, alerting, incident management, and reliability engineering.
  • Experience with compute policy design, workload isolation, service principals, and secure production execution on cloud data platforms.
  • Ability to work in regulated or security-sensitive environments with access-control, auditability, and operational-discipline requirements.
  • Ability to collaborate with cloud infrastructure, security, data engineering, and analytics stakeholders.
  • Databricks certification or expertise with Delta Lake, Unity Catalog, Workflows, and Databricks Asset Bundles (preferred).
  • Experience with infrastructure as code and enterprise platform automation (preferred).
  • Experience supporting commercial and government or other segregated environments, or working in defense, aerospace, federal, or another regulated industry (preferred).

Benefits

  • Salary within the listed range, based on experience, qualifications, certifications, and location.
  • Bonus opportunity.
  • Equity.
  • Benefits package for full-time regular employees.
  • Temporary benefits package available after 60 days of employment for eligible temporary employees.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer

Definitive Healthcare 501-1000 Professional Services

Definitive Healthcare is seeking a Data Engineer to build and operate reliable healthcare data pipelines and transformations supporting Claims and Consumer data products and customer-facing solutions.

Apache Airflow Apache Spark AWS Azure CI/CD Databricks GCP Kubernetes Python Snowflake SQL
7 hours, 21 minutes ago

Senior Manager, Data Engineering - India

JumpCloud 501-1000 Internet Software & Services

JumpCloud is hiring a remote Senior Engineering Manager in India to lead EDA, ESE, and machine learning teams building reliable data platforms and production ML capabilities for its unified IT management platform.

Agile Apache Spark C++ Databricks dbt Feature Engineering Git Go Java Machine Learning MLOps NetSuite Python PyTorch Salesforce Scikit-learn Snowflake TensorFlow
7 hours, 21 minutes ago

Senior Data Engineer

Prima 501-1000 Insurance

Prima is hiring a Senior Data Engineer to build and maintain data products and pipelines for its pricing and underwriting domain, connecting data science, machine learning, and engineering to support growth in motor insurance.

Apache Airflow Apache Spark AWS CI/CD Databricks Feature Engineering Kafka LightGBM Machine Learning MLOps NumPy Pandas PostgreSQL Python Scikit-learn SQL XGBoost
7 hours, 36 minutes ago

Data Software Engineer

Prima 501-1000 Insurance

Prima is seeking a Data Software Engineer for its Claims team to build reliable, scalable data products and infrastructure that support analytics, data science, and the future of motor insurance.

Apache Spark AWS CI/CD Databricks Feature Engineering Kafka Machine Learning PostgreSQL Python SQL
7 hours, 36 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers