RemoteLeaf Logo
Log in Sign up

1104 | Senior Data Engineer (Databricks)

9 hours, 1 minute ago
Serbia, Spain, United Kingdom, Estonia, Poland, Romania
Full-time
Senior
Data Engineer
DevOps and Infrastructure
Apache Spark AWS Azure CI/CD Databricks Git PostgreSQL Python Secrets Management Serverless SQL SQL Server
Apply Now
Intetics

Intetics

Intetics is a top custom software development company with 28 years of experience, offering high-quality software applications and AI/ML integration. They excel in various industries and provide global talent solutions for exceptional project outcomes.

Internet Software & Services
1K-5K
Founded 1995
View All Jobs 90

Description

  • Own production support for Databricks pipelines, including monitoring, alerting, incident response, and SLA reporting.
  • Optimize pipelines to reduce compute costs, improve throughput, and shorten processing windows using measurable KPIs.
  • Migrate legacy ETL/ELT pipelines to Databricks and develop automation for reliable transitions.
  • Provision, validate, and harden tenant data pipelines for new customer onboarding.
  • Design and build scalable pipelines for ingesting, transforming, and serving ERP and CRM data across Azure and AWS.
  • Own Delta Lake architecture, including schema design, partitioning, data quality, and incremental processing.
  • Enforce security and multi-tenant isolation through access controls, secrets management, and compliance practices.
  • Implement data quality monitoring and observability for pipelines and ML model inputs.
  • Collaborate with ML engineering, Product, Infrastructure, and Enterprise Architecture teams.
  • Maintain documentation, runbooks, architectural decision records, CI/CD workflows, testing, and deployment tooling; participate in global on-call support.

Requirements

  • 4+ years of data engineering experience.
  • 2+ years working with Databricks or Apache Spark across Azure and/or AWS.
  • Proficiency in PySpark, SQL, and Python for production-grade pipelines operating under SLAs.
  • Hands-on Delta Lake experience, including schema evolution, ACID transactions, optimize/vacuum, incremental processing, and streaming.
  • Experience tuning pipeline performance and compute costs in production Databricks environments.
  • Working knowledge of PostgreSQL, including query optimization, schema design, and production pipeline integration.
  • Experience supporting legacy ETL tools such as SSIS, Informatica, or custom Python/SQL pipelines.
  • Experience with large-scale multi-tenant architectures, tenant isolation, performance, and data privacy.
  • Understanding of data governance, security, access control, compliance, and sensitive enterprise data protection.
  • Preferred: cross-cloud Databricks operations, serverless optimization, SQL Server, ML feature stores, onboarding automation/IaC, or Databricks certification.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

DoorDash

Senior Security Data Engineer

DoorDash 10K-50K Air Freight & Logistics

DoorDash is hiring a Cyber Defense Data Pipelines Engineer to operate and scale security telemetry pipelines across AWS and GCP, enabling reliable detection, investigation, and response across DoorDash, Deliveroo, and Wolt.

United States Full-time Senior Data Engineer Security Engineer
$160k-$235k
AWS Bitbucket CI/CD Cybersecurity Docker Elasticsearch GCP GitHub GitHub Actions GitLab Go Java Kafka Kubernetes Penetration Testing Python REST API Rust SIEM Snowflake Splunk SQL
8 hours, 30 minutes ago
Nortal

(1542) Senior Data / Reporting Engineer (Python, SQL, AWS)

Nortal 251-1K Internet Software & Services

Nortal is seeking a Senior Data/Reporting Engineer for its remote LATAM team to build and maintain scalable data pipelines and reporting services supporting a global merchant base.

Latin America Full-time Senior Data Engineer
AWS CI/CD Java Python SQL
8 hours, 45 minutes ago
Nortal

(1556) Senior Data and Insight Engineer

Nortal 251-1K Internet Software & Services

Nortal is hiring a Data and Insight Engineer for its remote LATAM team to build reliable data infrastructure and enable organizations to derive actionable insights from data.

Latin America Full-time Senior Data Engineer
Apache Airflow AWS GCP Python Snowflake
8 hours, 45 minutes ago
Cohere Health

Senior Manager, Data Platform Engineering

Cohere Health 251-1K Insurance

Cohere Health is seeking a Senior Manager, Data Platform Engineering to lead its data platform team, strengthen engineering practices, and deliver a scalable, reliable data foundation supporting healthcare products and business growth.

United States Full-time Lead Data Engineer Engineering Manager
$175k-$195k
Apache Airflow Apache Spark AWS CI/CD Git System Design
1 day, 7 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers