RemoteLeaf Logo
Log in Sign up

1104 | Senior Data Engineer (Databricks)

1 month, 1 week ago
Serbia, Spain, United Kingdom, Estonia, Poland, Romania
Full-time
Senior
Data Engineer
DevOps and Infrastructure
Apache Spark AWS Azure CI/CD Databricks Git PostgreSQL Python Secrets Management Serverless SQL SQL Server
Apply Now
Intetics

Intetics

Intetics is a top custom software development company with 28 years of experience, offering high-quality software applications and AI/ML integration. They excel in various industries and provide global talent solutions for exceptional project outcomes.

Internet Software & Services
1K-5K
Founded 1995
View All Jobs 78

Description

  • Own production support for Databricks pipelines, including monitoring, alerting, incident response, and SLA reporting.
  • Optimize pipelines to reduce compute costs, improve throughput, and shorten processing windows using measurable KPIs.
  • Migrate legacy ETL/ELT pipelines to Databricks and develop automation for reliable transitions.
  • Provision, validate, and harden tenant data pipelines for new customer onboarding.
  • Design and build scalable pipelines for ingesting, transforming, and serving ERP and CRM data across Azure and AWS.
  • Own Delta Lake architecture, including schema design, partitioning, data quality, and incremental processing.
  • Enforce security and multi-tenant isolation through access controls, secrets management, and compliance practices.
  • Implement data quality monitoring and observability for pipelines and ML model inputs.
  • Collaborate with ML engineering, Product, Infrastructure, and Enterprise Architecture teams.
  • Maintain documentation, runbooks, architectural decision records, CI/CD workflows, testing, and deployment tooling; participate in global on-call support.

Requirements

  • 4+ years of data engineering experience.
  • 2+ years working with Databricks or Apache Spark across Azure and/or AWS.
  • Proficiency in PySpark, SQL, and Python for production-grade pipelines operating under SLAs.
  • Hands-on Delta Lake experience, including schema evolution, ACID transactions, optimize/vacuum, incremental processing, and streaming.
  • Experience tuning pipeline performance and compute costs in production Databricks environments.
  • Working knowledge of PostgreSQL, including query optimization, schema design, and production pipeline integration.
  • Experience supporting legacy ETL tools such as SSIS, Informatica, or custom Python/SQL pipelines.
  • Experience with large-scale multi-tenant architectures, tenant isolation, performance, and data privacy.
  • Understanding of data governance, security, access control, compliance, and sensitive enterprise data protection.
  • Preferred: cross-cloud Databricks operations, serverless optimization, SQL Server, ML feature stores, onboarding automation/IaC, or Databricks certification.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

RevStar

Databricks Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based Databricks Engineer to build and optimize cloud-agnostic Lakehouse data pipelines and MLOps frameworks for enterprise AI projects across AWS, Azure, and GCP.

United States Mexico Argentina Brazil Chile Colombia Venezuela Contract Mid Level Data Engineer
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks Feature Engineering HIPAA Kafka MLflow MLOps Prefect Python SQL Terraform
5 hours, 34 minutes ago
phData

Senior Data Engineer

phData 251-1K IT Services

Data Engineer at phData, a remote-first global data and AI consultancy, designing and delivering secure, scalable cloud data solutions for enterprise clients.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python REST API Scala Snowflake Solr SQL System Design
1 day, 5 hours ago
Abacus Insights

Forward Deployed Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Forward Deployed Data Engineer to work alongside health plan clients, building governed data foundations, pipelines, and integrations that turn fragmented payer data into analytics-ready products.

United States Full-time Senior Data Engineer
Apache Spark Databricks Snowflake SQL
1 day, 5 hours ago
Azumo

Data Engineer

Azumo 51-250 Internet Software & Services

Azumo is hiring a fully remote Latin America-based Data Engineer to build and operate production ingestion, transformation, storage, warehouse, and retrieval infrastructure that supports client AI systems.

Mexico Argentina Brazil Chile Colombia Peru Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure CI/CD Dagster Databricks dbt Docker Flink GCP Git GitHub Actions HIPAA Jupyter Kafka Prefect Python Snowflake SQL Terraform
1 day, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers