RemoteLeaf Logo
Log in Sign up

Senior Data Engineer - Azure Databricks Platform

4 hours, 41 minutes ago
United Kingdom
Full-time
Senior
Data Engineer
Software Development
Azure CI/CD Databricks DNS Terraform
Apply Now
EnerMech

EnerMech

EnerMech is a global specialist service company offering integrated solutions for the energy sector, including mechanical, electrical, and instrumentation services. They provide critical asset support with a wide range of services such as cranes, lifti...

Construction & Engineering
1001-5000
Founded 2008
View All Jobs

Description

  • Design, build, test, and operate assigned Azure Databricks platform workstreams from scoping through production deployment.
  • Own the integrity of bronze, silver, and gold medallion data models for assigned data domains.
  • Build and optimize Delta tables and materialized views for scalable performance.
  • Design and implement data-quality frameworks, including validation against data contracts and quarantine/error handling.
  • Define workload-specific compute configurations that balance performance and cost.
  • Contribute to and troubleshoot Terraform-managed Azure infrastructure, including networking, storage, Key Vaults, Managed DevOps Pools, and Dev Centers.
  • Own and maintain Azure DevOps build and release pipelines, variable libraries, repository permissions, and branch policies.
  • Support Azure environment configuration, including subscription access, RBAC, service-principal identities, and Terraform state backends.
  • Make and document architectural decisions and resolve complex platform issues independently.
  • Communicate with technical and non-technical stakeholders across global time zones.

Requirements

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related discipline, or equivalent practical experience.
  • Typically 6+ years of data engineering experience, including 3+ years of production Azure Databricks experience.
  • Experience designing medallion architectures and data models.
  • Experience implementing production data-quality frameworks and data contracts.
  • Experience implementing PII protections, such as masking, tokenisation, or access tiering, across environments.
  • Platform engineering experience diagnosing infrastructure issues.
  • Demonstrated autonomous delivery and direct stakeholder engagement.
  • Databricks Certified Data Engineer Associate certification.
  • Databricks Certified Data Engineer Professional certification (preferred).
  • Experience with Azure DevOps, multi-environment Azure networking, Entra ID/RBAC governance, GDPR, or global delivery models in energy or industrial services (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Valdera

Chemical Data Scientist

Valdera 11-50 Chemicals

Valdera is hiring a Chemical Data Scientist to build and own data pipelines that standardize supplier and chemical product information for its manufacturing procurement platform.

United States Full-time Senior Data Engineer
Machine Learning Python
16 hours, 11 minutes ago
veranahealth.com

Senior Director, Data Development

veranahealth.com 201-500 Insurance

Verana Health is seeking a Senior Director, Data Development to lead machine learning teams and deliver clinically meaningful healthcare data products from real-world EHR, text, and imaging data.

United States Full-time Executive Data Engineer
$210k-$262k
Apache Spark Databricks Machine Learning MLflow NLP Python R SQL
16 hours, 41 minutes ago
Agicap

Senior Data Engineer

Agicap 501-1000 Diversified Financial Services

Join Agicap as a Senior Data Engineer to operate and evolve its company-wide data platform, including the semantic layer that enables reliable AI-powered data access.

France Full-time Senior Data Engineer
$67k-$78k
Apache Airflow CI/CD dbt Docker GCP GitHub Actions Helm HubSpot Looker PostgreSQL Python SQL SQL Server Terraform
16 hours, 41 minutes ago
Via Logic

Cloud Platform and Data Engineer [U.S. Citizenship Required, Public Trust Eligibility]

Via Logic 1-10 Internet Software & Services

Via Logic is hiring a remote Cloud Platform and Data Engineer to support DHS programs by operating secure AWS infrastructure and Salesforce-connected applications, integrations, and data workflows.

United States Full-time Mid Level Data Engineer Platform Engineer
$100k-$120k
Agile Ansible AWS Bash Cybersecurity DevSecOps Docker Encryption Git Helm Java Jenkins Kubernetes Microservices Monday.com New Relic PostgreSQL Power BI Python Redis Salesforce Secrets Management SQL Tableau Terraform
1 day, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers