RemoteLeaf Logo
Log in Sign up

Senior Databricks Administrator/Architect

2 months, 2 weeks ago
Spain
Full-time
Senior
Data Architect
DevOps and Infrastructure
Apache Spark Azure CI/CD Generative AI Network Security Power BI Python SQL Terraform
Apply Now
European Dynamics

European Dynamics

EUROPEAN DYNAMICS is a leading European company specializing in ICT technologies and software products for e-government services.

IT Services
251-1K
Founded 1993
View All Jobs 68

Description

  • Collaborate with data platform and integration teams to architect and implement scalable enterprise data platform solutions on Azure Databricks and related Azure services.
  • Design and develop data engineering frameworks for batch, streaming, ELT/ETL, and real-time analytics workloads.
  • Administer and maintain Azure Databricks workspaces, including clusters, job scheduling, Unity Catalog, secret management, compute policies, and workspace governance.
  • Define and implement enterprise security architecture covering identity integration, RBAC, PIM, encryption, private networking, managed identities, and Key Vault integration.
  • Establish data governance standards using Unity Catalog, including lineage, quality, metadata management, catalog organization, access policies, and audit capabilities.
  • Deploy and configure CI/CD pipelines, infrastructure as code, and release automation for Databricks environments.
  • Optimize Databricks workloads through Spark tuning, cluster sizing, partitioning, caching, Delta optimization, Photon, and cost controls.
  • Design monitoring, logging, alerting, and operational dashboards for platform health and workload observability.
  • Develop reusable architecture patterns, standards, naming conventions, operational procedures, and platform documentation.
  • Support migration of legacy data warehouses, ETL solutions, and reporting platforms to Azure Databricks lakehouse architecture.
  • Provide technical support and troubleshooting for production incidents affecting Databricks, Spark workloads, data pipelines, and platform infrastructure.

Requirements

  • University degree plus 9 years of relevant IT professional experience.
  • At least 8 years of experience designing and implementing enterprise data platforms.
  • At least 5 years of hands-on Azure Databricks experience in enterprise environments.
  • Experience architecting modern lakehouse solutions using Azure Databricks and Delta Lake.
  • Experience administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security.
  • Experience developing data engineering solutions with Apache Spark, including PySpark and/or Spark SQL.
  • Experience implementing enterprise data governance with Unity Catalog, metadata management, data lineage, and fine-grained access controls.
  • Experience implementing infrastructure as code with Terraform and/or Bicep.
  • Strong experience with CI/CD pipelines using Azure DevOps, automated testing, release management, and deployment automation.
  • Experience with enterprise security architecture including RBAC, managed identities, private endpoints, Key Vault integration, encryption, and network security.
  • Experience implementing data quality frameworks, monitoring, observability, and operational dashboards.
  • Strong understanding of dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts.
  • Strong knowledge of Azure Data Lake Storage Gen2, Azure Data Factory, Azure Event Hub, Azure SQL Database, Azure Key Vault, Azure Monitor, Microsoft Entra ID (Azure AD), and Azure networking.
  • Strong SQL skills and proficiency in Python and PySpark.
  • Knowledge of AI/ML workloads, Databricks ML, Feature Store, Model Serving, and Generative AI architectures is an asset.
  • Experience with Power BI, Microsoft Fabric, Synapse Analytics, or similar enterprise analytics platforms is highly desirable.
  • Experience in large international organizations, NGOs, or United Nations agencies is desirable.
  • Relevant certifications such as Databricks Certified Platform, Azure Solution Architecture Expert, or Databricks Certified Data Engineer Associate/Professional are desirable.
  • Excellent command of English.

Benefits

  • Remote work arrangement.
  • Competitive remuneration based on qualifications and experience.
  • Option of a contract basis or a remuneration package with full benefits.
  • Opportunity to work within a major European institution in an international, multilingual, and multicultural environment.
  • Confidential handling of applications.
  • Equal employment opportunity policy.
  • Potential to contribute meaningfully to a large-scale engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

BHG Financial

Associate Database Administrator

BHG Financial 1K-5K Diversified Financial Services

BHG Financial is hiring an early-career Database Administrator to support SQL Server databases across on-premises and Azure environments, maintaining reliable, secure, and high-performing systems for a financial services organization.

United States Full-time Junior Database Administrator
Azure PowerShell SQL SQL Server
11 hours, 8 minutes ago
CI&T

[Job-31961] Data Developer Sênior - Cloud DB Specialist, Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca um Cloud Data Developer Sênior para liderar a arquitetura e execução da migração de bancos de dados on-premises para o Azure em um projeto estratégico de modernização de infraestrutura para um cliente do setor de saúde.

Brazil Full-time Senior Cloud Engineer Database Administrator
Agile Azure CI/CD Kanban Microservices Scrum
11 hours, 8 minutes ago
Banyan Software

Application Support Analyst – SQL & Data

Banyan Software 51-250 Internet Software & Services

TechGrove, Banyan Software’s Chennai-based technology centre, is hiring a Technical Support and Data Analyst to support TotalCtrl, a field service management platform, by resolving customer issues, managing data, and improving support through AI-enabled processes.

India Full-time Junior Database Administrator Technical Support Engineer
C# Git HubSpot JIRA JSON Laravel Metabase MySQL .NET PHP PostgreSQL Postman Power BI SQL SQL Server
1 day, 11 hours ago
SSC Egypt

Senior Data Architect (Telco)

SSC Egypt 11-50 IT Services

Senior Telco Data Modeler responsible for designing telecommunications data models and Customer 360 structures that unify customer, account, service, billing, and usage data.

Egypt Mid Level Data Architect
SQL
2 days, 12 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers