Senior Databricks Administrator/Architect

3 hours, 31 minutes ago
Full-time
Senior
DevOps and Infrastructure
European Dynamics

European Dynamics

EUROPEAN DYNAMICS is a leading European company specializing in ICT technologies and software products for e-government services.

IT Services
251-1K
Founded 1993

Description

  • Collaborate with data platform and integration teams to architect and implement scalable enterprise data platform solutions on Azure Databricks and related Azure services.
  • Design and develop data engineering frameworks for batch, streaming, ELT/ETL, and real-time analytics workloads.
  • Administer and maintain Azure Databricks workspaces, including clusters, job scheduling, Unity Catalog, secret management, compute policies, and workspace governance.
  • Define and implement enterprise security architecture covering identity integration, RBAC, PIM, encryption, private networking, managed identities, and Key Vault integration.
  • Establish data governance standards using Unity Catalog, including lineage, quality, metadata management, catalog organization, access policies, and audit capabilities.
  • Deploy and configure CI/CD pipelines, infrastructure as code, and release automation for Databricks environments.
  • Optimize Databricks workloads through Spark tuning, cluster sizing, partitioning, caching, Delta optimization, Photon, and cost controls.
  • Design monitoring, logging, alerting, and operational dashboards for platform health and workload observability.
  • Develop reusable architecture patterns, standards, naming conventions, operational procedures, and platform documentation.
  • Support migration of legacy data warehouses, ETL solutions, and reporting platforms to Azure Databricks lakehouse architecture.
  • Provide technical support and troubleshooting for production incidents affecting Databricks, Spark workloads, data pipelines, and platform infrastructure.

Requirements

  • University degree plus 9 years of relevant IT professional experience.
  • At least 8 years of experience designing and implementing enterprise data platforms.
  • At least 5 years of hands-on Azure Databricks experience in enterprise environments.
  • Experience architecting modern lakehouse solutions using Azure Databricks and Delta Lake.
  • Experience administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security.
  • Experience developing data engineering solutions with Apache Spark, including PySpark and/or Spark SQL.
  • Experience implementing enterprise data governance with Unity Catalog, metadata management, data lineage, and fine-grained access controls.
  • Experience implementing infrastructure as code with Terraform and/or Bicep.
  • Strong experience with CI/CD pipelines using Azure DevOps, automated testing, release management, and deployment automation.
  • Experience with enterprise security architecture including RBAC, managed identities, private endpoints, Key Vault integration, encryption, and network security.
  • Experience implementing data quality frameworks, monitoring, observability, and operational dashboards.
  • Strong understanding of dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts.
  • Strong knowledge of Azure Data Lake Storage Gen2, Azure Data Factory, Azure Event Hub, Azure SQL Database, Azure Key Vault, Azure Monitor, Microsoft Entra ID (Azure AD), and Azure networking.
  • Strong SQL skills and proficiency in Python and PySpark.
  • Knowledge of AI/ML workloads, Databricks ML, Feature Store, Model Serving, and Generative AI architectures is an asset.
  • Experience with Power BI, Microsoft Fabric, Synapse Analytics, or similar enterprise analytics platforms is highly desirable.
  • Experience in large international organizations, NGOs, or United Nations agencies is desirable.
  • Relevant certifications such as Databricks Certified Platform, Azure Solution Architecture Expert, or Databricks Certified Data Engineer Associate/Professional are desirable.
  • Excellent command of English.

Benefits

  • Remote work arrangement.
  • Competitive remuneration based on qualifications and experience.
  • Option of a contract basis or a remuneration package with full benefits.
  • Opportunity to work within a major European institution in an international, multilingual, and multicultural environment.
  • Confidential handling of applications.
  • Equal employment opportunity policy.
  • Potential to contribute meaningfully to a large-scale engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Systems Administrator - OneStream

AvePoint 1K-5K Internet Software & Services

AvePoint is seeking a System Administrator - OneStream to help implement and support its finance operating system across financial reporting and connected business systems.

CRM NetSuite Power BI SAP
2 hours, 46 minutes ago

Geospatial Technical Specialist

BKF Engineers 251-1K Construction & Engineering

BKF is hiring a remote senior geospatial analyst to support its ArcGIS team and environmental consulting work across California, with a focus on mapping, geospatial analysis, and data management for biological and cultural resource assessments.

3 hours, 1 minute ago

Cloud Operations Administrator III

Jenzabar 251-1K Internet Software & Services

Jenzabar is hiring a Cloud Operations Administrator III to support and manage customer-hosted cloud environments, troubleshoot complex issues, and drive operational efficiency for its Jenzabar One ecosystem.

Docker Kubernetes PowerShell Python SQL Server
3 hours, 1 minute ago

SSR Data Platform Admin

Resilient Co 11-50 Professional Services

Resilient Co. is hiring a semi-senior Data Platform Admin to stabilize and scale a data platform through Terraform-driven infrastructure automation and hands-on operational support.

CI/CD Databricks Python SQL Terraform
3 hours, 1 minute ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers