RemoteLeaf Logo
Log in Sign up

Senior Databricks Administrator/Architect

1 month, 3 weeks ago
Spain
Full-time
Senior
Data Architect
DevOps and Infrastructure
Apache Spark Azure CI/CD Generative AI Network Security Power BI Python SQL Terraform
Apply Now
European Dynamics

European Dynamics

EUROPEAN DYNAMICS is a leading European company specializing in ICT technologies and software products for e-government services.

IT Services
251-1K
Founded 1993
View All Jobs 67

Description

  • Collaborate with data platform and integration teams to architect and implement scalable enterprise data platform solutions on Azure Databricks and related Azure services.
  • Design and develop data engineering frameworks for batch, streaming, ELT/ETL, and real-time analytics workloads.
  • Administer and maintain Azure Databricks workspaces, including clusters, job scheduling, Unity Catalog, secret management, compute policies, and workspace governance.
  • Define and implement enterprise security architecture covering identity integration, RBAC, PIM, encryption, private networking, managed identities, and Key Vault integration.
  • Establish data governance standards using Unity Catalog, including lineage, quality, metadata management, catalog organization, access policies, and audit capabilities.
  • Deploy and configure CI/CD pipelines, infrastructure as code, and release automation for Databricks environments.
  • Optimize Databricks workloads through Spark tuning, cluster sizing, partitioning, caching, Delta optimization, Photon, and cost controls.
  • Design monitoring, logging, alerting, and operational dashboards for platform health and workload observability.
  • Develop reusable architecture patterns, standards, naming conventions, operational procedures, and platform documentation.
  • Support migration of legacy data warehouses, ETL solutions, and reporting platforms to Azure Databricks lakehouse architecture.
  • Provide technical support and troubleshooting for production incidents affecting Databricks, Spark workloads, data pipelines, and platform infrastructure.

Requirements

  • University degree plus 9 years of relevant IT professional experience.
  • At least 8 years of experience designing and implementing enterprise data platforms.
  • At least 5 years of hands-on Azure Databricks experience in enterprise environments.
  • Experience architecting modern lakehouse solutions using Azure Databricks and Delta Lake.
  • Experience administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security.
  • Experience developing data engineering solutions with Apache Spark, including PySpark and/or Spark SQL.
  • Experience implementing enterprise data governance with Unity Catalog, metadata management, data lineage, and fine-grained access controls.
  • Experience implementing infrastructure as code with Terraform and/or Bicep.
  • Strong experience with CI/CD pipelines using Azure DevOps, automated testing, release management, and deployment automation.
  • Experience with enterprise security architecture including RBAC, managed identities, private endpoints, Key Vault integration, encryption, and network security.
  • Experience implementing data quality frameworks, monitoring, observability, and operational dashboards.
  • Strong understanding of dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts.
  • Strong knowledge of Azure Data Lake Storage Gen2, Azure Data Factory, Azure Event Hub, Azure SQL Database, Azure Key Vault, Azure Monitor, Microsoft Entra ID (Azure AD), and Azure networking.
  • Strong SQL skills and proficiency in Python and PySpark.
  • Knowledge of AI/ML workloads, Databricks ML, Feature Store, Model Serving, and Generative AI architectures is an asset.
  • Experience with Power BI, Microsoft Fabric, Synapse Analytics, or similar enterprise analytics platforms is highly desirable.
  • Experience in large international organizations, NGOs, or United Nations agencies is desirable.
  • Relevant certifications such as Databricks Certified Platform, Azure Solution Architecture Expert, or Databricks Certified Data Engineer Associate/Professional are desirable.
  • Excellent command of English.

Benefits

  • Remote work arrangement.
  • Competitive remuneration based on qualifications and experience.
  • Option of a contract basis or a remuneration package with full benefits.
  • Opportunity to work within a major European institution in an international, multilingual, and multicultural environment.
  • Confidential handling of applications.
  • Equal employment opportunity policy.
  • Potential to contribute meaningfully to a large-scale engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lingaro

Azure Data Architect - freelance

Lingaro 5K-10K IT Services

The Data Architect will shape enterprise data strategy and architecture by designing governed, scalable data models, platforms, and integration solutions that support business and analytics objectives.

Poland Freelance Senior Data Architect
Apache Spark Azure Cassandra CI/CD DynamoDB Generative AI MongoDB MySQL Oracle Python R Scala SQL Server
1 day, 4 hours ago
Smile Digital Health

Database Administrator - Remote US

Smile Digital Health 251-1K IT Services

Smile Digital Health is seeking a Database Administrator to maintain and optimize data stores supporting its FHIR-based healthcare data platform, clients, and partners worldwide.

United States Full-time Senior Database Administrator
$110k-$125k
ActiveMQ Azure Kafka MongoDB NetSuite Oracle PostgreSQL Snowflake SQL SQL Server
1 day, 4 hours ago
Lingaro

Azure Data Engineering Architect - freelance

Lingaro 5K-10K IT Services

Data Engineering Architect responsible for designing and guiding scalable, secure data architecture and processing solutions that support the organization’s analytics needs and long-term data strategy.

Poland Freelance Lead Data Architect Data Engineer
Apache Spark AWS Azure Hadoop Python SQL
1 day, 4 hours ago
MyFitnessPal

Staff Data Systems Architect

MyFitnessPal 10K-50K Health Care Providers & Services

MyFitnessPal is seeking a Staff Data Systems Architect to own the architecture and evolution of its product data stack, enabling reliable, governed data systems for its consumer health and fitness platform.

United States Full-time Lead Data Architect
$160k-$220k
Amplitude Apache Airflow dbt Docker Elasticsearch GitHub Kafka Kubernetes PlanetScale Python Scala Snowflake SQL
1 day, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers