Azure Databricks Data Engineer

2 hours ago
Full-time
Mid Level
Data Science and Analytics
OZ Digital,

OZ Digital,

OZ Digital Consulting Unlock growth opportunities with OZ Digital Consulting. Our expert solutions drive innovation, transformation, and success for your business. OZ is a consulting and technology solutions leader focused on increasing customer engage...

Internet Software & Services
251-1K
Founded 1997

Description

  • Design and implement end-to-end data solutions on the Azure platform, including ingestion, processing, storage, and visualization.
  • Develop and maintain data pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage, and related tools.
  • Collaborate with data architects and data scientists to define data requirements and design scalable data models and schemas.
  • Implement ETL and other data integration solutions to move data from diverse sources into Azure data platforms.
  • Monitor and optimize data pipelines and storage systems to ensure reliability, availability, and performance.
  • Troubleshoot and resolve data-related issues, including data quality, performance, and security concerns.
  • Work with cross-functional teams to gather business requirements and translate them into technical solutions.
  • Perform data profiling, validation, and cleansing to improve data accuracy and consistency.
  • Document technical specifications, data flows, and processes for reference and knowledge sharing.
  • Stay current on Azure data technologies and recommend new tools and techniques where appropriate.

Requirements

  • 3+ years of proven work experience with Databricks.
  • 2+ years of proven work experience with Azure data integration services, data modeling, and data architecture.
  • Proven experience as a Data Engineer with a focus on Azure cloud technologies.
  • Strong knowledge of Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics.
  • Proficiency in Python, SQL, and PowerShell for data manipulation and automation.
  • Experience with data modeling and designing efficient data structures for analytics and reporting.
  • Solid understanding of ETL processes and data transformation techniques.
  • Familiarity with big data technologies such as Apache Spark and Hadoop is a plus.
  • Strong problem-solving skills with the ability to debug and resolve complex data issues.
  • Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
  • Azure Data Engineer Associate or Azure Solutions Architect Expert certification is highly desirable.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Operations Engineer

SWORD Health 251-1K Health Care Providers & Services

Sword Health is hiring a remote Data Operations Engineer in its Growth team to support healthcare client integrations by maintaining accurate, timely data pipelines that power its AI care platform.

HIPAA SFTP SQL
0 minutes ago

Data Engineer

Irth 51-250 Diversified Telecommunication Services

Irth Solutions is hiring a Data Engineer to help implement and operate a multi-cloud Databricks lakehouse platform that centralizes, governs, and delivers enterprise data across AWS, Azure, and GCP.

Apache Airflow Apache Spark AWS Azure CI/CD Databricks Encryption GCP Git Machine Learning Power BI SQL
0 minutes ago

Data Engineer | Flying On The Cloud (FOTC) [B2B]

Bee Talents 51-250 Professional Services

FOTC, a Google Cloud Premier Partner, is hiring a remote Data Engineer in Poland to design and build data warehouse and ETL solutions that support data management and BI workflows.

Apache Airflow AWS Azure CI/CD Docker GCP Git Kubernetes Python SQL Terraform
0 minutes ago

Data Engineer

ForceMetrics 11-50 information technology & services

ForceMetrics is hiring a mission-driven Data Engineer to help design, build, and scale a data platform that supports public safety and government analytics for better community outcomes.

Agile AWS CI/CD Docker Elasticsearch GCP Kibana Kubernetes MySQL PostgreSQL Power BI Python Scrum SQL SQL Server Tableau
0 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers