Senior Data Engineer

1 month, 4 weeks ago
Full-time
Lead
Software Development
Enable Data

Enable Data

Enable Data is a leading provider of advanced data, software, and cloud engineering services, specializing in the implementation of large-scale data solutions such as Hadoop clusters and SAS applications to support critical business operations in the h...

IT Services
11-50
Founded 2018

Description

  • Design, develop, and maintain scalable data solutions in the cloud using Apache Spark and Databricks.
  • Gather and analyze data requirements from business stakeholders.
  • Build and optimize data pipelines for ingestion, processing, and integration.
  • Ensure data quality, integrity, and security across the data lifecycle.
  • Collaborate with cross-functional teams to design data models, schemas, and storage solutions.
  • Tune Spark jobs and use Databricks features to improve processing and analytics performance.
  • Provide technical guidance to junior data engineers and developers.
  • Contribute to improvements in data engineering processes, tools, and best practices.
  • Stay current on emerging trends in cloud computing, big data, and data engineering.

Requirements

  • Bachelor's or Master's degree in computer science, engineering, or a related field.
  • 10+ years of experience as a Data Engineer, Software Engineer, or similar role.
  • Strong experience with cloud platforms such as Azure.
  • Proficiency in Apache Spark and Databricks for large-scale data processing and analytics.
  • Experience designing and implementing data processing pipelines using Spark and Databricks.
  • Strong knowledge of SQL and experience with relational and NoSQL databases.
  • Experience with data integration and ETL processes using tools like Apache Airflow or cloud-native orchestration services.
  • Good understanding of data modeling and schema design principles.
  • Experience with data governance and compliance frameworks.
  • Excellent problem-solving, troubleshooting, communication, and collaboration skills.
  • Relevant certifications in cloud platforms, Spark, or Databricks are a plus.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Middle Data Engineer for Real Time Streaming Platform

GR8 Tech 251-1K IT Services

GR8_TECH is hiring a Streaming Data Engineer to design, build, and maintain Kafka-based streaming data solutions that support reliable processing, integrations, and testing for its B2B iGaming platform.

CI/CD Grafana Java JSON Kafka Kubernetes Prometheus Scala SQL
5 hours, 36 minutes ago

Senior Data Engineer - Managed Services

3Cloud 251-1K Internet Software & Services

3Cloud is hiring a Senior Data Engineer for Managed Services to support and optimize client Microsoft Azure data and Power BI environments while delivering analytics solutions and resolving incidents across diverse customer accounts.

Azure Databricks Power BI
6 hours, 6 minutes ago

Senior Compute Platform Engineer

Zeta Global 1K-5K Media

Zeta Global is hiring a Senior Compute Platform Engineer for its Data Platform team to build and operate the infrastructure behind its lakehouse and large-scale data processing environment.

Apache Airflow Apache Spark AWS EC2 Hadoop Kubernetes Linux Scala
6 hours, 6 minutes ago

Data Engineer

Stitch Fix 10K-50K Textiles, Apparel & Luxury Goods

Stitch Fix is hiring a data engineer to help build and scale the infrastructure that centralizes ETL logic and metric definitions for personalized retail analytics and AI-driven operations.

Apache Airflow Apache Spark AWS dbt Python SQL
6 hours, 21 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers