RemoteLeaf Logo
Log in Sign up

Databricks Engineer

1 month, 2 weeks ago
United States
Full-time
Mid Level
Data Engineer
Data Science and Analytics
Agile Apache Airflow Apache Spark AWS CI/CD Databricks Feature Engineering Generative AI HIPAA Kafka Machine Learning MLflow MLOps Prefect Python SQL Terraform
Apply Now
RevStar

RevStar

RevStar Consulting is a client-centric cloud consulting firm that specializes in developing modern, user-focused, cloud-native web and mobile applications. They offer custom integrations, implementations, and solutions using the latest cloud technologi...

Internet Software & Services
51-250
Founded 2009
View All Jobs 7

Description

  • Develop and optimize data pipelines using Apache Spark and Delta Lake within Databricks.
  • Implement ETL/ELT workflows for data ingestion, transformation, and storage.
  • Design scalable Lakehouse architecture solutions across structured and unstructured data sources.
  • Integrate Databricks with cloud storage platforms such as Azure Data Lake, AWS S3, and Google Cloud Storage.
  • Optimize Spark jobs for scalability, cost efficiency, and low latency.
  • Implement monitoring, alerting, automated validation, and data quality processes.
  • Support ML model training and deployment within Databricks using MLflow for tracking and versioning.
  • Collaborate with data scientists, ML engineers, architects, and business stakeholders to deliver aligned solutions.
  • Implement feature engineering pipelines and help integrate models into production environments.
  • Ensure data security, access control, governance, compliance, and documentation best practices.

Requirements

  • 3+ years of hands-on experience in data engineering with big data processing and cloud-native architectures.
  • 2+ years of hands-on experience with Databricks, including Apache Spark, Delta Lake, and MLflow.
  • Databricks Certified Data Engineer Associate or higher certification is mandatory.
  • Proficiency in Python, SQL, and Spark-based frameworks.
  • Experience developing and optimizing large-scale ETL/ELT pipelines.
  • Strong understanding of Lakehouse architecture and cloud-agnostic data solutions.
  • Familiarity with CI/CD pipelines and Infrastructure-as-Code tools for Databricks, such as Terraform and Databricks CLI.
  • Knowledge of data governance, security, and compliance best practices.
  • Experience working in Agile environments and following DevOps/MLOps best practices.
  • Preferred: additional Databricks certifications, such as Databricks Certified Machine Learning Associate.
  • Preferred: experience with real-time streaming tools such as Kafka, Kinesis, or Event Hub.
  • Preferred: familiarity with orchestration tools such as Apache Airflow or Prefect.
  • Preferred: background in AI/ML integration within Databricks, including feature engineering and model deployment.
  • Preferred: experience in client-facing roles or consulting environments.

Benefits

  • Paid time off.
  • Remote-first working environment.
  • Comprehensive health coverage including medical, dental, and vision.
  • 401(k) retirement plan.
  • Annual learning and development stipend for conferences, certifications, or courses.
  • Peer mentorship and coaching.
  • Professional growth opportunities with exposure to AWS GenAI, data, and cloud technologies.
  • Company outings and volunteer opportunities.
  • Collaborative, innovative culture.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Coforge

Senior Data Engineer - Qlik Replicate

Coforge 10K-50K IT Services

The company is hiring a Qlik Replicate specialist to build and support data replication and pipeline operations across enterprise systems as part of migration, modernization, and integration work.

Malaysia Senior Data Engineer
CI/CD DB2 Hadoop Oracle
17 hours, 57 minutes ago
Coforge

Senior Data Engineer

Coforge 10K-50K IT Services

Coforge is hiring a Senior Data Engineer in Costa Rica for a remote role focused on building and supporting cloud-based data platforms and pipelines.

Costa Rica Lead Data Engineer
Agile Azure CI/CD dbt Git Snowflake SQL Terraform
17 hours, 57 minutes ago
Nortal

(EG0049) Senior Data Engineer - Talent Connection

Nortal 251-1K Internet Software & Services

Nortal is seeking a Senior Data Engineer for a remote LATAM role focused on designing and optimizing data pipelines and analytics solutions for business intelligence and machine learning initiatives.

Latin America Full-time Senior Data Engineer
Java Machine Learning Power BI Python Scala SQL Tableau
17 hours, 57 minutes ago
Mindrift.ai: Be the “I” in AI

Senior Python Data Scraping Engineer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a Senior Python Data Scraping Engineer for its Tendem freelance project to support hybrid AI-human data extraction workflows and deliver accurate structured datasets.

Brazil Part-time Senior Backend Engineer Data Engineer
$52k-$52k
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
17 hours, 57 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers