RemoteLeaf Logo
Log in Sign up

Senior Databricks Engineer

4 weeks, 1 day ago
Canada
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt GCP Generative AI Git HIPAA MLflow Python SQL
Apply Now
Bounteous

Bounteous

Bounteous collaborates with ambitious brands across various industries, including finance and healthcare, to drive digital transformation by creating innovative and seamless customer experiences through advanced technologies such as AI, cloud, and data...

Internet Software & Services
1K-5K
Founded 2003
View All Jobs 14

Description

  • Architect, build, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, and Delta Lake.
  • Design and implement medallion architecture data layers and enforce data quality, governance, and lineage standards.
  • Optimize Spark jobs and cluster configurations for performance and cost through partitioning, caching, and autoscaling strategies.
  • Implement and manage Unity Catalog for access control, governance, and cross-workspace asset sharing.
  • Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines.
  • Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products.
  • Establish engineering best practices, conduct code reviews, and mentor junior data engineers.
  • Monitor production pipelines, troubleshoot failures, and drive root-cause analysis and continuous improvement.
  • Promote and enforce information security practices, including secure use of information assets and password and malware protection protocols.
  • Assess and report security risks and ensure compliance with data privacy and protection standards such as GDPR and CCPA.

Requirements

  • 5+ years of data engineering experience, including 3+ years building production solutions on Databricks and Apache Spark.
  • Expert proficiency in Python (PySpark) and advanced SQL.
  • Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern.
  • Strong experience with at least one major cloud platform: AWS, Azure, or GCP.
  • Proven track record optimizing Spark performance and managing cluster cost.
  • Experience with data modeling, warehousing concepts, and building dimensional or analytics-ready datasets.
  • Proficiency with Git-based version control, CI/CD, and infrastructure-as-code.
  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
  • Databricks certification (Data Engineer Associate/Professional) is preferred.
  • Experience with Delta Live Tables, structured streaming, and real-time data processing is preferred.
  • Familiarity with MLflow and production machine learning workflows is preferred.
  • Experience with orchestration tools such as Airflow or dbt, and data observability platforms is preferred.
  • Exposure to data governance, security, and compliance frameworks such as GDPR, HIPAA, or SOC 2 is preferred.
  • Hands-on experience with AI coding assistants such as Claude Code, GitHub Copilot, or Cursor is preferred.
  • Familiarity with LLM APIs and SDKs such as Anthropic Claude or OpenAI, prompt engineering, RAG, and vector search is preferred.

Benefits

  • Bounteous is willing to sponsor eligible candidates for employment visas.
  • Remote work is available, as indicated by the #LI-Remote designation.
  • Equal opportunity employer with non-discrimination protections across protected characteristics.
  • Accommodation support is provided for candidates in Canada throughout the hiring process.
  • Opportunity to subscribe to monthly job openings alerts to stay connected with the company.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dan.com - a GoDaddy brand

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

United States Contract Lead Data Engineer
AWS
1 day, 19 hours ago
Xebia

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Romania Bulgaria Poland Europe Senior Data Engineer
Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
1 day, 19 hours ago
Coupang

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

South Korea Full-time Lead Data Engineer
Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
1 day, 19 hours ago
Cresteo

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

Latin America Full-time Senior Database Administrator Data Engineer
JSON SQL Server
1 day, 19 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers