RemoteLeaf Logo
Log in Sign up

Databricks Solution Architect

1 month ago
Canada
Full-time
Lead
Data Architect
DevOps and Infrastructure
Apache Spark AWS Azure CI/CD Databricks Encryption GCP Git Machine Learning MLflow Python Scala Secrets Management SQL Terraform
Apply Now
Bounteous

Bounteous

Bounteous collaborates with ambitious brands across various industries, including finance and healthcare, to drive digital transformation by creating innovative and seamless customer experiences through advanced technologies such as AI, cloud, and data...

Internet Software & Services
1K-5K
Founded 2003
View All Jobs 14

Description

  • Architect and lead implementation of an enterprise lakehouse on Databricks across one or more major cloud providers.
  • Design batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and Delta Live Tables.
  • Establish platform patterns for ingestion from operational systems, event streams, and third-party APIs.
  • Define and enforce standards for data modeling, CI/CD, code quality, testing, observability, and cost optimization.
  • Lead the governance strategy with Unity Catalog, including access control, lineage, auditability, and PII handling.
  • Optimize Spark workloads for performance and cost through cluster sizing, Photon, autoscaling, file layout, Z-ordering, caching, and query tuning.
  • Partner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving.
  • Own cloud infrastructure components including networking, IAM, secrets, encryption, and Terraform/IaC for Databricks and supporting services.
  • Mentor data engineers and lead architecture reviews, code reviews, and technical design sessions.
  • Work with stakeholders across analytics, product, and finance to shape the data platform roadmap.

Requirements

  • 8+ years of data engineering experience, including 4+ years building production workloads on Databricks.
  • Deep expertise in Apache Spark, including PySpark, Spark SQL, performance tuning, partitioning strategy, and the Catalyst/Photon execution model.
  • Strong hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.
  • Production experience on at least one major cloud platform: AWS, Azure, or GCP.
  • Experience with cloud networking, IAM, storage services such as S3, ADLS, or GCS, and compute primitives.
  • Proficiency in Python and SQL; Scala experience is a plus.
  • Experience designing medallion (bronze/silver/gold) architectures and dimensional models for analytics.
  • Strong CI/CD and DevOps practices, including Git, Terraform, Databricks Asset Bundles or dbx, and automated testing of data pipelines.
  • Track record of leading technical projects end to end and mentoring engineers.
  • Excellent written and verbal communication skills for aligning technical and business stakeholders.
  • Must be legally eligible to work in Canada.
  • Employer is willing to sponsor eligible candidates for employment visas.

Benefits

  • Salary range of $115,000 to $150,000 per year.
  • Remote work arrangement.
  • Visa sponsorship available for eligible candidates.
  • Equal opportunity employer with accommodations provided during the hiring process in Ontario.
  • Opportunity to work on enterprise-scale Databricks, cloud, data, and AI initiatives.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dan.com - a GoDaddy brand

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

United States Contract Lead Data Engineer
AWS
1 day, 19 hours ago
Xebia

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Romania Bulgaria Poland Europe Senior Data Engineer
Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
1 day, 19 hours ago
Coupang

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

South Korea Full-time Lead Data Engineer
Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
1 day, 19 hours ago
Cresteo

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

Latin America Full-time Senior Database Administrator Data Engineer
JSON SQL Server
1 day, 19 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers