RemoteLeaf Logo
Log in Sign up

Databricks Solution Architect

9 hours, 40 minutes ago
Canada
Full-time
Lead
Data Architect
DevOps and Infrastructure
Apache Spark AWS Azure CI/CD Databricks Encryption GCP Git Machine Learning MLflow Python Scala Secrets Management SQL Terraform
Apply Now
Bounteous

Bounteous

Bounteous collaborates with ambitious brands across various industries, including finance and healthcare, to drive digital transformation by creating innovative and seamless customer experiences through advanced technologies such as AI, cloud, and data...

Internet Software & Services
1K-5K
Founded 2003
View All Jobs 15

Description

  • Architect and lead implementation of an enterprise lakehouse on Databricks across one or more major cloud providers.
  • Design batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and Delta Live Tables.
  • Establish platform patterns for ingestion from operational systems, event streams, and third-party APIs.
  • Define and enforce standards for data modeling, CI/CD, code quality, testing, observability, and cost optimization.
  • Lead the governance strategy with Unity Catalog, including access control, lineage, auditability, and PII handling.
  • Optimize Spark workloads for performance and cost through cluster sizing, Photon, autoscaling, file layout, Z-ordering, caching, and query tuning.
  • Partner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving.
  • Own cloud infrastructure components including networking, IAM, secrets, encryption, and Terraform/IaC for Databricks and supporting services.
  • Mentor data engineers and lead architecture reviews, code reviews, and technical design sessions.
  • Work with stakeholders across analytics, product, and finance to shape the data platform roadmap.

Requirements

  • 8+ years of data engineering experience, including 4+ years building production workloads on Databricks.
  • Deep expertise in Apache Spark, including PySpark, Spark SQL, performance tuning, partitioning strategy, and the Catalyst/Photon execution model.
  • Strong hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.
  • Production experience on at least one major cloud platform: AWS, Azure, or GCP.
  • Experience with cloud networking, IAM, storage services such as S3, ADLS, or GCS, and compute primitives.
  • Proficiency in Python and SQL; Scala experience is a plus.
  • Experience designing medallion (bronze/silver/gold) architectures and dimensional models for analytics.
  • Strong CI/CD and DevOps practices, including Git, Terraform, Databricks Asset Bundles or dbx, and automated testing of data pipelines.
  • Track record of leading technical projects end to end and mentoring engineers.
  • Excellent written and verbal communication skills for aligning technical and business stakeholders.
  • Must be legally eligible to work in Canada.
  • Employer is willing to sponsor eligible candidates for employment visas.

Benefits

  • Salary range of $115,000 to $150,000 per year.
  • Remote work arrangement.
  • Visa sponsorship available for eligible candidates.
  • Equal opportunity employer with accommodations provided during the hiring process in Ontario.
  • Opportunity to work on enterprise-scale Databricks, cloud, data, and AI initiatives.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

SmithRx

Senior Staff Data Engineer

SmithRx 1K-5K Pharmaceuticals

SmithRx is hiring a Data Engineering leader to design and scale the data systems that power its pharmacy benefits platform, with a focus on improving transparency, governance, and business impact.

United States Full-time Lead Data Engineer
Apache Airflow Apache Spark C# C++ dbt Go Java Looker Python Scala Snowflake SQL Superset
8 hours, 40 minutes ago
CI&T

[Job 29931] Senior, AI Data Engineer Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior AI Data Engineer in Brazil to transform raw data into reliable, reusable data products that support business, BI, analytics, and machine learning teams through a single consistent source of truth.

Brazil Full-time Senior Data Engineer
Databricks dbt GitHub Machine Learning SQL
9 hours, 40 minutes ago
Intersog

Senior Data Engineer - Platform Experience

Intersog 51-250 Internet Software & Services

Intersog is hiring a Senior Data Engineer with Platform Experience to support a leading Canadian financial institution’s Core Data Platform modernization in a regulated enterprise environment.

Canada Contract Senior Data Engineer
Apache Airflow AWS Azure Dagster GitHub Actions Python Snowflake SQL
9 hours, 40 minutes ago
Intersog

Senior Data Engineer

Intersog 51-250 Internet Software & Services

Intersog is hiring a Senior Data Engineer to support a leading Canadian financial institution’s Core Data Platform team in delivering multiple high-impact initiatives.

Canada Contract Senior Data Engineer
Apache Airflow AWS Azure Dagster GitHub Actions Python Snowflake SQL Terraform
9 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers