RemoteLeaf Logo
Log in Sign up

Senior Software Engineer - Python and Data Ecosystem

2 months ago
Canada
Full-time
Senior
Backend Engineer
Software Development
Apache Airflow Apache Spark ClickHouse Dagster dbt Flink Metabase NumPy Pandas Power BI Prefect Python SQL Superset Tableau
Apply Now
ClickHouse

ClickHouse

ClickHouse provides a fast open source column-oriented database management system that enables users to generate real-time analytical data reports through SQL queries, catering to the needs of industries requiring efficient data processing and analysis.

IT Services
51-250
Founded 2021
$300M raised
View All Jobs 158

Description

  • Own and evolve ClickHouse’s Python connector and SDK ecosystem, improving performance, reliability, and API design.
  • Build and maintain enterprise-grade integrations with orchestration platforms such as Airflow, Dagster, and Prefect.
  • Develop and maintain integrations with transformation tools such as dbt and SQLMesh.
  • Drive the AI/LLM integration strategy for RAG architectures, ML feature pipelines, and LLM-powered data applications.
  • Engage with the open-source community by triaging issues, supporting contributors, and incorporating user feedback into the roadmap.
  • Collaborate with Product, Cloud, and other engineering teams to align integration work with platform priorities.
  • Bring a practitioner’s perspective to roadmap decisions based on real Data Engineer and Data Scientist workflows.
  • Own the full lifecycle of key Python integrations, including architecture, performance, and feature direction.

Requirements

  • 7+ years of software development experience.
  • Hands-on experience as a Data Engineer, Data Scientist, or ML Engineer is preferred.
  • Proven experience designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for at least one major platform.
  • Experience with the Python data ecosystem, including Pandas, NumPy, and Pydantic.
  • Prior contributions to or deep practical experience with Airflow, Dagster, or Prefect.
  • Hands-on production experience with AI/ML data engineering workflows such as embedding generation, vector search, feature pipelines, or LLM-powered tooling.
  • Strong understanding of SQL, data modeling, query optimization, and OLAP or analytical databases.
  • Experience with concurrent Python, including threading, multiprocessing, and async patterns.
  • Outstanding written and verbal communication skills.
  • Bonus: experience deploying AI/ML models in production, including inference APIs and vector databases.
  • Bonus: prior experience as a Data Engineer or Data Scientist in a product-facing or platform role.
  • Bonus: familiarity with ClickHouse or similar high-performance OLAP platforms.
  • Bonus: familiarity with the JVM ecosystem.

Benefits

  • Flexible, remote-friendly work environment with a globally distributed team operating in over 20 countries.
  • Employer contributions toward healthcare.
  • Stock options for every new team member.
  • Flexible time off in the US and generous vacation entitlement in other countries.
  • $500 home office setup stipend for remote employees.
  • Opportunities to connect through company-wide offsites and global gatherings.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Affirm

Software Engineer II, Backend (ML Training & Serving)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a Software Engineer II for its ML Training & Serving engineering team to build the infrastructure that trains and serves machine learning models across the company.

United States Full-time Junior Backend Engineer Machine Learning Engineer
$142k-$210k
AWS Kotlin Kubernetes Machine Learning MySQL Python
11 hours, 48 minutes ago
Samsara

Senior Data Engineer I

Samsara 1K-5K IT Services

Samsara is hiring a Senior Data Engineer in Canada to design and maintain data pipelines for its connected operations platform, transforming IoT and product data into analytics-ready datasets that support analysis, model training, and dashboards.

Canada Full-time Senior Data Engineer
$109k-$160k
Apache Airflow Apache Spark AWS Azure Dagster Databricks GCP Git GitHub Prefect Python REST API SQL
12 hours, 3 minutes ago
SoFi

Senior Backend Developer, Banking Core

SoFi 1K-5K Capital Markets

SoFi is hiring a Senior Backend Developer for Banking Core in San Francisco to lead core banking system development and migration work for its mobile-first financial services platform.

United States Full-time Senior Backend Engineer
$188k-$206k
Linux Unix
12 hours, 3 minutes ago
Intetics

1085 | Lead Rust Engineer

Intetics 1K-5K Internet Software & Services

Intetics Inc. is seeking a Lead Rust Developer to help build a high-performance open-source system for validating and visualizing electricity grid models.

Poland Portugal Slovakia Slovenia Spain Germany Full-time Lead Backend Engineer Technical Lead
JSON Rust XML
12 hours, 33 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers