RemoteLeaf Logo
Log in Sign up

Senior Software Engineer - Python and Data Ecosystem

13 hours, 54 minutes ago
Canada
Full-time
Senior
Backend Engineer
Software Development
Apache Airflow Apache Spark ClickHouse Dagster dbt Flink LLM Metabase NumPy Pandas Power BI Prefect Python SQL Superset Tableau
Apply Now
ClickHouse

ClickHouse

ClickHouse provides a fast open source column-oriented database management system that enables users to generate real-time analytical data reports through SQL queries, catering to the needs of industries requiring efficient data processing and analysis.

IT Services
51-250
Founded 2021
$300M raised
View All Jobs 97

Description

  • Own and evolve the Python connector and SDK ecosystem, improving performance, reliability, and API design.
  • Build and maintain integrations with orchestration platforms such as Airflow, Dagster, and Prefect.
  • Develop enterprise-grade integrations for transformation tools such as dbt.
  • Drive AI/LLM integration strategy for RAG architectures, ML feature pipelines, and LLM-powered data applications.
  • Engage with the open-source community by triaging issues, supporting contributors, and shaping the roadmap from user feedback.
  • Collaborate with Product, Cloud, and engineering teams to align integration work with platform priorities.
  • Bring a practitioner’s perspective to roadmap decisions based on real Data Engineer and Data Scientist workflows.
  • Own the full lifecycle of key Python integrations, including architecture, performance, and feature direction.

Requirements

  • 7+ years of software development experience, ideally with hands-on experience as a Data Engineer, Data Scientist, or ML Engineer.
  • Deep experience designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for at least one major platform.
  • Strong experience with the Python data ecosystem, including Pandas, NumPy, and Pydantic.
  • Practical experience with data orchestration tools such as Airflow, Dagster, or Prefect.
  • Hands-on production experience with AI/ML workflows in data engineering, including embedding generation, vector search, feature pipelines, or LLM tooling.
  • Strong understanding of SQL, data modeling, query optimization, and OLAP/analytical databases.
  • Experience with concurrent Python, including threading, multiprocessing, and async patterns.
  • Excellent written and verbal communication skills and comfort collaborating across engineering teams and open-source communities.
  • Experience deploying AI/ML models in production, including inference APIs and vector databases, is preferred.
  • Prior experience as a Data Engineer or Data Scientist in a product-facing or platform role is preferred.
  • Familiarity with ClickHouse or similar high-performance OLAP platforms is preferred.
  • Familiarity with the JVM ecosystem is preferred.

Benefits

  • Flexible, remote-friendly work environment with a globally distributed team operating in 20 countries.
  • Employer contributions toward healthcare.
  • Stock options for every new team member.
  • Flexible time off in the US and generous leave entitlement in other countries.
  • $500 home office setup stipend for remote employees.
  • Opportunities to connect with colleagues through company-wide offsites and global gatherings.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

MetroStar

Sr. Data Engineer I (6436)

MetroStar 251-1K IT Services

MetroStar is hiring a Sr. Data Engineer I to support an enterprise AI-enabled financial compliance initiative for the Department of War, building the data foundation for compliance modernization across 180+ systems.

United States Full-time Senior Data Engineer
$128k-$138k
PostgreSQL Python SQLAlchemy XML YAML
10 hours, 54 minutes ago
Fundraise Up

Backend Developer (Node.js)

Fundraise Up 51-250 Capital Markets

Fundraise Up is hiring a Backend Developer to build and scale the core services behind its global nonprofit fundraising platform.

Georgia Full-time Senior Backend Engineer
$13k-$17k
Bull ClickHouse Datadog Elasticsearch Grafana Kafka Koa MongoDB NestJS Node.js Prometheus RabbitMQ React Redis REST API TypeScript Vue.js
11 hours, 9 minutes ago
Datadog

Staff Software Engineer - Product Analytics

Datadog 5K-10K IT Services

Datadog is hiring a Staff Engineer to lead the backend technical direction for its Product Analytics platform, building systems that help customers analyze user behavior, retention, and growth at scale.

France Germany Ireland Italy Spain Switzerland Full-time Lead Data Engineer Technical Lead
SQL
11 hours, 9 minutes ago
SoFi

Senior Staff Data Engineer

SoFi 1K-5K Capital Markets

SoFi is seeking a Senior Staff Data Engineer to lead the architecture and evolution of its AI-powered Data Platform, advancing data reliability, governance, and scalable data experiences for members.

United States Full-time Lead Data Engineer
Apache Airflow Apache Spark AWS GCP GitLab Hadoop Kafka Python Snowflake SQL
11 hours, 9 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers