RemoteLeaf Logo
Log in Sign up

Senior Software Engineer - Data Integration & JVM Ecosystem

3 months ago
United Kingdom
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark Beam ClickHouse dbt Flink Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
Apply Now
ClickHouse

ClickHouse

ClickHouse provides a fast open source column-oriented database management system that enables users to generate real-time analytical data reports through SQL queries, catering to the needs of industries requiring efficient data processing and analysis.

IT Services
51-250
Founded 2021
$300M raised
View All Jobs 115

Description

  • Own and maintain critical parts of ClickHouse’s data engineering ecosystem for JVM-based frameworks.
  • Build and maintain official data connectors for systems such as Kafka, dbt, Spark, Flink, Beam, and Fivetran.
  • Develop SDKs and connectors that make ClickHouse feel native in JVM-based applications.
  • Own the full lifecycle of data framework integrations, from core database drivers to higher-level tooling.
  • Collaborate with open-source contributors, internal teams, and enterprise users to improve JVM integrations.
  • Work on low-level database integrations and high-level visualization platform integrations.
  • Help ensure integrations meet standards for performance, reliability, and developer experience.
  • Support data workloads involving real-time analytics, observability, and large-scale data processing.

Requirements

  • 6+ years of software development experience focused on high-quality, data-intensive solutions.
  • Proven experience with the internals of at least one of these technologies: Apache Spark, Apache Flink, Kafka Connect, or Apache Beam.
  • Experience developing or extending connectors, sinks, or sources for at least one big data processing framework such as Spark, Flink, Beam, or Kafka Connect.
  • Strong understanding of database fundamentals, including SQL, data modeling, query optimization, and OLAP/analytical databases.
  • Track record of building scalable data integration systems beyond simple ETL jobs.
  • Strong proficiency in Java and the JVM ecosystem, including memory management, garbage collection tuning, and performance profiling.
  • Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns.
  • Outstanding written and verbal communication skills for cross-functional collaboration.
  • Understanding of JDBC, network protocols such as TCP/IP and HTTP, and techniques for optimizing data throughput over the wire.
  • Passion for open-source development.
  • Prior contributions to open-source projects, active OSS community engagement, or influencing core system evolution is a plus.
  • Familiarity with ClickHouse or similar high-performance data platforms is a plus.
  • Working knowledge of Python in data engineering contexts such as Pandas, PySpark, or Airflow is a plus.

Benefits

  • Flexible, remote-friendly work environment across more than 20 countries.
  • Employer contributions toward healthcare.
  • Equity in the company through stock options for new team members.
  • Flexible time off in the US and generous vacation entitlement in other countries.
  • $500 home office setup allowance for remote employees.
  • Opportunities to connect with colleagues through company-wide offsites and global gatherings.
  • Competitive salary range with location-based market adjustments.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Oklo

Software Engineer (Applied AI/ML)

Oklo 51-250 Electric Utilities

Oklo is hiring a Software Engineer to develop AI and machine-learning systems that support the design, analysis, and deployment of advanced fission power technology.

United States Full-time Lead Software Engineer
$200k-$250k
CI/CD Git JavaScript Machine Learning Python Rust Statistics Svelte TypeScript
8 hours, 14 minutes ago
Databricks

Sr. Forward Deployed Engineer

Databricks 1K-5K IT Services

Databricks is hiring a Forward Deployed Engineer to partner with customers on designing, building, and productionizing end-to-end data and AI solutions using the Databricks platform.

United States Full-time Senior Software Engineer
$182k-$250k
Apache Spark AWS Azure CI/CD Databricks GCP JavaScript Machine Learning MLOps Python Scala TypeScript
8 hours, 14 minutes ago
Impiricus - The HCP-Preferred Engagement Platform

Software Engineer (Full-stack)

Impiricus - The HCP-Preferred Engagement Platform 11-50 Pharmaceuticals

Impiricus is hiring a full-stack Software Engineer to build and optimize scalable web and AI-powered healthcare solutions for life sciences and healthcare users from New York, Atlanta, or remotely in the United States.

United States Full-time Junior Software Engineer
$110k-$135k
AWS Azure CI/CD GCP JavaScript LLM Next.js Node.js Python React REST API SQL TypeScript
8 hours, 14 minutes ago
Elastic

Principal Software Developer - Vector Search - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Principal Software Engineer for its globally distributed Elasticsearch Search team to advance vector similarity search features, performance, relevance, and reliability.

Canada Full-time Lead Software Engineer
$114k-$180k
Cassandra CI/CD Elasticsearch Java MongoDB PostgreSQL Solr
8 hours, 29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers