RemoteLeaf Logo
Log in Sign up

Senior Software Engineer - Data Integration & JVM Ecosystem

2 months ago
United Kingdom
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark Beam ClickHouse dbt Flink Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
Apply Now
ClickHouse

ClickHouse

ClickHouse provides a fast open source column-oriented database management system that enables users to generate real-time analytical data reports through SQL queries, catering to the needs of industries requiring efficient data processing and analysis.

IT Services
51-250
Founded 2021
$300M raised
View All Jobs 133

Description

  • Own and maintain critical parts of ClickHouse’s data engineering ecosystem for JVM-based frameworks.
  • Build and maintain official data connectors for systems such as Kafka, dbt, Spark, Flink, Beam, and Fivetran.
  • Develop SDKs and connectors that make ClickHouse feel native in JVM-based applications.
  • Own the full lifecycle of data framework integrations, from core database drivers to higher-level tooling.
  • Collaborate with open-source contributors, internal teams, and enterprise users to improve JVM integrations.
  • Work on low-level database integrations and high-level visualization platform integrations.
  • Help ensure integrations meet standards for performance, reliability, and developer experience.
  • Support data workloads involving real-time analytics, observability, and large-scale data processing.

Requirements

  • 6+ years of software development experience focused on high-quality, data-intensive solutions.
  • Proven experience with the internals of at least one of these technologies: Apache Spark, Apache Flink, Kafka Connect, or Apache Beam.
  • Experience developing or extending connectors, sinks, or sources for at least one big data processing framework such as Spark, Flink, Beam, or Kafka Connect.
  • Strong understanding of database fundamentals, including SQL, data modeling, query optimization, and OLAP/analytical databases.
  • Track record of building scalable data integration systems beyond simple ETL jobs.
  • Strong proficiency in Java and the JVM ecosystem, including memory management, garbage collection tuning, and performance profiling.
  • Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns.
  • Outstanding written and verbal communication skills for cross-functional collaboration.
  • Understanding of JDBC, network protocols such as TCP/IP and HTTP, and techniques for optimizing data throughput over the wire.
  • Passion for open-source development.
  • Prior contributions to open-source projects, active OSS community engagement, or influencing core system evolution is a plus.
  • Familiarity with ClickHouse or similar high-performance data platforms is a plus.
  • Working knowledge of Python in data engineering contexts such as Pandas, PySpark, or Airflow is a plus.

Benefits

  • Flexible, remote-friendly work environment across more than 20 countries.
  • Employer contributions toward healthcare.
  • Equity in the company through stock options for new team members.
  • Flexible time off in the US and generous vacation entitlement in other countries.
  • $500 home office setup allowance for remote employees.
  • Opportunities to connect with colleagues through company-wide offsites and global gatherings.
  • Competitive salary range with location-based market adjustments.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Datadog

Senior Software Engineer - Security Libraries

Datadog 5K-10K IT Services

Datadog is hiring a senior polyglot engineer to build and operate security library integrations for its run-time security products, with a primary focus on .NET or Java.

France Spain Full-time Senior Security Engineer Software Engineer
C# C++ Envoy Go HAProxy Java Maven .NET Nginx Node.js PHP Python Ruby WAF
17 hours, 33 minutes ago
Databricks

Sr. Forward Deployed Engineer (FDE) - Retail

Databricks 1K-5K IT Services

Databricks is hiring a Forward Deployed Engineer to work directly with customers on building and productionizing data and AI solutions on the Databricks platform.

United States Full-time Senior Software Engineer Solutions Engineer
$182k-$250k
Apache Spark AWS Azure CI/CD Databricks GCP JavaScript Machine Learning MLOps Python Scala TypeScript
17 hours, 48 minutes ago
AvePoint

CRM Developer Engineer (Johor Bahru)

AvePoint 1K-5K Internet Software & Services

AvePoint is seeking a CRM Specialist to configure, customize, and support Microsoft Dynamics 365 systems for customer-related projects with public agency IT teams in Singapore and the company’s R&D team.

Malaysia Full-time Mid Level Salesforce Developer Software Engineer
CI/CD CSS HTML JavaScript Microsoft Dynamics 365 MySQL PostgreSQL React SFTP SQL Server
17 hours, 48 minutes ago
Fundraise Up

Senior AI Enablement Engineer

Fundraise Up 51-250 Capital Markets

Fundraise Up is hiring an AI Enablement Engineer in a remote role based in Turkey to drive adoption of AI-assisted development and build the internal integrations that improve engineering productivity across a global product team.

Turkey Full-time Senior AI Engineer Software Engineer
$65k-$70k
Bull CI/CD ClickHouse Elasticsearch Grafana Kafka Koa LLM MongoDB NestJS Node.js OpenTelemetry Prometheus React Redis Serverless TypeScript Vue.js
17 hours, 48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers