RemoteLeaf Logo
Log in Sign up

Data Engineer

1 month, 1 week ago
Germany
Full-time
Mid Level
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS CI/CD Docker FastAPI Git Gradle Kafka Kubernetes Maven Microservices Python REST API Scala Terraform
Apply Now
Kpler

Kpler

Kpler provides a comprehensive platform for global trade intelligence, offering real-time data and analytics that empower businesses to plan, grow, and operate sustainably across various commodities and markets.

Professional Services
251-1K
Founded 2014
View All Jobs 10

Description

  • Build and maintain core datasets for vessels characteristics, companies, and geospatial data.
  • Create and maintain REST APIs, streaming pipelines with Kafka Streams, and Spark batch pipelines.
  • Own development tasks end to end, from understanding requirements through implementation, testing, deployment, and review.
  • Design and build APIs and data processing components for development environments and peer/product testing.
  • Write and execute unit, integration, functional, and end-to-end tests based on defined scenarios.
  • Monitor system performance, alerts, and SLOs after release to ensure reliability and optimal functionality.
  • Deliver well-documented, maintainable code following TDD principles and clean code standards.
  • Implement data schema evolution and versioning strategies to support reliable data exchange.
  • Develop and maintain batch and streaming data pipelines, including backpressure handling, orchestration, retries, and data quality controls.
  • Instrument services with metrics, logs, and traces, and contribute to CI/CD and incident response.

Requirements

  • 3–5 years of experience in data-focused software engineering roles.
  • Strong programming skills in Scala or other JVM languages; Python experience is preferred.
  • Experience designing and operating RESTful APIs and versioned interfaces.
  • Good understanding of data modeling, schema evolution, and serialization technologies such as Avro or Protobuf.
  • Experience building and maintaining batch or streaming data systems.
  • Familiarity with CI/CD pipelines and modern monitoring and alerting practices.
  • Proficiency with Git-based workflows, code reviews, and Agile development methodologies.
  • Strong ownership mindset with pragmatic problem-solving skills and the ability to deliver end-to-end solutions.
  • Excellent communication skills and fluency in English.
  • Experience with Apache Airflow is a plus.
  • Exposure to cloud platforms, preferably AWS, and infrastructure as code with Terraform is a plus.
  • Experience with Docker and Kubernetes in production environments is a plus.
  • Hands-on knowledge of Kafka and event-driven or microservices architectures is a plus.
  • Familiarity with JVM build tools such as Gradle or Maven is a plus.

Benefits

  • Remote full-time role based in Germany.
  • Opportunity to work on high-impact data products in commodities, energy, and maritime markets.
  • Work at a global company with more than 700 experts across 35+ countries.
  • Inclusive and diverse work environment.
  • Supportive culture that emphasizes collaboration and helping colleagues and clients.
  • Encouragement to apply even if you do not meet every requirement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Natera

Head of Data Engineering & Platform, Real-World Data (RWD)

Natera 1K-5K Pharmaceuticals

Natera is hiring a Head of Data Engineering & Platform for Real-World Data to lead the strategy, development, and delivery of a healthcare data platform that supports clinical, research, analytics, and business needs.

United States Full-time Lead Data Engineer
$154k-$193k
Agile AWS CI/CD Machine Learning PostgreSQL Python REST API Snowflake SQL
1 hour, 35 minutes ago
Knak

Senior Data Engineer

Knak 51-250 Internet Software & Services

Knak is hiring its first Data Engineer to architect the governed Snowflake data layer that powers company-wide self-serve analytics, AI agents, and department-specific data access.

Canada Full-time Senior Data Engineer
AWS Databricks dbt GCP Git LinkedIn Ads Looker Mixpanel Mode MySQL Pandas Python Salesforce Snowflake SQL Tableau
2 hours, 16 minutes ago
Lingaro

SAP BW Lead

Lingaro 5K-10K IT Services

SAP BW Lead for Poland’s CC Data Engineering & Management team at SAP, responsible for leading SAP BW-related data engineering work in a full-time remote role.

Poland Full-time Lead Data Engineer
3 hours, 30 minutes ago
Egen.ai

Senior Data Engineer

Egen.ai IT Services

Egen is seeking a Senior Data Engineer to build scalable, client-facing data platforms and API integrations on Google Cloud, with a focus on healthcare data solutions.

Anywhere Full-time Senior Data Engineer
$125k-$150k
Apache Airflow AWS dbt GCP JSON Python REST API Salesforce SQL
4 hours, 10 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers