RemoteLeaf Logo
Log in Sign up

Data Engineer (Python)

3 months, 1 week ago
Germany
Full-time
Mid Level
Data Engineer
Software Development
Kafka Kubernetes PostgreSQL Python SQL Trino
Apply Now
Orcrist Technologies

Orcrist Technologies

Orcrist Technologies specializes in providing advanced technology solutions, including data analytics, AI applications, and cybersecurity, aimed at empowering businesses to innovate and transform through the use of artificial intelligence and data-driv...

Internet Software & Services
View All Jobs 15

Description

  • Prototype batch and streaming ingestion and connector patterns using NiFi, Kafka, Kafka Connect/Streams, and CDC approaches.
  • Design schemas and data models that are easy to adopt and support clear semantics and controlled evolution.
  • Build incremental lakehouse datasets using Hudi, Iceberg, or Delta patterns and create queryable outputs for performance and latency evaluation.
  • Incorporate data quality, provenance, metadata, and operability considerations early in prototype development.
  • Containerize and deploy prototypes on Kubernetes and provide minimal runbooks and configuration files to support handoff.
  • Produce adoption artifacts including schemas, reference implementations, technical design notes, and integration backlogs.
  • Generate credible performance and operability readouts for new data initiatives.
  • Collaborate with delivery or foundation teams to enable productization of prototypes.

Requirements

  • 3+ years of data engineering experience, with hands-on pipeline delivery beyond ad hoc scripts.
  • Strong Python and SQL skills for transformations, validation tooling, and pipeline glue code.
  • Practical knowledge of streaming and CDC concepts, including ordering, duplication, replay, and idempotency.
  • Experience with the Kafka ecosystem.
  • Familiarity with lakehouse and storage/query layers such as Hudi, Iceberg, Delta, Trino, Hive, or Postgres.
  • Comfort working in Kubernetes and container-based environments.
  • Ability to document technical decisions clearly.
  • Eligible to work in Germany; EU or NATO citizenship is preferred and export-control screening applies.
  • Experience with Great Expectations or similar data quality tools is preferred.
  • Experience with metadata and lineage platforms such as OpenMetadata, DataHub, or Atlas is preferred.
  • Experience shipping in on-prem or air-gapped environments is preferred.
  • Governance and policy awareness for regulated customers is preferred.
  • German language proficiency at B1+ level is preferred.
  • Experience with OSINT, GEOINT, or multi-INT data shapes is preferred.

Benefits

  • Remote-first work in Germany with regular Berlin prototyping sprints.
  • 30 days of vacation.
  • Equipment and learning budget.
  • Opportunity to work with a modern data stack including Kafka, NiFi, lakehouse technologies, distributed SQL, and Kubernetes.
  • High-leverage work where prototypes become blueprints reused and productized by multiple teams.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

D

Cyber Data Engineer

D2 Technical Services 11-50 IT services and consulting

D2 Technical Services is hiring a systems engineer to support national security cybersecurity operations by managing infrastructure, data pipelines, and SIEM environments.

United States Full-time Senior Data Engineer Security Engineer
$140k-$145k
AWS Bash Cybersecurity DHCP DNS Elasticsearch GCP Linux PowerShell Python SIEM Splunk
18 hours, 12 minutes ago
Voyager

Senior DataOps Engineer

Voyager Life Sciences Tools & Services

Voyager Technologies is hiring a remote US-based DataOps Engineer to own cloud-to-data platform migration and operations for mission-critical analytics in a regulated national security environment.

United States Full-time Senior Data Engineer
$150k-$180k
Ansible Apache Airflow Apache Spark AWS Azure Cassandra CloudFormation dbt Docker Git GitHub GitHub Actions GitLab GitLab CI Kafka Kubernetes MongoDB Pandas PostgreSQL PowerShell Python Redis Scala SQLAlchemy SQL Server Terraform
18 hours, 42 minutes ago
Dragos

Data Engineering Manager

Dragos 251-1K Professional Services

Dragos is seeking a Data Engineering Manager to lead the team building the core data layer that supports its cybersecurity products and threat-focused engineering work.

United States Full-time Lead Data Engineer Engineering Manager
$220k-$220k
Agile Apache Airflow ClickHouse Cybersecurity dbt Docker Kubernetes PostgreSQL Rust SOC
18 hours, 42 minutes ago
Movement Labs

Senior Data Engineers

Movement Labs 11-50 Media

Movement Labs is hiring Senior and Mid-level Data Engineers to support its progressive political data platform, with a focus on building and operating systems for voter outreach, experimentation, and election readiness.

United States Contract Senior Data Engineer
$90k-$119k
Apache Airflow Dagster dbt GCP Python SQL
18 hours, 57 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers