Data Engineer (Python)

2 months, 3 weeks ago
Full-time
Mid Level
Software Development
Orcrist Technologies

Orcrist Technologies

Orcrist Technologies specializes in providing advanced technology solutions, including data analytics, AI applications, and cybersecurity, aimed at empowering businesses to innovate and transform through the use of artificial intelligence and data-driv...

Internet Software & Services

Description

  • Prototype batch and streaming ingestion and connector patterns using NiFi, Kafka, Kafka Connect/Streams, and CDC approaches.
  • Design schemas and data models that are easy to adopt and support clear semantics and controlled evolution.
  • Build incremental lakehouse datasets using Hudi, Iceberg, or Delta patterns and create queryable outputs for performance and latency evaluation.
  • Incorporate data quality, provenance, metadata, and operability considerations early in prototype development.
  • Containerize and deploy prototypes on Kubernetes and provide minimal runbooks and configuration files to support handoff.
  • Produce adoption artifacts including schemas, reference implementations, technical design notes, and integration backlogs.
  • Generate credible performance and operability readouts for new data initiatives.
  • Collaborate with delivery or foundation teams to enable productization of prototypes.

Requirements

  • 3+ years of data engineering experience, with hands-on pipeline delivery beyond ad hoc scripts.
  • Strong Python and SQL skills for transformations, validation tooling, and pipeline glue code.
  • Practical knowledge of streaming and CDC concepts, including ordering, duplication, replay, and idempotency.
  • Experience with the Kafka ecosystem.
  • Familiarity with lakehouse and storage/query layers such as Hudi, Iceberg, Delta, Trino, Hive, or Postgres.
  • Comfort working in Kubernetes and container-based environments.
  • Ability to document technical decisions clearly.
  • Eligible to work in Germany; EU or NATO citizenship is preferred and export-control screening applies.
  • Experience with Great Expectations or similar data quality tools is preferred.
  • Experience with metadata and lineage platforms such as OpenMetadata, DataHub, or Atlas is preferred.
  • Experience shipping in on-prem or air-gapped environments is preferred.
  • Governance and policy awareness for regulated customers is preferred.
  • German language proficiency at B1+ level is preferred.
  • Experience with OSINT, GEOINT, or multi-INT data shapes is preferred.

Benefits

  • Remote-first work in Germany with regular Berlin prototyping sprints.
  • 30 days of vacation.
  • Equipment and learning budget.
  • Opportunity to work with a modern data stack including Kafka, NiFi, lakehouse technologies, distributed SQL, and Kubernetes.
  • High-leverage work where prototypes become blueprints reused and productized by multiple teams.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer - Qlik Replicate

Coforge 10K-50K IT Services

The company is hiring a Qlik Replicate specialist to build and support data replication and pipeline operations across enterprise systems as part of migration, modernization, and integration work.

CI/CD DB2 Hadoop Oracle
17 hours, 8 minutes ago

Senior Data Engineer

Coforge 10K-50K IT Services

Coforge is hiring a Senior Data Engineer in Costa Rica for a remote role focused on building and supporting cloud-based data platforms and pipelines.

Agile Azure CI/CD dbt Git Snowflake SQL Terraform
17 hours, 8 minutes ago

(EG0049) Senior Data Engineer - Talent Connection

Nortal 251-1K Internet Software & Services

Nortal is seeking a Senior Data Engineer for a remote LATAM role focused on designing and optimizing data pipelines and analytics solutions for business intelligence and machine learning initiatives.

Java Machine Learning Power BI Python Scala SQL Tableau
17 hours, 8 minutes ago

Senior Python Data Scraping Engineer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a Senior Python Data Scraping Engineer for its Tendem freelance project to support hybrid AI-human data extraction workflows and deliver accurate structured datasets.

AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
17 hours, 8 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers