Middle Data Engineer for Real Time Streaming Platform

1 month, 1 week ago
Full-time
Mid Level
Software Development
GR8 Tech

GR8 Tech

GR8 Tech is a leading B2B iGaming solutions provider, offering a full range of betting and gambling software solutions. Their top-of-the-line software and services cater to iGaming professionals looking to launch, grow, or upgrade their businesses, pro...

IT Services
251-1K

Description

  • Build and maintain data pipelines using Apache Kafka, including topics, partitions, and consumer group tuning.
  • Implement and manage Kafka Connect source and sink connectors for system integrations.
  • Design and develop stateful streaming applications using Kafka Streams or Flink with Java, and Scala where applicable.
  • Ensure data consistency and schema evolution using Schema Registry and Avro.
  • Write and maintain unit and integration tests for streaming topologies.
  • Support reliable data processing and integration across streaming applications.
  • Work with large datasets using SQL for processing and analysis.
  • Contribute to the ongoing maintenance and improvement of streaming data solutions.

Requirements

  • 3+ years of experience in back-end development.
  • Commercial experience in software engineering with strong proficiency in Java; Scala is a plus.
  • Understanding of Apache Kafka architecture and internals.
  • Experience working with Apache Flink.
  • Experience with Schema Registry and schema evolution strategies.
  • Knowledge of serialization formats such as Avro and JSON.
  • Experience using SQL for processing large datasets.
  • Upper-intermediate or higher level of English.
  • Experience running Kafka and/or Flink on Kubernetes is a plus.
  • Familiarity with monitoring tools such as Prometheus and Grafana for streaming metrics is a plus.
  • Understanding of stream processing semantics is a plus.
  • Experience with CI/CD pipelines for streaming applications is a plus.

Benefits

  • Annual Benefits Cafeteria budget you can allocate to sports, medical, mental health, home office, or language learning.
  • Paid maternity/paternity leave plus a monthly childcare allowance.
  • 20+ vacation days, unlimited sick leave, and emergency time off.
  • Remote-first work model with tech support and coworking compensation.
  • Team events, including online, offline, and offsite gatherings.
  • Internal courses and growth programs to support learning and development.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Freelance Senior Data Engineer

Huge 251-1K Media

Huge is hiring a remote freelance Senior Data Engineer to support digital analytics and web data collection work that improves the accuracy and reliability of cross-platform measurement.

Agile Google Tag Manager JavaScript
13 hours, 55 minutes ago

Senior Data Engineer (R13923)

Oportun 1K-5K Banks

Oportun is hiring a Senior Data Engineer to design and deliver scalable data platforms and solutions that support business and analytical needs across cross-functional initiatives.

Agile Apache Airflow Apache Spark AWS Azure Databricks GCP Hadoop Java Jenkins Kafka Kanban MariaDB PostgreSQL Python Scala Scrum SQL
14 hours, 40 minutes ago

AWS Senior DevOps Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring a Senior DevOps Engineer to provision and operate a multi-region AWS environment for a US expansion while maintaining parity with the existing EU setup and supporting analytics and security operations.

AWS CI/CD Penetration Testing PostgreSQL
14 hours, 55 minutes ago

Data Analytics Senior

MUTT DATA 51-250 Internet Software & Services

Mutt Data is hiring a Data Analytics Senior to build and maintain business-facing reporting and data models for a remote startup working with machine learning and data products.

Apache Spark AWS Azure Databricks dbt Deep Learning GCP Generative AI Machine Learning Power BI SQL
1 day, 14 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers