RemoteLeaf Logo
Log in Sign up

Middle Data Engineer for Real Time Streaming Platform

3 weeks ago
Anywhere
Full-time
Mid Level
Data Engineer
Software Development
CI/CD Grafana Java JSON Kafka Kubernetes Prometheus Scala SQL
Apply Now
GR8 Tech

GR8 Tech

GR8 Tech is a leading B2B iGaming solutions provider, offering a full range of betting and gambling software solutions. Their top-of-the-line software and services cater to iGaming professionals looking to launch, grow, or upgrade their businesses, pro...

IT Services
251-1K
View All Jobs 16

Description

  • Build and maintain data pipelines using Apache Kafka, including topics, partitions, and consumer group tuning.
  • Implement and manage Kafka Connect source and sink connectors for system integrations.
  • Design and develop stateful streaming applications using Kafka Streams or Flink with Java, and Scala where applicable.
  • Ensure data consistency and schema evolution using Schema Registry and Avro.
  • Write and maintain unit and integration tests for streaming topologies.
  • Support reliable data processing and integration across streaming applications.
  • Work with large datasets using SQL for processing and analysis.
  • Contribute to the ongoing maintenance and improvement of streaming data solutions.

Requirements

  • 3+ years of experience in back-end development.
  • Commercial experience in software engineering with strong proficiency in Java; Scala is a plus.
  • Understanding of Apache Kafka architecture and internals.
  • Experience working with Apache Flink.
  • Experience with Schema Registry and schema evolution strategies.
  • Knowledge of serialization formats such as Avro and JSON.
  • Experience using SQL for processing large datasets.
  • Upper-intermediate or higher level of English.
  • Experience running Kafka and/or Flink on Kubernetes is a plus.
  • Familiarity with monitoring tools such as Prometheus and Grafana for streaming metrics is a plus.
  • Understanding of stream processing semantics is a plus.
  • Experience with CI/CD pipelines for streaming applications is a plus.

Benefits

  • Annual Benefits Cafeteria budget you can allocate to sports, medical, mental health, home office, or language learning.
  • Paid maternity/paternity leave plus a monthly childcare allowance.
  • 20+ vacation days, unlimited sick leave, and emergency time off.
  • Remote-first work model with tech support and coworking compensation.
  • Team events, including online, offline, and offsite gatherings.
  • Internal courses and growth programs to support learning and development.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Resident Home

Data Engineer

Resident Home 251-1K Specialty Retail

Ashley Digital is hiring a Data Engineer in Tel Aviv to build and evolve the data foundations supporting product, finance, operations, and business teams across its global e-commerce portfolio.

Israel Mid Level Data Engineer
Apache Airflow AWS Azure CI/CD dbt GCP SQL
40 minutes ago
Tripadvisor

Data Engineer II

Tripadvisor 1K-5K Consumer Services

Tripadvisor is hiring a Data Engineer II to build and maintain the data platform infrastructure that powers analytics, experimentation, and data-driven initiatives across its global travel products.

Canada Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS BERT CI/CD CSS Flink GCP Generative AI Gradle GraphQL Hadoop Hive HTML Java JavaScript Kafka Linux Machine Learning PostgreSQL Python React REST API Snowflake SQL
55 minutes ago
Capco

Dataiku Developer – Data Analytics & Reporting

Capco 5K-10K Internet Software & Services

Capco, a Wipro company, is hiring a Data Warehousing specialist to design and operationalize end-to-end analytics solutions for the BNP Paribas group’s Data Analytics & Reporting team.

India Full-time Senior Data Engineer
Agile Apache Airflow Apache Spark CI/CD Confluence Docker Elasticsearch GitLab JIRA Kafka Kibana Kubernetes Pandas PostgreSQL Python SQL SQLAlchemy Tableau Teradata
1 hour, 10 minutes ago
Mindrift.ai: Be the “I” in AI

Senior Python Data Scraping Engineer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a Senior Python Data Scraping Engineer for a part-time remote Tendem project to build and quality-check end-to-end web data extraction workflows within a hybrid AI + human system.

Poland Part-time Senior Backend Engineer Data Engineer
Up to $83k
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
1 hour, 10 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers