Platform Data Engineer

3 months, 2 weeks ago
Full-time
Senior
DevOps and Infrastructure
RUNWARE

RUNWARE

RUNWARE provides an affordable API that enables AI developers to efficiently run image, video, and custom generative AI models without the need for extensive infrastructure or machine learning expertise.

Internet Software & Services
1-10
Founded 2023

Description

  • Design, build, and maintain schemas, data models, and data infrastructure for high-volume system data.
  • Optimize table layout, partitioning, indexing, and compression for large-scale datasets.
  • Maintain ingestion pipelines handling logs, metrics, requests, traces, and events at billion-record scale.
  • Build robust ETL/ELT pipelines that transform raw data into analytics-ready structures.
  • Support deep log and performance analysis, including latency, throughput, errors, and bottlenecks.
  • Provide the raw data foundation for end-to-end inference-time monitoring and production debugging.
  • Integrate data pipelines with observability and monitoring tools such as Prometheus, Grafana, Datadog, and OpenTelemetry.
  • Automate ingestion, cleanup, and related data operations.
  • Collaborate with DevOps, ML, backend engineering, and the Data Expert to deliver usable data interfaces and dashboards.
  • Contribute to debugging, root cause analysis, and performance optimization efforts.

Requirements

  • Solid experience as a Data Engineer or in a similar production role.
  • Strong understanding of data pipelines, streaming and batch processing, and data modeling.
  • Experience working with analytical databases; ClickHouse is a plus but not required.
  • Comfortable analyzing logs, metrics, and platform data to understand system behavior.
  • Familiarity with event-based systems, monitoring, and observability concepts.
  • Pragmatic focus on usefulness, reliability, and performance.
  • Comfort working cross-functionally with backend, infrastructure, and data teams.
  • Startup or scale-up experience is a plus.
  • Experience with high-throughput or real-time systems is a plus.
  • Exposure to cost monitoring, performance analytics, or platform observability is a plus.
  • Background in AI, ML platforms, or data-heavy products is a plus.
  • Must have existing right to work in the UK; visa sponsorship is not available in the UK.

Benefits

  • Remote-first setup with the ability to work from home anywhere the company can employ you.
  • Flexible hours outside core collaboration blocks.
  • Generous paid time off, including vacation, sick days, and public holidays.
  • Meaningful stock options.
  • Paid family leave, including maternity, paternity, and caregiver time.
  • Twice-yearly company retreats in inspiring locations.
  • Built-in downtime after big release pushes to rest and recharge.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

JSON SQL Server
19 hours, 26 minutes ago

Senior Software Engineer - Storage Engine - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is seeking a Senior Software Engineer for the globally distributed Elasticsearch Storage Engine team to improve core storage and query technologies for observability workloads.

CI/CD Elasticsearch GitHub Java MongoDB PostgreSQL Prometheus Solr
1 day, 18 hours ago

Senior Software Developer - Storage Engine - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Senior Software Engineer for its globally distributed Elasticsearch Storage Engine team to improve core storage and query technologies for observability workloads.

CI/CD Elasticsearch GitHub Java MongoDB PostgreSQL Prometheus Solr
1 day, 18 hours ago

Principal Software Developer - Storage Engine - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Principal Software Developer for its globally distributed Elasticsearch Storage Engine team to shape the core storage and query engine for observability workloads.

CI/CD Elasticsearch GitHub Java MongoDB PostgreSQL Prometheus Solr
1 day, 19 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers