Staff Software Engineer - Serverless

3 weeks ago
Full-time
Lead
Software Development
RUNWARE

RUNWARE

RUNWARE provides an affordable API that enables AI developers to efficiently run image, video, and custom generative AI models without the need for extensive infrastructure or machine learning expertise.

Internet Software & Services
1-10
Founded 2023

Description

  • Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation, and scaling.
  • Design a simple SDK-based experience that lets developers deploy models and run AI workloads without managing infrastructure.
  • Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries, and failure handling.
  • Work with infrastructure and ML teams to improve startup time, GPU utilization, model warm-up, caching, and placement.
  • Build observability tools that make serverless workloads easy to monitor, debug, and operate globally at scale.
  • Lead technical design for a new product area and help define engineering standards.
  • Mentor other engineers and provide technical leadership across the team.
  • Collaborate closely with senior leadership to bring the new product line to market.

Requirements

  • Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer, or similar.
  • Experience building backend services, distributed systems, developer platforms, or workload orchestration systems.
  • Strong understanding of async processing, queues, scheduling, retries, back pressure, and failure handling.
  • Comfort working across APIs, control planes, workers, databases, and observability systems.
  • Strong engineering fundamentals in one or more backend languages such as Python, Go, or similar.
  • Good judgment around trade-offs between reliability, latency, scale, cost, and developer experience.
  • Clear communication, strong ownership, and the ability to lead technical direction in a fast-moving environment.
  • Experience building serverless platforms, job execution systems, container platforms, or compute orchestration systems is a nice to have.
  • Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing, or high-performance compute is a nice to have.
  • Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad, or Knative is a nice to have.
  • Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing, or queue management is a nice to have.
  • Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting, or usage-based billing is a nice to have.

Benefits

  • Remote-first setup with the ability to work from home anywhere the company can employ you.
  • Flexible hours with core collaboration blocks and control over your schedule outside them.
  • Generous paid time off, including vacation, sick days, and public holidays.
  • Meaningful stock options that let you share in the upside you help create.
  • Paid family leave for maternity, paternity, and caregiver time.
  • Company retreats twice a year in inspiring locations.
  • Built-in downtime after major release pushes to rest and recharge.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Backend Engineer - Platform - Stacks | UK | Remote

Grafana 1K-5K IT Services

Grafana Labs is hiring a Backend Engineer for its Platform Stacks team to build and operate the systems that create, configure, reconcile, and manage Grafana Cloud stacks across regions and services.

AWS Azure Flux GCP Go Grafana Helm Kubernetes Microservices Node.js Terraform TypeScript
1 hour, 47 minutes ago

Senior Backend Engineer (Elixir)

Remote 251-1K Professional Services

Remote is hiring a full-time engineer to help build tools, APIs, and integrations for its global HR and Payroll products in a fully remote, async environment.

Angular AWS CI/CD Docker Elixir GitHub GitLab Jenkins Kubernetes Next.js Phoenix PostgreSQL React Vue.js
2 hours, 26 minutes ago

Senior Backend Engineer - Grafana Search & Storage | Spain | Remote

Grafana 1K-5K IT Services

Grafana Labs is hiring a Senior Backend Engineer to help build and operate its next-generation search and storage platform for Grafana Cloud and related products.

Go Grafana Kubernetes Prometheus
2 hours, 55 minutes ago

Software Engineer II - Model Platform

Abnormal AI Internet Software & Services

Abnormal AI is hiring a Software Backend Engineer II to join its Detection Team and build the Model Platform infrastructure that supports ML and Data Science work on advanced email and cloud attack detection.

AWS Azure Django GCP Go Kubernetes Machine Learning OWASP PostgreSQL Python
3 hours, 12 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers