Staff Software Engineer - Serverless

4 months ago
Full-time
Lead
Software Development
RUNWARE

RUNWARE

RUNWARE provides an affordable API that enables AI developers to efficiently run image, video, and custom generative AI models without the need for extensive infrastructure or machine learning expertise.

Internet Software & Services
1-10
Founded 2023

Description

  • Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation, and scaling.
  • Design a simple SDK-based experience that lets developers deploy models and run AI workloads without managing infrastructure.
  • Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries, and failure handling.
  • Work with infrastructure and ML teams to improve startup time, GPU utilization, model warm-up, caching, and placement.
  • Build observability tools that make serverless workloads easy to monitor, debug, and operate globally at scale.
  • Lead technical design for a new product area and help define engineering standards.
  • Mentor other engineers and provide technical leadership across the team.
  • Collaborate closely with senior leadership to bring the new product line to market.

Requirements

  • Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer, or similar.
  • Experience building backend services, distributed systems, developer platforms, or workload orchestration systems.
  • Strong understanding of async processing, queues, scheduling, retries, back pressure, and failure handling.
  • Comfort working across APIs, control planes, workers, databases, and observability systems.
  • Strong engineering fundamentals in one or more backend languages such as Python, Go, or similar.
  • Good judgment around trade-offs between reliability, latency, scale, cost, and developer experience.
  • Clear communication, strong ownership, and the ability to lead technical direction in a fast-moving environment.
  • Experience building serverless platforms, job execution systems, container platforms, or compute orchestration systems is a nice to have.
  • Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing, or high-performance compute is a nice to have.
  • Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad, or Knative is a nice to have.
  • Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing, or queue management is a nice to have.
  • Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting, or usage-based billing is a nice to have.

Benefits

  • Remote-first setup with the ability to work from home anywhere the company can employ you.
  • Flexible hours with core collaboration blocks and control over your schedule outside them.
  • Generous paid time off, including vacation, sick days, and public holidays.
  • Meaningful stock options that let you share in the upside you help create.
  • Paid family leave for maternity, paternity, and caregiver time.
  • Company retreats twice a year in inspiring locations.
  • Built-in downtime after major release pushes to rest and recharge.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Platform Engineer

Natera 1K-5K Pharmaceuticals

Natera is hiring a Senior Platform Engineer to build and operate an Internal Developer Portal and infrastructure provisioning golden paths that improve developer self-service and adoption across its regulated healthcare technology environment.

AWS CI/CD Kubernetes PostgreSQL React Secrets Management Terraform TypeScript
9 hours, 8 minutes ago

Senior Engineering Manager - Platform

TRAILD 11-50 Internet Software & Services

Traild is seeking a Senior Engineering Manager to lead its Platform Engineering team, shaping the cloud infrastructure and developer platforms that support the company’s globally scaling finance automation products.

CI/CD
9 hours, 38 minutes ago

Senior C# / .NET Developer

Margo Bank Professional Services

Senior developer role in a six-person technology unit supporting a global Retail Media company, focused on designing and building a Core User Platform and partner APIs from the ground up.

C# .NET
9 hours, 38 minutes ago

Senior Backend Engineer

Megaport 251-1K Diversified Telecommunication Services

Megaport is hiring a Senior Software Engineer to evolve its global Network as a Service platform by developing backend services, modernizing core systems, and guiding technical improvements.

CI/CD Hibernate Java Kotlin REST API SQL
9 hours, 38 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers