RUNWARE

RUNWARE

RUNWARE provides an affordable API that enables AI developers to efficiently run image, video, and custom generative AI models without the need for extensive infrastructure or machine learning expertise.

Internet Software & Services
1-10
Founded 2023

Description

  • Build and scale infrastructure for real-time AI inference across GPU fleets, bare-metal servers, and containerized production systems.
  • Help evolve the platform toward more elastic, on-demand infrastructure that can respond to customer traffic and model demand.
  • Improve the performance, reliability, and resilience of request entrypoints, inference services, queues, storage, load balancers, and networking.
  • Automate infrastructure operations, including provisioning, configuration, CI/CD, deployment safety, progressive rollouts, and rapid rollback.
  • Build and maintain the observability stack needed to detect issues early, understand capacity, and resolve problems before they affect customers.
  • Lead production operations, incident response, debugging, and post-incident improvements.
  • Strengthen infrastructure security and compliance through patching, secrets management, access controls, hardening, auditability, and documentation.

Requirements

  • Strong experience as a DevOps Engineer, SRE, Infrastructure Engineer, Platform Engineer, or in a similar role running production systems at scale.
  • Deep Linux knowledge and confidence debugging real production issues across networking, storage, performance, services, and system behavior.
  • Hands-on experience building automation, Infrastructure-as-Code, CI/CD pipelines, and deployment workflows.
  • Experience operating high-availability, low-latency, or high-throughput platforms where reliability and performance directly affect customers.
  • Strong networking fundamentals across TCP/IP, DNS, load balancing, routing, firewalls, proxies, TLS, and HTTP.
  • A calm and pragmatic approach under pressure, with strong communication, good judgment, and a bias toward automation over manual toil.
  • Experience operating GPU infrastructure for AI/ML inference, including NVIDIA drivers, CUDA, container runtimes, GPU monitoring, capacity planning, and workload isolation (bonus).
  • Familiarity with inference serving and optimization frameworks such as vLLM, TensorRT, Triton, or similar (bonus).

Benefits

  • Remote-first work environment with the option to work from home anywhere they can employ you.
  • Flexible hours outside core collaboration blocks.
  • Generous paid time off, including vacation, sick days, and public holidays.
  • Meaningful stock options.
  • Paid family leave, including maternity, paternity, and caregiver time.
  • Twice-yearly company retreats in inspiring locations.
  • Built-in downtime after major release cycles to unplug and recharge.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer - Messaging

Reddit 1K-5K Internet Software & Services

Reddit’s Messaging Infra team is hiring a Senior Software Engineer to scale and operate the distributed messaging systems that support communication across the company’s products.

C++ Go Java Kafka Kubernetes Python
10 hours, 8 minutes ago

Middle DevOps Engineer

United Tech 51-250 Internet Software & Services

Middle DevOps Engineer at a live-streaming platform, where you will support high-load, real-time infrastructure for a global product and help improve reliability, scalability, and efficiency.

AWS EC2 Firebase Flux GCP Grafana Helm Kafka Kubernetes Node.js Terraform
2 days, 10 hours ago

Senior Software Engineer - CI/CD

ZoomInfo 1K-5K Professional Services

ZoomInfo is hiring a Platform Engineer to own and improve the company’s CI/CD and developer tooling platforms across Kubernetes, GitHub Actions, ArgoCD, and Jenkins.

Argo CD AWS Datadog Docker GCP GitHub Actions GitOps Go Groovy Helm Jenkins Kubernetes LLM Node.js PagerDuty Python Terraform
2 days, 10 hours ago

Senior Datadog Security & Observability Engineer

Keeper Security 251-1K Professional Services

Keeper Security is hiring a Senior Datadog Engineer to support its DevOps and Security teams by scaling Datadog-driven detection engineering, SIEM operations, and observability across production and corporate environments.

AWS Datadog PowerShell Python SIEM Terraform
2 days, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers