RUNWARE

RUNWARE

RUNWARE provides an affordable API that enables AI developers to efficiently run image, video, and custom generative AI models without the need for extensive infrastructure or machine learning expertise.

Internet Software & Services
1-10
Founded 2023

Description

  • Build and scale infrastructure for real-time AI inference across GPU fleets, bare-metal servers, and containerized production systems.
  • Help evolve the platform toward more elastic, on-demand infrastructure that can respond to customer traffic and model demand.
  • Improve the performance, reliability, and resilience of request entrypoints, inference services, queues, storage, load balancers, and networking.
  • Automate infrastructure operations, including provisioning, configuration, CI/CD, deployment safety, progressive rollouts, and rapid rollback.
  • Build and maintain the observability stack needed to detect issues early, understand capacity, and resolve problems before they affect customers.
  • Lead production operations, incident response, debugging, and post-incident improvements.
  • Strengthen infrastructure security and compliance through patching, secrets management, access controls, hardening, auditability, and documentation.

Requirements

  • Strong experience as a DevOps Engineer, SRE, Infrastructure Engineer, Platform Engineer, or in a similar role running production systems at scale.
  • Deep Linux knowledge and confidence debugging real production issues across networking, storage, performance, services, and system behavior.
  • Hands-on experience building automation, Infrastructure-as-Code, CI/CD pipelines, and deployment workflows.
  • Experience operating high-availability, low-latency, or high-throughput platforms where reliability and performance directly affect customers.
  • Strong networking fundamentals across TCP/IP, DNS, load balancing, routing, firewalls, proxies, TLS, and HTTP.
  • A calm and pragmatic approach under pressure, with strong communication, good judgment, and a bias toward automation over manual toil.
  • Experience operating GPU infrastructure for AI/ML inference, including NVIDIA drivers, CUDA, container runtimes, GPU monitoring, capacity planning, and workload isolation (bonus).
  • Familiarity with inference serving and optimization frameworks such as vLLM, TensorRT, Triton, or similar (bonus).

Benefits

  • Remote-first work environment with the option to work from home anywhere they can employ you.
  • Flexible hours outside core collaboration blocks.
  • Generous paid time off, including vacation, sick days, and public holidays.
  • Meaningful stock options.
  • Paid family leave, including maternity, paternity, and caregiver time.
  • Twice-yearly company retreats in inspiring locations.
  • Built-in downtime after major release cycles to unplug and recharge.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

DevOps Engineer

Cloudbeds 251-1K Internet Software & Services

Cloudbeds is hiring a remote DevOps Engineer in the USA to build and operate AWS and Kubernetes infrastructure supporting its global hospitality platform.

Argo CD AWS Bash CI/CD Datadog Docker GitHub Actions GitOps Grafana Helm Kubernetes Load Balancing Memcached MySQL Nginx OpenTelemetry PostgreSQL Prometheus Python Redis Terraform
10 hours, 4 minutes ago

R&D DevSecOps Engineer

Rackner 11-50 Internet Software & Services

Rackner is seeking a remote Software/AI Developer and DevSecOps Engineer to build secure mission applications, AI-enabled development tools, and controlled software-delivery pipelines for U.S. government and defense customers.

Argo CD AWS Azure CI/CD Cybersecurity DevSecOps Docker FastAPI Generative AI Git GitHub Actions GitLab CI Helm Kubernetes PostgreSQL Prefect Python Terraform
1 day, 8 hours ago

DevOps Lead (FedRAMP)

Orca Security 251-1K Internet Software & Services

Orca Security is seeking a remote, US-based DevOps Lead (FedRAMP) to own and engineer its federal cloud environments, authorization program, and agency relationships while automating continuous compliance.

AWS Azure CI/CD GCP Helm Kubernetes Python Secrets Management Terraform
1 day, 9 hours ago

DevOps Engineer - Contract

Lingaro 5K-10K IT Services

DevOps Engineer for a 12-month remote contract in India, responsible for building and operating an Azure-based monitoring and operations platform that improves system reliability, data quality, observability, and cost management.

Azure CI/CD Databricks Grafana Kafka Kubernetes Power BI Prometheus Python Shell Scripting
1 day, 9 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers