DRW

DRW

DRW is a diversified trading firm that leverages technology and risk management to identify and capture global trading and investment opportunities across a wide range of asset classes and markets.

Capital Markets
1K-5K
Founded 1992

Description

  • Deploy, maintain, and optimize GPU infrastructure for large-scale LLM inference workloads.
  • Provision, configure, and deploy GPU server fleets.
  • Architect and implement distributed serving solutions for multi-node, multi-GPU model deployments.
  • Manage GPU-enabled Kubernetes clusters for LLM and ML workloads.
  • Configure network infrastructure, including load balancers, firewalls, and inter-node communication for GPU clusters.
  • Implement and optimize storage solutions for model weights and inference caches.
  • Troubleshoot performance bottlenecks across hardware, drivers, networking, and the application layer.
  • Research and evaluate emerging GPU technologies, model serving frameworks, and infrastructure optimizations.
  • Collaborate with ML engineers to profile model performance and implement inference acceleration techniques.
  • Drive reliability improvements through monitoring, alerting, capacity planning, and incident response.

Requirements

  • Bachelor's or Master's degree in Computer Science, Systems Engineering, or a related field.
  • 5+ years of experience in DevOps, SRE, or infrastructure engineering roles.
  • Strong experience with GPU infrastructure, model serving frameworks such as vLLM or SGLang, and GPU driver management.
  • Hands-on experience optimizing deep learning workloads on GPU clusters for inference or training.
  • Deep Linux systems knowledge, including network configuration, storage optimization, and Kubernetes orchestration.
  • Experience with infrastructure-as-code tools such as Ansible or Terraform.
  • Strong understanding of distributed systems, networking protocols such as TCP/IP and HTTP/2, and load balancing.
  • Proficiency in Python and Bash scripting for automation.
  • Experience with monitoring and observability tools such as Prometheus and Grafana.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Engineering Manager - Machine Learning

Super Technologies Pvt Ltd 1-10 aviation & aerospace

Super Technologies is hiring a Senior Engineering Manager for Applied Machine Learning & Research to lead the development and delivery of machine learning systems for online gambling and sports betting experiences.

Apache Airflow Apache Spark AWS BERT Deep Learning Docker GPT Kubernetes Machine Learning MLflow Python PyTorch Snowflake TensorFlow
22 hours, 14 minutes ago

DevOps Engineer

KnowledgeCity 51-250 Internet Software & Services

DevOps Engineer at a company focused on building and maintaining software infrastructure and release systems for continuous delivery, operational reliability, and secure engineering workflows.

Ansible AWS CI/CD ClickHouse CloudFormation Docker EC2 ELK Stack Git Grafana Helm Kubernetes MySQL PHP PostgreSQL Prometheus Python Terraform WAF
22 hours, 14 minutes ago

DevOps Engineer II - Remote (U.S. Eastern Time Hours)

Diversified Services Network 51-250 Construction & Engineering

DSN is hiring a remote DevOps Engineer II to support a federal government engineering team delivering and operating mission-critical software systems.

Angular Ansible Azure Bash CI/CD CloudFormation Docker Git GitLab CI Java Jenkins Kubernetes PHP PowerShell Python Terraform
22 hours, 29 minutes ago

AI Developer

Awesome Motive 51-250 Internet Software & Services

Awesome Motive is hiring an AI-First Developer on its R&D team to build internal AI tools and data systems that turn large-scale behavioral and operational data into analytics, automation, and decision-support features used across the company.

Apache Spark AWS Azure Databricks Docker FastAPI Flask GCP Git GitHub Kubernetes Machine Learning MLflow MLOps Pandas PHP Python SageMaker SQL WordPress
22 hours, 44 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers