RemoteLeaf Logo
Log in Sign up

Staff Software Engineer, GPU Infrastructure Lifecycle Management

3 hours, 38 minutes ago
United States
Full-time
Lead
Software Engineer
Software Development
Ansible AWS CI/CD Go Kafka Kubernetes NATS Python Rust
Apply Now
Together

Together

Together AI provides the fastest and most cost-efficient tools for building generative AI models, with a dedicated team of experts to support users in training their own models and advancing AI technology.

IT Services
1-10
$20M raised
View All Jobs 6

Description

  • Design and implement the provisioning state machine for physical hosts across discovery, bring-up, health validation, and decommissioning.
  • Build declarative self-service APIs and control-plane workflows for requesting, scaling, and tearing down inference clusters.
  • Automate node health detection, safe draining, repair or replacement, and restoration of capacity.
  • Implement reliable provisioning logic with idempotency, retries, rollback, and drift detection.
  • Partner with the inference and ML platform teams to model cluster topology, interconnect, and scheduling constraints.
  • Write strongly typed, tested, versioned production code and deliver it through CI/CD.
  • Operate and support the software in production as an owned product.
  • Design and build software that turns bare metal into functioning AI clusters for training or inference.

Requirements

  • Strong software engineering experience in Go, Python, Rust, or a similar language.
  • Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent.
  • Experience building control planes, orchestration systems, or reconciliation loops such as Kubernetes controllers/operators.
  • Experience with event-driven systems using message queues, event streams, or pub/sub such as Kafka, NATS, or SQS.
  • A product mindset and experience building internal platforms or APIs used by other engineering teams.
  • Exposure to bare-metal provisioning technologies such as PXE/iPXE, Redfish/IPMI, or BMC is preferred.
  • Networking fundamentals such as VLANs, BGP, or fabric design are preferred.
  • Experience with GPU cluster software stacks such as NCCL, CUDA, or InfiniBand/RoCE is preferred.
  • Prior work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure organization is preferred.
  • Systems programming experience in Rust or Go is preferred.

Benefits

  • Competitive compensation with startup equity.
  • US base salary range of $240,000-$280,000.
  • Health insurance and other competitive benefits.
  • Equal opportunity employer with inclusive hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sand Technologies

Senior Software Engineer

Sand Technologies Internet Software & Services

Sand Technologies is hiring a Senior Software Engineer to build an AI-enabled situational awareness and decision-support platform for UK utility clients on Microsoft Azure.

South Africa Full-time Senior Software Engineer
Azure CI/CD Django IoT JavaScript .NET Node.js Python React SQL TypeScript
3 hours, 38 minutes ago
Appian

Senior Technical Consultant

Appian 1K-5K Internet Software & Services

Appian is hiring a Senior Consultant for Customer Success to post-sale implement custom software and AI solutions on its platform for commercial clients.

United States Full-time Senior Implementation Consultant Software Engineer
$100k-$200k
Agile AWS CI/CD GCP Machine Learning REST API SOAP SQL
3 hours, 38 minutes ago
Morgan & Morgan

Senior Software Engineer

Morgan & Morgan 1K-5K Specialized Consumer Services

Morgan & Morgan is hiring a Senior Software Engineer to help advance its legal technology platform and improve the client and attorney experience.

United States Full-time Senior Software Engineer
$210k-$220k
Agile Angular C# CSS Django Express.js HTML Java JavaScript MongoDB MySQL .NET NLP Node.js PHP PostgreSQL Python React REST API Ruby Ruby on Rails Salesforce Salesforce Apex Salesforce Lightning Spring SQL Server Vue.js
3 hours, 38 minutes ago
Workato

Principal Software Engineer, GO & Rust (Engine)

Workato 251-1K IT Services

Workato is seeking a System Architect to lead the design and evolution of its cloud platform architecture for secure, scalable, and cost-efficient enterprise orchestration.

Serbia Full-time Lead Software Engineer
Apache Spark AWS Azure C++ CI/CD Docker Flink GCP Go gRPC HashiCorp Vault HIPAA Java JWT Kafka Kubernetes Microservices OpenID Connect PostgreSQL Python Redis Ruby Rust Terraform WebSockets
3 hours, 38 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers