RemoteLeaf Logo
Log in Sign up

Sr. Engineering Manager, AI Runtime

14 hours, 39 minutes ago
United States
Full-time
Lead
Engineering Manager
Software Development
Apache Spark Deep Learning LLM MLflow PyTorch
Apply Now
Databricks

Databricks

Databricks is the pioneering data intelligence platform, empowering organizations worldwide to solve complex data challenges with AI-driven analytics solutions.

IT Services
1K-5K
Founded 2013
$4450M raised
View All Jobs 239

Description

  • Lead, mentor, and grow the engineering team responsible for Custom Training and its foundational infrastructure.
  • Own the product and technical roadmap for AI Runtime, balancing customer experience, functionality, and infrastructure investment.
  • Collaborate with product, research, platform, infrastructure teams, and customers to drive delivery from ideation through launch and operations.
  • Drive architectural decisions and product design for managed GPU training at scale.
  • Advocate for customer needs through direct engagement and ensure engineering decisions create clear product impact.
  • Build observability and reliability practices for long-running, multi-node training jobs, including checkpointing, failure recovery, and operational runbooks.
  • Partner with recruiting to attract, hire, and develop engineering talent.

Requirements

  • 8+ years of software engineering experience, including 3+ years in engineering management.
  • Track record building and operating managed GPU training infrastructure at scale across hundreds or thousands of GPUs.
  • Deep familiarity with distributed training frameworks such as PyTorch, DeepSpeed, Composer, and Megatron-LM.
  • Experience with parallelism strategies such as FSDP and tensor/pipeline parallelism.
  • Experience with training resilience patterns including checkpointing, elastic training, and automated failure recovery.
  • Understanding of GPU performance fundamentals, including NCCL, interconnect topologies, and memory optimization.
  • Experience building platform products with clear SLAs and ownership of the customer experience, not just the backend.
  • Strong cross-functional leadership across platform, product, and research teams, with the ability to lead through ambiguity and deliver complex projects.
  • Excellent collaboration and communication skills across engineering, product, and research organizations.
  • BS/MS in Computer Science, Electrical Engineering, or a related technical field.

Benefits

  • Local pay range of $228,600 to $297,120 USD.
  • Eligibility for annual performance bonus.
  • Eligibility for equity as part of total compensation.
  • Comprehensive benefits and perks package.
  • Compensation based on job-related skills, depth of experience, relevant certifications and training, and work location.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Intersog

Engineering Manager (Landing Page Builder Group)

Intersog 51-250 Internet Software & Services

An established Canadian SaaS company is hiring an Engineering Manager to lead the Landing Page Builder team as it executes a transition toward an AI-first product organization.

Canada Full-time Lead Engineering Manager
Agile CI/CD Scrum
14 hours, 24 minutes ago
LiveData,

DevOps Engineering Manager

LiveData, 11-50 Health Care Providers & Services

LiveData is hiring a remote DevOps Engineering Manager to lead a small team and own infrastructure, deployment, operations, and reliability for cloud-based surgical software used by hospitals.

United States Full-time Lead DevOps Engineer Engineering Manager
$125k-$175k
API Gateway AWS AWS CDK Bash CI/CD GitHub GitHub Actions Linux PostgreSQL Python REST API Secrets Management Serverless Shell Scripting Terraform
1 day, 14 hours ago
Rush Street Interactive

Manager, Software Engineering

Rush Street Interactive 251-1K Hotels, Restaurants & Leisure

Rush Street Interactive is hiring a Manager, Software Engineering to lead a product team delivering high-quality gaming services and maintaining team performance, delivery quality, and morale.

Colombia Full-time Lead Engineering Manager
Agile Confluence JIRA
1 day, 14 hours ago
Lone Wolf Technologies

Forms Manager

Lone Wolf Technologies 251-1K Internet Software & Services

Forms Manager at a real estate technology company leading operations work to improve transaction management platforms used by brokerage clients every day.

United States Full-time Mid Level Engineering Manager
2 days, 14 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers