Senior Staff Machine Learning Engineer, LLM/VLM Model Architecture & Optimization

3 weeks, 6 days ago
Full-time
Senior
Software Development

Waymo

Waymo is an autonomous driving technology company building the Waymo Driver and operating Waymo One, its fully autonomous ride-hailing service.

Autonomous vehicles, robotics, AI, ride-hailing / mobility tech
Founded 2009
$21600M raised

Description

  • Design VLM and LLM model architectures and align them with hardware architectures.
  • Optimize model performance for on-device inference in memory-, power-, and compute-constrained environments.
  • Collaborate with research, software engineering, hardware engineering, and product teams to deliver end-to-end solutions.
  • Work on perception systems that learn spatial-temporal representations and semantic understanding of the vehicle’s surrounding environment.
  • Develop methods for learning continuously from large-scale real-world driving data.
  • Develop and train models at scale using diverse sensor data.
  • Analyze real-world behavior and build systems that handle the complexity of real-world interactions.
  • Optimize models for onboard and offboard hardware.

Requirements

  • 7+ years of experience in machine learning, with a focus on large-scale model development such as LLMs, VLMs, or similar foundation models.
  • Proven expertise in low-latency on-device inference techniques and hardware acceleration.
  • Extensive experience with deep learning frameworks such as PyTorch or JAX.
  • Experience with large-scale model training.
  • Ability to operate effectively under ambiguity and set direction amid rapidly evolving research and technical constraints.
  • Experience applying large language models or foundation models in safety-critical domains such as autonomy, robotics, or other high-reliability systems.
  • Master’s degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
  • Familiarity with large-scale data curation and quality assurance for multimodal datasets, preferred.
  • Background in autonomous vehicle perception, motion planning, or decision-making systems, preferred.
  • Publications in top-tier machine learning or computer vision conferences such as NeurIPS, ICML, CVPR, ICCV, or ECCV, preferred.
  • PhD in a relevant field, preferred.

Benefits

  • Base salary range of $298,000 to $368,000 USD.
  • Eligibility for Waymo’s discretionary annual bonus program.
  • Eligibility for Waymo’s equity incentive plan.
  • Access to Waymo’s generous company benefits program, subject to eligibility requirements.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

ML Infrastructure Engineer

x.ai 51-250 Internet Software & Services

SpaceXAI is hiring an ML Infrastructure Engineer to build and optimize the machine learning platform that powers recommendations on X.

Ansible C++ Linux Puppet Python PyTorch Rust
15 hours ago

Senior Machine Learning Engineer, Safety

Reddit 1K-5K Internet Software & Services

Reddit is hiring a remote-friendly Machine Learning Engineer to build and improve safety systems that support enforcement of Reddit rules using large language models.

Deep Learning LLM Machine Learning NLP Python PyTorch TensorFlow
15 hours, 30 minutes ago

Senior, Machine Learning Engineer - 3D Perception

Torc 251-1K Road & Rail

Torc is hiring a Senior Machine Learning Engineer – 3D Perception to develop and deploy production perception models for autonomous trucks and improve Bird's Eye View understanding across its autonomy stack.

C++ Computer Vision Deep Learning Machine Learning Python PyTorch
15 hours, 45 minutes ago

Applied AI Engineer

Unframe Inc. 51-200 Technology, Information and Internet

Unframe is hiring an Applied AI Engineer to work with enterprise customers and internal teams on deploying AI-driven solutions that connect business problems to production systems.

Machine Learning Python React TypeScript
1 day, 14 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers