Senior Staff Machine Learning Engineer, LLM/VLM Model Architecture & Optimization

22 hours, 40 minutes ago
Full-time
Senior
Software Development

Waymo

Waymo is an autonomous driving technology company building the Waymo Driver and operating Waymo One, its fully autonomous ride-hailing service.

Autonomous vehicles, robotics, AI, ride-hailing / mobility tech
Founded 2009
$21600M raised

Description

  • Design VLM and LLM model architectures and align them with hardware architectures.
  • Optimize model performance for on-device inference in memory-, power-, and compute-constrained environments.
  • Collaborate with research, software engineering, hardware engineering, and product teams to deliver end-to-end solutions.
  • Work on perception systems that learn spatial-temporal representations and semantic understanding of the vehicle’s surrounding environment.
  • Develop methods for learning continuously from large-scale real-world driving data.
  • Develop and train models at scale using diverse sensor data.
  • Analyze real-world behavior and build systems that handle the complexity of real-world interactions.
  • Optimize models for onboard and offboard hardware.

Requirements

  • 7+ years of experience in machine learning, with a focus on large-scale model development such as LLMs, VLMs, or similar foundation models.
  • Proven expertise in low-latency on-device inference techniques and hardware acceleration.
  • Extensive experience with deep learning frameworks such as PyTorch or JAX.
  • Experience with large-scale model training.
  • Ability to operate effectively under ambiguity and set direction amid rapidly evolving research and technical constraints.
  • Experience applying large language models or foundation models in safety-critical domains such as autonomy, robotics, or other high-reliability systems.
  • Master’s degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
  • Familiarity with large-scale data curation and quality assurance for multimodal datasets, preferred.
  • Background in autonomous vehicle perception, motion planning, or decision-making systems, preferred.
  • Publications in top-tier machine learning or computer vision conferences such as NeurIPS, ICML, CVPR, ICCV, or ECCV, preferred.
  • PhD in a relevant field, preferred.

Benefits

  • Base salary range of $298,000 to $368,000 USD.
  • Eligibility for Waymo’s discretionary annual bonus program.
  • Eligibility for Waymo’s equity incentive plan.
  • Access to Waymo’s generous company benefits program, subject to eligibility requirements.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Machine Learning Engineer, Risk Modeling

Block 10K-50K Capital Markets

Block is hiring Senior and Staff Machine Learning Engineers for its Risk Machine Learning organization to develop large-scale fraud, abuse, and risk detection systems across Cash App and Square.

Apache Airflow Apache Spark AWS CI/CD Deep Learning GCP Keras LLM Machine Learning MLflow Mode MySQL NLP NumPy Pandas Prefect Python PyTorch Reinforcement Learning Scikit-learn Snowflake Tableau TensorFlow Vertex AI XGBoost
22 hours, 55 minutes ago

Principal Software Engineer - Vector Search - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Principal Software Engineer for its globally distributed Elasticsearch Search team to advance vector similarity search capabilities and improve the search experience at scale.

Cassandra CI/CD Elasticsearch Git GitHub Java Lucene MongoDB PostgreSQL
23 hours, 10 minutes ago

Senior ML Infrastructure Engineer

Orion Innovation 1K-5K IT Services

Orion Innovation is seeking a Senior ML Infrastructure Engineer to build and operate a large-scale document intelligence platform on Azure that combines GPU-based Kubernetes infrastructure with applied machine learning model serving.

Active Directory Azure BERT Docker Helm Kubernetes Python PyTorch Terraform
23 hours, 25 minutes ago

FBS Ops Engineer Manager

Capgemini 100K+ Internet Software & Services

Capgemini is seeking an ML Ops Engineering Manager to lead the architecture, implementation, and evolution of machine learning operations for a major U.S. insurer’s enterprise-scale production environment.

AWS CI/CD Machine Learning MLOps Python SageMaker
23 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers