RemoteLeaf Logo
Log in Sign up

Senior, ML Engineer - VLM

1 month, 1 week ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
Apache Spark AWS Computer Vision Databricks Deep Learning Docker GitHub Actions LLM MLflow OpenGL Pandas Python PyTorch Terraform Three.js
Apply Now
Torc

Torc

Torc Robotics is a leading provider of unmanned and autonomous ground vehicle technology, specializing in self-driving trucks for various industries. Founded in 2005, Torc has a history of innovation, including winning the 2007 DARPA Urban Challenge an...

Road & Rail
251-1K
Founded 2007
$37M raised
View All Jobs 10

Description

  • Own and evolve the offline dataset pipeline that converts logged multi-sensor data into VLM/VLA training datasets.
  • Design, implement, test, and deploy cloud-based data pipelines for geometric, semantic, scenario-level, and action-grounded annotations.
  • Develop VLM-assisted auto-labeling workflows such as open-vocabulary detection, dense captioning, and scene description generation.
  • Produce reasoning-grounded labels aligned to ego-motion and trajectories to support VLA training and explainable behavior.
  • Mine rare, difficult, and high-uncertainty driving scenarios and curate datasets that improve downstream model performance.
  • Define dataset schemas, quality metrics, and validation processes, and route model failures back into relabeling and retraining loops.
  • Partner with VLM/VLA model developers to co-define dataset specifications, quality standards, and delivery cadence.
  • Build distributed, reproducible pipelines on cloud infrastructure using columnar data formats and distributed compute.
  • Serve as project lead, mentor less-experienced engineers, run design reviews, and set coding and annotation standards.
  • Track advances in multimodal models, auto-labeling, and end-to-end autonomous driving, and translate relevant research into production systems.

Requirements

  • Bachelor’s degree in Computer Science, Robotics, Electrical Engineering, or a related technical field with 6+ years of experience, or a Master’s degree in a related technical field with 3+ years of experience.
  • Strong proficiency in computer vision and deep learning, including model training and at least two of: 2D/3D object detection, tracking, sensor fusion, semantic segmentation, BEV, or depth estimation.
  • Hands-on experience with multimodal or vision-language models, including open-vocabulary or zero-shot recognition, dense captioning, or semantic embeddings/search applied to perception data.
  • Experience building targeted datasets that measurably improve downstream model performance, including large-scale Parquet data processing with tools such as Databricks, Daft, or Pandas.
  • Experience with distributed ML and data frameworks such as PyTorch, Lightning, Ray, or Spark.
  • Experience with scaled MLOps and tooling, including experiment tracking, model registries, MLflow or Weights & Biases, and ML evaluation/quality metrics.
  • Strong Python software development skills and experience with VDI or cloud-based development environments, GitHub Actions, and Docker.
  • Ability to work with minimal supervision, exercise independent judgment, and own technical solutions across team interfaces.
  • Preferred experience with end-to-end or VLA driving models, trajectory and action grounding, or chain-of-causation datasets.
  • Preferred experience with auto-labeling foundation models, high-throughput model serving such as vLLM or SGLang, semantic retrieval/vector databases, AV data standards, cloud orchestration, visualization tools, or research/publication experience.

Benefits

  • Competitive compensation package with bonus and stock options.
  • 100% paid medical, dental, and vision premiums for full-time employees.
  • 401(k) plan with a 6% employer match.
  • Flexible schedule with generous paid vacation available immediately after the start date.
  • Company-wide holiday office closures.
  • AD&D and life insurance.
  • Potential sign-on payment, relocation support, and other forms of compensation depending on the position.
  • A full range of medical, financial, and other benefits.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Beacon Biosignals

Senior Algorithm Engineer

Beacon Biosignals 11-50 Biotechnology

Beacon Biosignals is hiring a Senior Algorithm and Machine Learning Engineer to develop and deploy biosignal and brain-data models for medical devices supporting sleep, neurological, and psychiatric care.

United States Full-time Senior Machine Learning Engineer
$170k-$190k
CI/CD Deep Learning Docker Git Machine Learning PyTorch Statistics
1 hour, 9 minutes ago
Federato

Staff Machine Learning Engineer

Federato 11-50 Insurance

Federato is hiring a Senior Machine Learning Engineer to help build AI-native systems that modernize insurance workflows across the full policy lifecycle.

Anywhere Full-time Lead Machine Learning Engineer
$210k-$250k
CI/CD LLM Machine Learning
1 day ago
FloVision Solutions

Machine Learning Engineer

FloVision Solutions 1-10 Internet Software & Services

FloVision is hiring a remote Machine Learning Engineer to develop computer vision and deep learning systems for its food supply chain platform, with a focus on production-ready models that improve QA, reduce waste, and support real-world industrial use.

United States Full-time Mid Level Machine Learning Engineer
$90k-$115k
AWS Azure Computer Vision Deep Learning Feature Engineering GCP Jupyter Machine Learning Matplotlib MLOps NumPy Pandas Python PyTorch SQL TensorFlow
1 day, 1 hour ago
Pinterest

Principal Engineer, Core - Pinner Journeys

Pinterest 5K-10K Internet Software & Services

Pinterest is hiring a Principal Engineer to lead technical strategy for Homefeed, Search, and AI Assistant experiences that improve discovery, relevance, and creator value at massive scale.

United States Full-time Lead Machine Learning Engineer Technical Lead
$243k-$450k
Generative AI LLM Machine Learning Prototyping Reinforcement Learning System Design
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers