RemoteLeaf Logo
Log in Sign up

Senior, ML Engineer - VLM

2 months, 3 weeks ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
Apache Spark AWS Computer Vision Databricks Deep Learning Docker GitHub Actions LLM MLflow OpenGL Pandas Python PyTorch Terraform Three.js
Apply Now
Torc

Torc

Torc Robotics is a leading provider of unmanned and autonomous ground vehicle technology, specializing in self-driving trucks for various industries. Founded in 2005, Torc has a history of innovation, including winning the 2007 DARPA Urban Challenge an...

Road & Rail
251-1K
Founded 2007
$37M raised
View All Jobs 13

Description

  • Own and evolve the offline dataset pipeline that converts logged multi-sensor data into VLM/VLA training datasets.
  • Design, implement, test, and deploy cloud-based data pipelines for geometric, semantic, scenario-level, and action-grounded annotations.
  • Develop VLM-assisted auto-labeling workflows such as open-vocabulary detection, dense captioning, and scene description generation.
  • Produce reasoning-grounded labels aligned to ego-motion and trajectories to support VLA training and explainable behavior.
  • Mine rare, difficult, and high-uncertainty driving scenarios and curate datasets that improve downstream model performance.
  • Define dataset schemas, quality metrics, and validation processes, and route model failures back into relabeling and retraining loops.
  • Partner with VLM/VLA model developers to co-define dataset specifications, quality standards, and delivery cadence.
  • Build distributed, reproducible pipelines on cloud infrastructure using columnar data formats and distributed compute.
  • Serve as project lead, mentor less-experienced engineers, run design reviews, and set coding and annotation standards.
  • Track advances in multimodal models, auto-labeling, and end-to-end autonomous driving, and translate relevant research into production systems.

Requirements

  • Bachelor’s degree in Computer Science, Robotics, Electrical Engineering, or a related technical field with 6+ years of experience, or a Master’s degree in a related technical field with 3+ years of experience.
  • Strong proficiency in computer vision and deep learning, including model training and at least two of: 2D/3D object detection, tracking, sensor fusion, semantic segmentation, BEV, or depth estimation.
  • Hands-on experience with multimodal or vision-language models, including open-vocabulary or zero-shot recognition, dense captioning, or semantic embeddings/search applied to perception data.
  • Experience building targeted datasets that measurably improve downstream model performance, including large-scale Parquet data processing with tools such as Databricks, Daft, or Pandas.
  • Experience with distributed ML and data frameworks such as PyTorch, Lightning, Ray, or Spark.
  • Experience with scaled MLOps and tooling, including experiment tracking, model registries, MLflow or Weights & Biases, and ML evaluation/quality metrics.
  • Strong Python software development skills and experience with VDI or cloud-based development environments, GitHub Actions, and Docker.
  • Ability to work with minimal supervision, exercise independent judgment, and own technical solutions across team interfaces.
  • Preferred experience with end-to-end or VLA driving models, trajectory and action grounding, or chain-of-causation datasets.
  • Preferred experience with auto-labeling foundation models, high-throughput model serving such as vLLM or SGLang, semantic retrieval/vector databases, AV data standards, cloud orchestration, visualization tools, or research/publication experience.

Benefits

  • Competitive compensation package with bonus and stock options.
  • 100% paid medical, dental, and vision premiums for full-time employees.
  • 401(k) plan with a 6% employer match.
  • Flexible schedule with generous paid vacation available immediately after the start date.
  • Company-wide holiday office closures.
  • AD&D and life insurance.
  • Potential sign-on payment, relocation support, and other forms of compensation depending on the position.
  • A full range of medical, financial, and other benefits.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Roadpass

Senior AI/ML Engineer (REMOTE)

Roadpass 51-250 Hotels, Restaurants & Leisure

Roadpass Digital is seeking a remote Senior AI/ML Engineer in the United States to build and scale intelligent, product-driven solutions across its Roadtrippers and Campendium travel platforms.

United States Full-time Senior Machine Learning Engineer
Agile AWS Feature Engineering Machine Learning Python SQL
22 hours, 29 minutes ago
Babylist

Staff Machine Learning Engineer

Babylist 251-1K Internet Software & Services

Babylist is hiring a Staff Machine Learning Engineer to define and build personalization systems across its registry, commerce, health, search, and AI products used by millions of families.

Canada Full-time Lead Machine Learning Engineer
$221k-$276k
Apache Airflow AWS CI/CD CRM Datadog dbt Deep Learning GitHub Actions Kotlin Kubernetes Linear Machine Learning MLflow MySQL Pandas Python PyTorch React Ruby on Rails SageMaker Scikit-learn Shopify Sidekiq Snowflake Swift System Design Terraform TypeScript XGBoost
1 day, 21 hours ago
Babylist

Staff Machine Learning Engineer

Babylist 251-1K Internet Software & Services

Babylist is hiring a Staff Machine Learning Engineer to lead personalization across feeds, recommendations, search, and AI products used by millions of families.

United States Canada Full-time Lead Machine Learning Engineer
$234k-$291k
Apache Airflow AWS CI/CD CRM Datadog dbt Deep Learning GitHub Actions Kotlin Kubernetes Linear Machine Learning MLflow MLOps MySQL Pandas Python PyTorch React Ruby Ruby on Rails Scikit-learn Shopify Sidekiq Snowflake Swift System Design Terraform TypeScript XGBoost
1 day, 21 hours ago
Reddit

Staff Machine Learning Engineer, Ads Creative Effectiveness

Reddit 1K-5K Internet Software & Services

Reddit is hiring a Staff engineer for its Ads Creative Effectiveness team to build GenAI and predictive products that generate, edit, optimize, and safeguard high-performing ad creative.

United States Full-time Lead Machine Learning Engineer
$230k-$322k
Generative AI Machine Learning Neural Networks
1 day, 21 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers