RemoteLeaf Logo
Log in Sign up

Senior, ML Engineer - VLM

3 weeks, 1 day ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
Apache Spark AWS Computer Vision Databricks Deep Learning Docker GitHub Actions LLM MLflow OpenGL Pandas Python PyTorch Terraform Three.js
Apply Now
Torc

Torc

Torc Robotics is a leading provider of unmanned and autonomous ground vehicle technology, specializing in self-driving trucks for various industries. Founded in 2005, Torc has a history of innovation, including winning the 2007 DARPA Urban Challenge an...

Road & Rail
251-1K
Founded 2007
$37M raised
View All Jobs 15

Description

  • Own and evolve the offline dataset pipeline that converts logged multi-sensor data into VLM/VLA training datasets.
  • Design, implement, test, and deploy cloud-based data pipelines for geometric, semantic, scenario-level, and action-grounded annotations.
  • Develop VLM-assisted auto-labeling workflows such as open-vocabulary detection, dense captioning, and scene description generation.
  • Produce reasoning-grounded labels aligned to ego-motion and trajectories to support VLA training and explainable behavior.
  • Mine rare, difficult, and high-uncertainty driving scenarios and curate datasets that improve downstream model performance.
  • Define dataset schemas, quality metrics, and validation processes, and route model failures back into relabeling and retraining loops.
  • Partner with VLM/VLA model developers to co-define dataset specifications, quality standards, and delivery cadence.
  • Build distributed, reproducible pipelines on cloud infrastructure using columnar data formats and distributed compute.
  • Serve as project lead, mentor less-experienced engineers, run design reviews, and set coding and annotation standards.
  • Track advances in multimodal models, auto-labeling, and end-to-end autonomous driving, and translate relevant research into production systems.

Requirements

  • Bachelor’s degree in Computer Science, Robotics, Electrical Engineering, or a related technical field with 6+ years of experience, or a Master’s degree in a related technical field with 3+ years of experience.
  • Strong proficiency in computer vision and deep learning, including model training and at least two of: 2D/3D object detection, tracking, sensor fusion, semantic segmentation, BEV, or depth estimation.
  • Hands-on experience with multimodal or vision-language models, including open-vocabulary or zero-shot recognition, dense captioning, or semantic embeddings/search applied to perception data.
  • Experience building targeted datasets that measurably improve downstream model performance, including large-scale Parquet data processing with tools such as Databricks, Daft, or Pandas.
  • Experience with distributed ML and data frameworks such as PyTorch, Lightning, Ray, or Spark.
  • Experience with scaled MLOps and tooling, including experiment tracking, model registries, MLflow or Weights & Biases, and ML evaluation/quality metrics.
  • Strong Python software development skills and experience with VDI or cloud-based development environments, GitHub Actions, and Docker.
  • Ability to work with minimal supervision, exercise independent judgment, and own technical solutions across team interfaces.
  • Preferred experience with end-to-end or VLA driving models, trajectory and action grounding, or chain-of-causation datasets.
  • Preferred experience with auto-labeling foundation models, high-throughput model serving such as vLLM or SGLang, semantic retrieval/vector databases, AV data standards, cloud orchestration, visualization tools, or research/publication experience.

Benefits

  • Competitive compensation package with bonus and stock options.
  • 100% paid medical, dental, and vision premiums for full-time employees.
  • 401(k) plan with a 6% employer match.
  • Flexible schedule with generous paid vacation available immediately after the start date.
  • Company-wide holiday office closures.
  • AD&D and life insurance.
  • Potential sign-on payment, relocation support, and other forms of compensation depending on the position.
  • A full range of medical, financial, and other benefits.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Spotify

Staff Machine Learning Engineer, Personalization

Spotify Media

Spotify is hiring a Staff Machine Learning Engineer to advance personalized discovery and engagement for millions of listeners through its Home feed and Shortcuts experiences.

United States North America Full-time Lead Machine Learning Engineer
$227k-$325k
Apache Airflow GCP LLM Machine Learning Python PyTorch
33 minutes ago
Lightning AI

AI Platform Support Engineer (APAC)

Lightning AI 11-50 IT Services

Lightning AI is hiring an AI Platform Support Engineer to support APAC customers running production ML workloads on cloud, Kubernetes, and GPU infrastructure.

Philippines Full-time Senior Machine Learning Engineer Technical Support Engineer
Grafana Kubeflow Kubernetes Linux MLOps OpenTelemetry Prometheus Python PyTorch
23 hours, 33 minutes ago
DNSFilter

AI Operations Engineer

DNSFilter 51-250 IT Services

DNSFilter is hiring a fully remote AI Operations Engineer to build internal AI tools, agents, and integrations that help a fast-growing SaaS company operate more efficiently.

United States Full-time Mid Level AI Engineer Machine Learning Engineer
$130k-$145k
Cybersecurity JavaScript LLM Python REST API SQL TypeScript
23 hours, 48 minutes ago
Weekday

Machine Learning & NLP Expert

Weekday 11-50 Construction & Engineering

A client is hiring a part-time, fully remote Machine Learning & NLP Expert to help train, evaluate, and improve frontier AI models through high-quality task design and model assessment.

United States Part-time Senior AI Engineer Machine Learning Engineer
$166k-$229k
Feature Engineering LLM Machine Learning NLP Python PyTorch TensorFlow
23 hours, 48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers