RemoteLeaf Logo
Log in Sign up

Senior, ML Engineer - VLM

2 months ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
Apache Spark AWS Computer Vision Databricks Deep Learning Docker GitHub Actions LLM MLflow OpenGL Pandas Python PyTorch Terraform Three.js
Apply Now
Torc

Torc

Torc Robotics is a leading provider of unmanned and autonomous ground vehicle technology, specializing in self-driving trucks for various industries. Founded in 2005, Torc has a history of innovation, including winning the 2007 DARPA Urban Challenge an...

Road & Rail
251-1K
Founded 2007
$37M raised
View All Jobs 13

Description

  • Own and evolve the offline dataset pipeline that converts logged multi-sensor data into VLM/VLA training datasets.
  • Design, implement, test, and deploy cloud-based data pipelines for geometric, semantic, scenario-level, and action-grounded annotations.
  • Develop VLM-assisted auto-labeling workflows such as open-vocabulary detection, dense captioning, and scene description generation.
  • Produce reasoning-grounded labels aligned to ego-motion and trajectories to support VLA training and explainable behavior.
  • Mine rare, difficult, and high-uncertainty driving scenarios and curate datasets that improve downstream model performance.
  • Define dataset schemas, quality metrics, and validation processes, and route model failures back into relabeling and retraining loops.
  • Partner with VLM/VLA model developers to co-define dataset specifications, quality standards, and delivery cadence.
  • Build distributed, reproducible pipelines on cloud infrastructure using columnar data formats and distributed compute.
  • Serve as project lead, mentor less-experienced engineers, run design reviews, and set coding and annotation standards.
  • Track advances in multimodal models, auto-labeling, and end-to-end autonomous driving, and translate relevant research into production systems.

Requirements

  • Bachelor’s degree in Computer Science, Robotics, Electrical Engineering, or a related technical field with 6+ years of experience, or a Master’s degree in a related technical field with 3+ years of experience.
  • Strong proficiency in computer vision and deep learning, including model training and at least two of: 2D/3D object detection, tracking, sensor fusion, semantic segmentation, BEV, or depth estimation.
  • Hands-on experience with multimodal or vision-language models, including open-vocabulary or zero-shot recognition, dense captioning, or semantic embeddings/search applied to perception data.
  • Experience building targeted datasets that measurably improve downstream model performance, including large-scale Parquet data processing with tools such as Databricks, Daft, or Pandas.
  • Experience with distributed ML and data frameworks such as PyTorch, Lightning, Ray, or Spark.
  • Experience with scaled MLOps and tooling, including experiment tracking, model registries, MLflow or Weights & Biases, and ML evaluation/quality metrics.
  • Strong Python software development skills and experience with VDI or cloud-based development environments, GitHub Actions, and Docker.
  • Ability to work with minimal supervision, exercise independent judgment, and own technical solutions across team interfaces.
  • Preferred experience with end-to-end or VLA driving models, trajectory and action grounding, or chain-of-causation datasets.
  • Preferred experience with auto-labeling foundation models, high-throughput model serving such as vLLM or SGLang, semantic retrieval/vector databases, AV data standards, cloud orchestration, visualization tools, or research/publication experience.

Benefits

  • Competitive compensation package with bonus and stock options.
  • 100% paid medical, dental, and vision premiums for full-time employees.
  • 401(k) plan with a 6% employer match.
  • Flexible schedule with generous paid vacation available immediately after the start date.
  • Company-wide holiday office closures.
  • AD&D and life insurance.
  • Potential sign-on payment, relocation support, and other forms of compensation depending on the position.
  • A full range of medical, financial, and other benefits.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Point

Technical Lead Manager

Point 251-1K Real Estate

Point is hiring a Technical Lead Manager to lead a senior engineering team building production-scale AI agents for homeowner customer experiences across voice, email, chat, and SMS.

United States Full-time Lead Engineering Manager Machine Learning Engineer
$187k-$259k
System Design
6 hours, 26 minutes ago
Fullscript

Senior Machine Learning Engineer

Fullscript 251-1K Health Care Providers & Services

Fullscript is hiring a Senior Machine Learning Engineer for its AI & Analytics Engineering team to build and deploy reliable AI experiences for lab interpretation, clinical decision support, and practitioner workflows.

Canada Full-time Senior Machine Learning Engineer
$104k-$118k
CI/CD Elixir Generative AI Git Hugging Face Machine Learning Python SQL
6 hours, 40 minutes ago
MUTT DATA

AI Backend Engineer (Python) — Forward Deployed

MUTT DATA 51-250 Internet Software & Services

Muttdata is seeking a forward-deployed AI Backend Engineer to embed with a banking client’s AI platform team, build and productionize LLM-based agents, and improve the platform through successive team rotations.

Argentina Full-time Mid Level Backend Engineer Machine Learning Engineer
AWS Azure CI/CD dbt Deep Learning Docker FastAPI GCP Generative AI JWT Kubernetes Machine Learning Microservices Python REST API Secrets Management Terraform
6 hours, 40 minutes ago
Y

Machine Learning Engineer

Yuno 51-200 Payment Processing Software

Yuno is hiring a Europe-based Machine Learning Engineer to build and scale the MLOps, streaming, and agentic infrastructure that moves payment-focused machine learning systems from research into reliable production.

Europe Full-time Senior Machine Learning Engineer
Apache Airflow AWS CI/CD Databricks Docker Kafka Kubeflow Kubernetes LLM Machine Learning MLflow MLOps Vertex AI
6 hours, 41 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers