RemoteLeaf Logo
Log in Sign up

Senior Manager, Forward Deployed Research

33 minutes ago
United States
Full-time
Lead
AI Research Scientist
Artificial Intelligence and Machine Learning
LLM Machine Learning
Apply Now
Snorkel AI

Snorkel AI

Snorkel AI offers a data-centric AI platform, Snorkel Flow, with programmatic labeling to build accurate and adaptable AI applications quickly, trusted by top organizations for mission-critical deployments.

IT Services
51-250
Founded 2019
$135M raised
View All Jobs 3

Description

  • Own the system for measuring what Snorkel’s data does, including benchmarking and model-tuning workflows and the related tooling and automation.
  • Recruit, hire, and develop a small team of engineers and researchers while staying hands-on as a player-coach.
  • Define and maintain the methodology and playbook for benchmarking and tuning, including model panels, metrics, tuning setups, and quality standards.
  • Turn benchmark results into clear gap analyses that show where models fall short and inform the company’s data pitch and product roadmap.
  • Tune customer and open-source models on Snorkel’s data to demonstrate performance lift and create presales material.
  • Partner with GTM, Research, and Engineering to support deal progression, research collaboration, and platform/tooling development.
  • Serve as the technical authority on evaluation and handle complex or high-stakes benchmarking work.
  • Ensure published pass rates and model comparisons are rigorous, credible, repeatable, and defensible across accounts and data series.

Requirements

  • 8+ years of experience in applied ML, model evaluation, or research-intensive engineering.
  • Strong software engineering skills with experience building scalable data or evaluation pipelines, automation, and tooling.
  • Deep understanding of model evaluation and benchmarking, including designing evaluations and selecting model panels and metrics.
  • Strong fluency in frontier AI concepts, including LLMs, evaluation methodologies, and post-training techniques such as RLHF, DPO, and RLAIF.
  • Experience with domain areas such as coding agents, reasoning, multimodal models, or RL environments.
  • Experience leading, hiring, and developing technical talent in a player-coach role.
  • Ability to translate technical results into clear insights for technical and go-to-market audiences.
  • Ability to work in a fast-moving environment with ambiguity and rapid iteration.
  • M.S. in Computer Science, Machine Learning, or a related field.

Benefits

  • Base salary range of $185,000–$321,600 depending on location, experience, and qualifications.
  • Eligible for variable compensation.
  • Eligible for stock grants.
  • Hybrid work options in New York City, Redwood City, and San Francisco, or remote work in the U.S.
  • Meaningful opportunities to shape priorities, initiatives, and strategic decisions.
  • Career growth support for technical development, leadership, and cross-functional learning.
  • Reasonable accommodation provided for applicants and employees with disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

City of Fort Worth

Strategic Initiatives Manager

City of Fort Worth 1K-5K Specialized Consumer Services

The City of Fort Worth is hiring a Strategic Initiatives Manager to lead citywide performance management, strategic initiatives, and business strategy for its Analytics & Intelligence division.

United States Full-time Senior Business Analyst Program Manager
$102k-$133k
Power BI Python SQL
3 minutes ago
Reddit

Machine Learning Manager, Feed Relevance (Retrieval)

Reddit 1K-5K Internet Software & Services

Reddit is hiring an Engineering Manager to lead the Feed Retrieval team, building machine learning systems that power personalized feed recommendations for over 120 million daily users.

United States Full-time Lead Machine Learning Engineer Program Manager
$253k-$355k
Machine Learning
18 minutes ago
ClinChoice

Senior Manager, System Operations

ClinChoice 1K-5K Professional Services

The company is seeking a Corporate System Project Specialist to lead ERP operations and drive system enhancements, process improvement, and training across global teams.

Philippines Senior Operations Manager Program Manager
ERP Microsoft Dynamics 365
18 minutes ago
Nebius

Technical Program Manager - Compute Systems Engineering

Nebius 51-250 Internet Software & Services

Nebius is seeking a Technical Program Manager to coordinate and improve complex infrastructure programs across its Compute Systems Engineering organization and broader cloud ecosystem.

Netherlands United Kingdom Europe Full-time Senior Program Manager
18 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers