RemoteLeaf Logo
Log in Sign up

Senior Manager, Forward Deployed Research

3 weeks, 3 days ago
United States
Full-time
Lead
AI Research Scientist
Artificial Intelligence and Machine Learning
LLM Machine Learning
Apply Now
Snorkel AI

Snorkel AI

Snorkel AI offers a data-centric AI platform, Snorkel Flow, with programmatic labeling to build accurate and adaptable AI applications quickly, trusted by top organizations for mission-critical deployments.

IT Services
51-250
Founded 2019
$135M raised
View All Jobs 5

Description

  • Own the system for measuring what Snorkel’s data does, including benchmarking and model-tuning workflows and the related tooling and automation.
  • Recruit, hire, and develop a small team of engineers and researchers while staying hands-on as a player-coach.
  • Define and maintain the methodology and playbook for benchmarking and tuning, including model panels, metrics, tuning setups, and quality standards.
  • Turn benchmark results into clear gap analyses that show where models fall short and inform the company’s data pitch and product roadmap.
  • Tune customer and open-source models on Snorkel’s data to demonstrate performance lift and create presales material.
  • Partner with GTM, Research, and Engineering to support deal progression, research collaboration, and platform/tooling development.
  • Serve as the technical authority on evaluation and handle complex or high-stakes benchmarking work.
  • Ensure published pass rates and model comparisons are rigorous, credible, repeatable, and defensible across accounts and data series.

Requirements

  • 8+ years of experience in applied ML, model evaluation, or research-intensive engineering.
  • Strong software engineering skills with experience building scalable data or evaluation pipelines, automation, and tooling.
  • Deep understanding of model evaluation and benchmarking, including designing evaluations and selecting model panels and metrics.
  • Strong fluency in frontier AI concepts, including LLMs, evaluation methodologies, and post-training techniques such as RLHF, DPO, and RLAIF.
  • Experience with domain areas such as coding agents, reasoning, multimodal models, or RL environments.
  • Experience leading, hiring, and developing technical talent in a player-coach role.
  • Ability to translate technical results into clear insights for technical and go-to-market audiences.
  • Ability to work in a fast-moving environment with ambiguity and rapid iteration.
  • M.S. in Computer Science, Machine Learning, or a related field.

Benefits

  • Base salary range of $185,000–$321,600 depending on location, experience, and qualifications.
  • Eligible for variable compensation.
  • Eligible for stock grants.
  • Hybrid work options in New York City, Redwood City, and San Francisco, or remote work in the U.S.
  • Meaningful opportunities to shape priorities, initiatives, and strategic decisions.
  • Career growth support for technical development, leadership, and cross-functional learning.
  • Reasonable accommodation provided for applicants and employees with disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

EnergySolutions

Director of Solar Outreach and Market Strategy (Remote -Illinois, US)

EnergySolutions 1K-5K Professional Services

Energy Solutions is hiring a Director of Solar Outreach and Market Strategy to lead an Illinois solar incentive program within its Distributed Energy Resources team.

United States Full-time Lead Marketing Strategist Program Manager
$145k-$180k
2 hours, 45 minutes ago
BlueLabs Analytics

Polling Manager

BlueLabs Analytics 51-250 Internet Software & Services

BlueLabs is hiring a Polling Manager to run survey polling operations that support client analysis, messaging, and decision-making.

United States Full-time Junior Program Manager
$85k-$85k
Python R SQL Statistics
3 hours ago
Scopely

Senior Producer - WWE Champions

Scopely 1K-5K Internet Software & Services

Scopely is seeking a remote Senior Producer in the US or Canada to drive execution and live-service production for WWE Champions.

United States Canada Full-time Senior Program Manager
JIRA
3 hours ago
Pie Insurance

Senior Operational Excellence Program Manager

Pie Insurance 251-1K Insurance

Pie Insurance is hiring a Senior Operational Excellence Manager to lead cross-functional operational improvement work across multiple business domains and turn process and systems changes into measurable, sustained business value.

United States Full-time Lead Program Manager
$100k-$125k
3 hours, 30 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers