RemoteLeaf Logo
Log in Sign up

Senior Manager, Forward Deployed Research

2 weeks, 2 days ago
United States
Full-time
Lead
AI Research Scientist
Artificial Intelligence and Machine Learning
LLM Machine Learning
Apply Now
Snorkel AI

Snorkel AI

Snorkel AI offers a data-centric AI platform, Snorkel Flow, with programmatic labeling to build accurate and adaptable AI applications quickly, trusted by top organizations for mission-critical deployments.

IT Services
51-250
Founded 2019
$135M raised
View All Jobs 5

Description

  • Own the system for measuring what Snorkel’s data does, including benchmarking and model-tuning workflows and the related tooling and automation.
  • Recruit, hire, and develop a small team of engineers and researchers while staying hands-on as a player-coach.
  • Define and maintain the methodology and playbook for benchmarking and tuning, including model panels, metrics, tuning setups, and quality standards.
  • Turn benchmark results into clear gap analyses that show where models fall short and inform the company’s data pitch and product roadmap.
  • Tune customer and open-source models on Snorkel’s data to demonstrate performance lift and create presales material.
  • Partner with GTM, Research, and Engineering to support deal progression, research collaboration, and platform/tooling development.
  • Serve as the technical authority on evaluation and handle complex or high-stakes benchmarking work.
  • Ensure published pass rates and model comparisons are rigorous, credible, repeatable, and defensible across accounts and data series.

Requirements

  • 8+ years of experience in applied ML, model evaluation, or research-intensive engineering.
  • Strong software engineering skills with experience building scalable data or evaluation pipelines, automation, and tooling.
  • Deep understanding of model evaluation and benchmarking, including designing evaluations and selecting model panels and metrics.
  • Strong fluency in frontier AI concepts, including LLMs, evaluation methodologies, and post-training techniques such as RLHF, DPO, and RLAIF.
  • Experience with domain areas such as coding agents, reasoning, multimodal models, or RL environments.
  • Experience leading, hiring, and developing technical talent in a player-coach role.
  • Ability to translate technical results into clear insights for technical and go-to-market audiences.
  • Ability to work in a fast-moving environment with ambiguity and rapid iteration.
  • M.S. in Computer Science, Machine Learning, or a related field.

Benefits

  • Base salary range of $185,000–$321,600 depending on location, experience, and qualifications.
  • Eligible for variable compensation.
  • Eligible for stock grants.
  • Hybrid work options in New York City, Redwood City, and San Francisco, or remote work in the U.S.
  • Meaningful opportunities to shape priorities, initiatives, and strategic decisions.
  • Career growth support for technical development, leadership, and cross-functional learning.
  • Reasonable accommodation provided for applicants and employees with disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Unlock Health

Manager, Managed Care

Unlock Health 1-10 Health Care Providers & Services

Unlock Health is hiring a managed care consulting leader to guide healthcare clients through complex contract, reimbursement, and communication challenges.

United States Full-time Senior Business Analyst Program Manager
7 hours, 54 minutes ago
Apex IT

Oracle PPM

Apex IT 251-1K Internet Software & Services

Apex IT is seeking a remote team member to support enterprise consulting work that improves customer, employee, and student experiences across Salesforce and Oracle solutions.

United States Full-time Mid Level Program Manager
CRM Oracle Salesforce
8 hours, 9 minutes ago
Topstep

Sr. Trading Platform Operations Specialist

Topstep 51-250 Capital Markets

Topstep is hiring a Sr. Trading Platform Operations Specialist to strengthen Trading Platform operations by running release coordination, operational programs, reporting, documentation, and automation across engineering, product, support, and operations.

United States Full-time Senior Operations Specialist Program Manager
$140k-$165k
JIRA
8 hours, 24 minutes ago
Coforge

Senior Agile Delivery Manager

Coforge 10K-50K IT Services

Coforge busca un Senior Agile Delivery Manager para un proyecto con Scotiabank en Perú, responsable de asegurar la entrega de software en equipos multidisciplinarios bajo principios ágiles.

Peru Senior Program Manager Scrum Master
Agile Scrum
8 hours, 24 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers