RemoteLeaf Logo
Log in Sign up

Researcher, Benchmark Reviews

12 hours, 44 minutes ago
Anywhere
Full-time
Mid Level
AI (Artificial Intelligence)
Data Science and Analytics
Machine Learning
Apply Now
Epoch AI

Epoch AI

Epoch is a research institute focused on exploring critical trends and questions that influence the development and governance of artificial intelligence, providing valuable insights into its societal implications.

Professional Services
1-10
Founded 2022
View All Jobs 7

Description

  • Review a new AI benchmark at least every two weeks and assess its methodology.
  • Evaluate what strong performance on a benchmark implies about AI capabilities.
  • Write public-facing research reports on new benchmarks.
  • Update published reports as benchmark versions change and models improve.
  • Examine individual tasks within benchmarks in detail.
  • Use coding agents to assist with analysis while maintaining independent judgment.
  • Identify issues, strengths, and weaknesses in benchmark design and evaluation methods.
  • Contribute to a steady stream of benchmark critiques and reviews.

Requirements

  • Strong written communication with publication-quality first drafts and minimal revision needed.
  • Strong critical thinking about research methodologies and benchmark evaluation.
  • Familiarity with existing AI benchmarks, including their methodologies, strengths, and weaknesses.
  • Ability to break down and analyze dense data and complex benchmark task structures.
  • Comfort using coding agents as assistants without delegating judgment.
  • Professional-level English proficiency.
  • Ability to submit application materials in English.
  • Preferred: experience writing about AI/ML for a public or research audience.
  • Preferred: hands-on experience running or building AI evaluations.
  • Preferred: ability to overlap with US and UK time zones.

Benefits

  • Annual salary of $100,000 to $200,000 USD, depending on location, seniority, and experience.
  • Salaries may be paid in local currencies rather than USD, with conversions based on one-year average exchange rates.
  • Fully remote work environment with flexible work hours.
  • Comprehensive global benefits, including health insurance, supplemental local benefits where available, life insurance, and a pension plan where applicable.
  • Generous PTO, including 30 protected PTO days per year, unlimited personal and sick leave, and 4 months of paid parental leave for eligible permanent staff.
  • Flexible expense policy for equipment, productivity tools, and learning/development opportunities, including unlimited spending on AI tools subject to approval.
  • Paid work trips, including three staff retreats per year and relevant conferences.
  • Access to well-equipped Berkeley offices with paid meals, snacks, gym access, and at least 20 office days per year for all staff.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Weekday

CUDA Engineering Expert

Weekday 11-50 Construction & Engineering

A client-facing contract role for a GPU kernel optimization specialist working with a leading AI lab to evaluate, analyze, and improve kernel performance across modern hardware environments.

United States Contract Junior AI Engineer Research Scientist
$166k-$208k
C++ Git Python
11 hours, 59 minutes ago
Ottimate

MBA Internship - GTM Analytics & AI Strategy

Ottimate IT Services

Ottimate is seeking a part-time MBA or graduate intern in Mexico to work with GTM leadership on AI- and data-driven initiatives that improve business performance tracking, analysis, and forecasting.

Mexico Part-time Entry Level AI (Artificial Intelligence) Data Analyst
$42k-$42k
CRM Generative AI LLM Pandas Power BI Python SQL Tableau
12 hours, 14 minutes ago
Mindrift.ai: Be the “I” in AI

Compliance Analyst - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking project-based compliance and regulatory contributors to test, evaluate, and improve AI systems by documenting regulation-based cases and verified citations for financial and legal compliance scenarios.

Lebanon Turkey Armenia Israel Jordan Part-time Junior AI (Artificial Intelligence) Compliance Manager
Up to $104k
12 hours, 14 minutes ago
Fullstack Academy

Part Time Instructor - Fullstack AI

Fullstack Academy 11-50 Diversified Consumer Services

Fullstack Academy is hiring a part-time online instructor for its Fullstack AI program to teach adult learners, support their progress, and connect modern full stack and AI concepts to real-world application development.

United States Part-time Senior AI (Artificial Intelligence) Teacher
$104k-$125k
Agile Angular AWS Azure CI/CD CSS Django Express.js Flask GCP Generative AI Git HTML JavaScript MongoDB Node.js Python React REST API
12 hours, 14 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers