AI Project Reviewer (CONTRACT)

2 months ago
Freelance
Senior
Education and Training
MasterClass

MasterClass

MasterClass offers premium online courses taught by world-renowned instructors in arts, entertainment, business, and sports, providing unlimited access to high-quality video lessons and immersive learning experiences.

Media
251-1K
Founded 2014
$461M raised

Description

  • Review learner projects against detailed rubrics and determine pass/fail outcomes.
  • Write clear, actionable feedback to help learners improve.
  • Collaborate with learning design and product teams to refine rubrics and assessment criteria.
  • Compare human and AI assessment results to identify calibration gaps.
  • Document the reasoning behind evaluation decisions to support consistency.
  • Maintain high standards while making nuanced evaluation judgments.
  • Work independently and manage time effectively across roughly 20 hours per week.

Requirements

  • 5+ years of experience in assessment, evaluation, or educational feedback roles.
  • Proven ability to apply detailed rubrics consistently across multiple submissions.
  • Strong written communication skills with the ability to explain reasoning clearly.
  • Experience providing constructive feedback that supports learner growth.
  • Ability to work independently while maintaining high standards.
  • Willingness to refrain from using AI during evaluations and written rationales.
  • Experience as a mentor, coach, educational evaluator, teaching assistant, consultant in AI or learning design, or instructor with grading/feedback experience.
  • Passion for education and helping learners succeed.
  • Attention to detail and comfort with nuanced judgments.
  • Curiosity and openness to learning more about AI-driven evaluation methods.

Benefits

  • Hourly range of $75-$125 USD.
  • Temporary freelance engagement with flexible scheduling.
  • Approximately 20 hours per week.
  • Equal opportunity workplace with reasonable accommodations for qualified individuals with disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Instructional Designer - Community Workforce

AlphaHire Professional Services

AlphaGov is engaging a project-based Instructional Designer to create accessible workforce training for public-sector partners, helping adult learners complete programs and gain employer-recognized skills.

13 hours, 11 minutes ago

Math Assessment Content Creator, ES 3 - 5 (24 month Fixed Term)

Khan Academy 51-250 Diversified Consumer Services

Khan Academy is hiring a fixed-term Elementary Math Content Creator for its Assessments team to develop equitable, engaging K–12 math assessments aligned with learning standards.

4 days, 12 hours ago

Content Creator - Biology (Encyclopedia of Experiments)

JoVE 51-250 Media

JoVE is seeking a creative Content Creator to develop research-focused educational animated videos in Biological Sciences for scientists, researchers, and graduate students.

5 days, 13 hours ago

Director of Onboarding & Enablement (Remote)

ZipLiens 11-50 Specialized Consumer Services

Zipliens is hiring a founding Director of Onboarding & Enablement to build and own the end-to-end customer implementation experience and scalable training and content systems for its lien resolution platform serving personal injury law firms.

CRM Git HubSpot
6 days, 13 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers