RemoteLeaf Logo
Log in Sign up

Physician (MD/DO) - Medical AI Evaluation

1 hour, 28 minutes ago
United States
Part-time
Senior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 9

Description

  • Evaluate clinical EHR vignettes, proposed answers, and distractor answers across diagnosis and treatment scenarios.
  • Assess cases spanning cardiovascular, neurologic, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
  • Score vignette accuracy, completeness, answer correctness, gradeability, and distractor quality.
  • Verify that reasoning chains reach the correct answer using only the facts provided in each vignette.
  • Correct reasoning traces and write concise clinical rationales.
  • Participate in three independent blind reviews followed by physician adjudication.
  • Submit accepted tasks by project deadlines and according to specified quality criteria.

Requirements

  • MD or DO degree with an active, unrestricted US medical license verified by the issuing medical board.
  • Board certification or completed residency training; attending-level experience preferred.
  • Recent direct patient-care experience.
  • Broad, multisystem diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
  • Strong clinical reasoning skills, including differential diagnosis, next-step management, and evidence-based guidelines.
  • Strong written English proficiency at C1 level or higher.
  • Availability for approximately 10–20 hours per week during active project phases.
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA preferred.
  • Not suitable for medical students, unlicensed graduates, non-physician clinicians, or non-clinical healthcare professionals.

Benefits

  • Project-based, part-time engagement with flexible participation during active project phases.
  • Compensation paid per accepted task, with rates up to the equivalent of $100 per hour.
  • Opportunity to contribute to the evaluation and improvement of medical AI tools.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Ooma, Inc.

Affiliate Marketing & AI Discovery Consultant

Ooma, Inc. 1001-5000 telecommunications

Ooma is seeking an Affiliate Marketing & AI Discovery Consultant for a 4–6 month maternity-leave coverage engagement to manage its B2B affiliate program and improve visibility across traditional and AI-powered buyer discovery channels.

United States Contract Lead AI (Artificial Intelligence) Influencer Marketing
$120k-$144k
Affiliate Marketing Content Marketing
14 minutes ago
Celonis

Applied AI Value Architect

Celonis 1K-5K IT Services

Celonis is hiring an AI Applied Value Architect in Toronto to lead data- and AI-driven transformation programs for North American customers across finance, supply chain, and core business processes.

Canada Full-time Mid Level AI (Artificial Intelligence) Program Manager
$98k-$112k
Oracle Salesforce SAP
14 minutes ago
National Information Solutions Cooperative

Member Value Consultant - AI Assistant

National Information Solutions Cooperative 1K-5K Internet Software & Services

NISC is seeking a Member Value Consultant to help energy and communications cooperatives adopt and measure the value of its AI Assistant and agentic workflows through consulting, training, and change management.

Remote
Full-time Senior AI (Artificial Intelligence)
Generative AI
1 hour, 28 minutes ago
REIGN

AI-Native Chief of Staff

REIGN 1-10 Media

Reign is hiring an AI-native Chief of Staff to run the CEO’s operating system, drive cross-functional execution, and build agentic workflows that help its autonomous commerce platform scale.

United States Full-time Mid Level AI (Artificial Intelligence) Executive Assistant
CRM
1 hour, 28 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers