Avo

Avo is the leading data quality platform for product analytics, helping teams like Adobe, Rappi, and Fender ensure data accuracy and build exceptional user experiences. With features like customizable alerts, schema management, and peer reviews, Avo st...

Internet Software & Services

Information Technology

11-50 (30)

Founded 2018

$4M raised

2 open positions

Links

View All Jobs

Medical Director, AI Safety

3 hours, 42 minutes ago

United States

Full-time

Senior

AI (Artificial Intelligence)

Artificial Intelligence and Machine Learning

Apply Now

Avo

Internet Software & Services

11-50

Founded 2018

$4M raised

View All Jobs 2

Description

Define safety standards for each clinical AI product, including hallucinations, omissions, material errors, and severity levels.
Design and run evaluations for hallucinations, omissions, accuracy, and alignment with source records and evidence-based guidelines.
Build and maintain a clinical harm taxonomy and NCC MERP-style grading rubric.
Review AI-generated clinical content and assess the reliability of automated graders.
Own release decisions by preparing go/no-go safety assessments for new modules and major prompt or model changes.
Investigate customer-reported clinical errors, identify root causes, and drive fixes with Studio and engineering teams.
Prepare safety reports, validation summaries, and white papers for customers and clinical governance committees.
Monitor FDA, ONC, CHAI, and Joint Commission standards and translate them into internal requirements.
Build and revise clinical modules in Avo’s Studio using clinical guidelines and practice experience.
Present Avo’s safety program and validation methods to CMIOs, CIOs, clinical quality leaders, and prospects.

Requirements

Active clinical license as an MD, DO, NP, or PA with hands-on patient care experience.
3–7 years of clinical practice experience.
Experience with or strong interest in clinical AI, clinical decision support, or health informatics.
Ability to design evaluation rubrics, analyze edge cases, and identify clinically significant errors.
Ability to write clear, defensible safety reports for clinical governance committees.
Comfort presenting to C-suite clinical leaders and discussing AI failure modes.
Willingness to help define the role’s scope as the company and product grow.
Willingness to travel up to 10% for customer meetings and demonstrations.
Experience with EHR systems such as Epic, Meditech, or Athena preferred.
Background in clinical informatics, quality improvement, patient safety, sales engineering, solutions, or customer-facing clinical work preferred.
Familiarity with AI or LLM evaluation methodologies preferred.

Benefits

Remote-first work from anywhere in the United States; NYC-area employees may work in the office two days per week.
Flexible and generous PTO.
Medical, dental, and vision coverage for employees and families.
401(k) contribution matching.
Tax-free personal device allowance.
$175,000–$200,000 OTE plus equity.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior AI QA Automation Engineer

Coforge 10K-50K IT Services

Coforge is seeking a remote Senior AI QA Automation Engineer in Costa Rica, Peru, Colombia, or Bolivia to build automated testing and evaluation systems that ensure the quality, reliability, and safety of AI agents, RAG solutions, prompts, and workflows.

Bolivia Colombia Costa Rica Peru Full-time Senior AI (Artificial Intelligence) SDET (Software Development Engineer in Test)

CI/CD Playwright Python Selenium

3 hours, 11 minutes ago

Apply

3 hours, 11 minutes ago

Senior AI QA Automation Engineer

Coforge 10K-50K IT Services

Coforge is hiring a remote Senior AI QA Automation Engineer in Costa Rica, Peru, Colombia, or Bolivia to build automated testing and evaluation systems that ensure the quality, reliability, and safety of AI agents, RAG solutions, prompts, and model outputs.