Clinical AI Quality Specialist

18 hours, 41 minutes ago
Full-time
Mid Level
Artificial Intelligence and Machine Learning
Hello Heart

Hello Heart

Hello Heart is a digital therapeutics company specializing in heart disease management through a Cardiovascular Digital Health Program. Their app empowers users to improve heart health with AI and behavioral science, reducing risks and promoting health...

Internet Software & Services
1-10
Founded 2013
$138M raised

Description

  • Run offline evaluations for clinically relevant Nia changes, including writing test cases and scoring outputs against expected clinical behavior.
  • Build and maintain clinical evaluation datasets and contribute to scoring methods.
  • Review sampled production conversations and help prepare weekly and monthly quality-review results.
  • Test Nia’s handling of high-risk situations, including medical emergencies, self-harm, and medication safety.
  • Measure inappropriate over-escalation and under-escalation of high-risk situations.
  • Document clinical failures, identify likely causes, and create actionable findings for product and engineering.
  • Ensure unsafe or incorrect findings have an owner, ticket, and documented decision.
  • Maintain auditable clinical specifications, review records, and supporting evidence.

Requirements

  • PharmD or equivalent clinical doctorate with an active U.S. license.
  • 3+ years of combined clinical practice and clinical AI evaluation experience.
  • Experience designing or running evaluations for LLM-based systems and reviewing production conversations.
  • Experience with AI monitoring tools such as Langfuse.
  • Knowledge of triage and escalation, crisis and self-harm handling, and medication safety under current guidelines.
  • Ability to research and cite current guidelines, drug labels, and primary sources in clinical assessments.
  • Ability to verify AI-generated output against reliable source material.
  • Strong written and verbal communication skills for explaining clinical risk to engineering and product teams.
  • Clinical experience in cardiovascular care or hypertension management (preferred).
  • Experience with structured clinical-transcript ratings, inter-rater agreement, or crisis and self-harm review (preferred).

Benefits

  • Base salary of $130,000–$143,000 per year.
  • Annual bonus eligibility.
  • Collaborative, diverse, and supportive work culture.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Trainer - Software Engineering (Remote, Full-Time) [MV001]

Smart Working Internet Software & Services

Smart Working is hiring a remote Technical AI Trainer to build and deliver practical internal training that helps software engineers apply AI across development, QA, and DevOps.

CI/CD Playwright
18 hours, 11 minutes ago

AI Artist

Magnopus 201-500 Media

Magnopus is hiring a freelance AI Artist to remotely create cinematic, photorealistic generative image and video content for an audience-focused storytelling project.

After Effects Generative AI Photoshop Unreal Engine
18 hours, 41 minutes ago

Prompt Qualtity Reviewers for Uzbek

Welo Global Professional Services

Welo Global is seeking a senior linguist reviewer to quality-assure native-language reasoning prompts for AI training, ensuring each item is accurate, complete, and appropriately challenging.

NLP
18 hours, 41 minutes ago

Andromeda MU - Image Quality Rater - India (Remote)

Welo Global Professional Services

Freelance AI Image Reviewer for a remote India-based project evaluating AI-generated product images against catalog references to make consistent keep-or-discard decisions.

E-commerce
18 hours, 41 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers