Clinical Quality AI Specialist

2 hours, 3 minutes ago
Full-time
Senior
Artificial Intelligence and Machine Learning
Included Health

Included Health

Included Health is a healthcare company that provides cost-saving solutions for employers and health plans. They offer virtual care and navigation services, connecting millions with board-certified doctors and specialists for comprehensive and convenie...

Insurance
1K-5K
$106M raised

Description

  • Lead pre-deployment validation and ongoing monitoring of clinical AI and LLM tools.
  • Produce model cards and transparency documentation covering intended use, limitations, monitoring, and rollback.
  • Partner with data, engineering, product, security, compliance, legal, and care leaders on AI quality and governance.
  • Build evaluation datasets and gold standards, and run clinical red-teaming and prompt testing.
  • Refine prompts and guardrails and assess retrieval-augmented generation (RAG) fidelity.
  • Train clinicians to oversee AI tools, adjudicate exceptions, and follow SOPs, checklists, and escalation paths.
  • Stand up and administer clinical AI governance processes, including ethics, safety, regulatory, privacy, and change control.
  • Maintain governance artifacts such as charters, SOPs, decision logs, and audit-ready documentation.
  • Support clinical service-line quality assurance, URAC/NCQA activities, and standards/rubric management.
  • Lead or support event detection, root cause analyses, failure mode analyses, corrective actions, education, audits, and escalation handling.
  • Analyze clinical quality performance data and translate value-based care insights into care model and health plan improvements.
  • Conduct ongoing assessments of clinical services using continuous improvement and evidence-based methodologies.

Requirements

  • Active, unrestricted NP or PA license.
  • 5+ years of clinical practice experience.
  • 2+ years of experience in quality, patient safety, or clinical operations.
  • Experience reviewing LLM outputs, building evaluation datasets, red-teaming prompts, and assessing RAG.
  • Experience with quality improvement and patient safety methodologies such as PDSA, Lean/Six Sigma, RCA/RCA2, FMEA, and CAPA.
  • Working knowledge of URAC, NCQA, and CMS, with familiarity with HEDIS and MIPS.
  • Proven experience improving quality within value-based care models.
  • Experience partnering with analytics or data science teams and interpreting core performance metrics.
  • Strong documentation and stakeholder communication skills.
  • Preferred: proficiency with BI and analytics tools such as Tableau or Power BI, plus basic SQL and statistics.
  • Preferred: experience in virtual care, care navigation, and enterprise audits.
  • Remote-first role with limited travel of 10-15%.

Benefits

  • Base salary target range of $128,130 to $198,610 for PA/NP candidates, plus bonus, equity, and benefits.
  • Remote-first culture.
  • 401(k) savings plan through Fidelity.
  • Comprehensive medical, vision, and dental coverage, including disability insurance.
  • Paid Time Off (PTO) and Discretionary Time Off (DTO).
  • 12 weeks of 100% paid parental leave.
  • Family-building and compassionate leave, including fertility coverage and $25,000 for surrogacy/adoption support.
  • Work-from-home reimbursement to support home office setup and team collaboration.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Shape the Future of AI - Basque Talent Hub

Welocalize 1K-5K Professional Services

Welo Data, part of Welocalize, is seeking Basque-speaking contributors in Spain to join its global remote talent network for flexible AI data projects involving annotation, evaluation, and prompt creation.

LLM
4 minutes ago

Shape the Future of AI - Macedonian Talent Hub

Welocalize 1K-5K Professional Services

Welo Data, part of Welocalize, is building a global contributor network of Macedonian-language freelancers to support remote AI data projects in annotation, evaluation, and prompt creation.

LLM NLP
4 minutes ago

Danish Content AI Evaluator

RWS Group 5K-10K Internet Software & Services

RWS’s TrainAI team is hiring a remote temporary/contract Danish Content AI Evaluator in Copenhagen to review and assess AI-generated content and source attribution for quality and accuracy.

Generative AI
4 minutes ago

Shape the Future of AI - Yoruba Talent Hub

Welocalize 1K-5K Professional Services

Welo Data, part of Welocalize, is building a global talent network of Yoruba contributors in Nigeria for remote AI data projects focused on annotation, evaluation, and prompt creation.

LLM
4 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers