Applied AI Operations Lead

6 months, 3 weeks ago
Full-time
Lead
Artificial Intelligence and Machine Learning
Canvas Medical

Canvas Medical

Canvas Medical is a digital health company that offers an EMR development and payments platform for healthcare. They provide tools for care delivery companies to see patients, run protocols, handle payments, and integrate necessary tools for good medic...

Health Care Providers & Services
51-250
Founded 2015
$44M raised

Description

  • Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation.
  • Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI.
  • Configure and optimize agent performance using prompt engineering, context management, and tool selection tailored to customer requirements.
  • Create and maintain customer-specific evaluation frameworks and monitoring systems to demonstrate agent effectiveness and build stakeholder confidence.
  • Maintain and operationalize AI governance frameworks to ensure safe, reliable agent operations in production healthcare environments.
  • Design and implement monitoring for agent performance, including accuracy tracking, drift detection, and quality assurance protocols.
  • Partner with clinical, compliance, and product teams to ensure deployed agents meet regulatory requirements, operational standards, and inform product improvements.
  • Develop and deliver training programs and change-management materials that enable care teams to collaborate effectively with AI agents.
  • Build and maintain a library of best practices, implementation templates, and governance playbooks to accelerate repeatable customer success.
  • Serve as a strategic, trusted AI advisor—lead executive conversations, create impact narratives and ROI analyses, and support sales on strategic opportunities.

Requirements

  • 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering) with a track record of enterprise implementations and measurable outcomes.
  • 2+ years of hands-on experience deploying and managing LLM-based systems in production environments.
  • Hands-on experience with foundation model providers and APIs (OpenAI, Anthropic, Google/Claude/Gemini) and familiarity with AI low-code automation tools and server-side SDKs (e.g., Canvas SDK).
  • Practical experience with prompt/context engineering, adversarial testing, evaluation frameworks, A/B testing, and performance monitoring for AI systems.
  • Understanding of AI safety, alignment, governance principles, and experience implementing monitoring and QA protocols (accuracy tracking, drift detection).
  • Healthcare technology experience required, with ability to advise on clinical workflows and construct automations that meet healthcare user needs.
  • Familiarity with clinical documentation standards, EMR systems, HIPAA, and healthcare compliance considerations.
  • Strong project management skills and ability to manage multiple customer engagements simultaneously.
  • Exceptional written and verbal communication skills, experience creating technical content and delivering technical training to diverse audiences.
  • Comfort with ambiguity, strong analytical and problem-solving abilities, and a consultative approach to customer engagement.

Benefits

  • $175,000–$250,000 annual salary range
  • Competitive salary with equity package
  • Health insurance with an option for 100% family coverage
  • 401(k) retirement plan
  • Paid maternity/paternity leave (12 weeks)
  • Flexible/unlimited PTO and support for remote/distributed work
  • Home office stipend

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Customer Success Engineer

Veeam Software 1K-5K Internet Software & Services

Veeam is seeking a Customer Success Engineer to own the technical success of enterprise and commercial customers using the Veeam Data Platform, driving onboarding, adoption, resilience, retention, and expansion.

5 hours, 46 minutes ago

Retention Specialist

Constant Contact 1K-5K Media

Constant Contact is hiring a Retention Specialist to advise customers considering cancellation or downgrade, reduce churn, and preserve subscription revenue through consultative support.

Salesforce
6 hours, 2 minutes ago

[Job-31523] Mid level Java Developer Copilot IA, Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa Desenvolvedora Java Pleno para criar, evoluir e integrar agentes inteligentes de IA com Microsoft Copilot Studio e tecnologias Java, transformando necessidades de clientes em soluções automatizadas de negócio.

Azure Java Kanban REST API Scrum
6 hours, 31 minutes ago

Patient & Family Advisor

InStride Health 51-250 Health Care Providers & Services

InStride Health is seeking a Patient and Family Advisor to guide prospective families through insurance-based pediatric anxiety and OCD care, providing advocacy, education, and concierge-level onboarding support.

HIPAA Salesforce
6 hours, 31 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers