RemoteLeaf Logo
Log in Sign up

Applied AI Operations Lead

7 months, 4 weeks ago
Anywhere, United States
Full-time
Lead
AI Engineer
Artificial Intelligence and Machine Learning
HIPAA
Apply Now
Canvas Medical

Canvas Medical

Canvas Medical is a digital health company that offers an EMR development and payments platform for healthcare. They provide tools for care delivery companies to see patients, run protocols, handle payments, and integrate necessary tools for good medic...

Health Care Providers & Services
51-250
Founded 2015
$44M raised
View All Jobs 5

Description

  • Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation.
  • Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI.
  • Configure and optimize agent performance using prompt engineering, context management, and tool selection tailored to customer requirements.
  • Create and maintain customer-specific evaluation frameworks and monitoring systems to demonstrate agent effectiveness and build stakeholder confidence.
  • Maintain and operationalize AI governance frameworks to ensure safe, reliable agent operations in production healthcare environments.
  • Design and implement monitoring for agent performance, including accuracy tracking, drift detection, and quality assurance protocols.
  • Partner with clinical, compliance, and product teams to ensure deployed agents meet regulatory requirements, operational standards, and inform product improvements.
  • Develop and deliver training programs and change-management materials that enable care teams to collaborate effectively with AI agents.
  • Build and maintain a library of best practices, implementation templates, and governance playbooks to accelerate repeatable customer success.
  • Serve as a strategic, trusted AI advisor—lead executive conversations, create impact narratives and ROI analyses, and support sales on strategic opportunities.

Requirements

  • 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering) with a track record of enterprise implementations and measurable outcomes.
  • 2+ years of hands-on experience deploying and managing LLM-based systems in production environments.
  • Hands-on experience with foundation model providers and APIs (OpenAI, Anthropic, Google/Claude/Gemini) and familiarity with AI low-code automation tools and server-side SDKs (e.g., Canvas SDK).
  • Practical experience with prompt/context engineering, adversarial testing, evaluation frameworks, A/B testing, and performance monitoring for AI systems.
  • Understanding of AI safety, alignment, governance principles, and experience implementing monitoring and QA protocols (accuracy tracking, drift detection).
  • Healthcare technology experience required, with ability to advise on clinical workflows and construct automations that meet healthcare user needs.
  • Familiarity with clinical documentation standards, EMR systems, HIPAA, and healthcare compliance considerations.
  • Strong project management skills and ability to manage multiple customer engagements simultaneously.
  • Exceptional written and verbal communication skills, experience creating technical content and delivering technical training to diverse audiences.
  • Comfort with ambiguity, strong analytical and problem-solving abilities, and a consultative approach to customer engagement.

Benefits

  • $175,000–$250,000 annual salary range
  • Competitive salary with equity package
  • Health insurance with an option for 100% family coverage
  • 401(k) retirement plan
  • Paid maternity/paternity leave (12 weeks)
  • Flexible/unlimited PTO and support for remote/distributed work
  • Home office stipend

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

A

Remote Client Success Representative

AO Garcia Agency Insurance

Virtual Consultant role focused on assessing client needs, presenting suitable options, and maintaining relationships remotely while managing related administrative work.

United States Mid Level Customer Success
CRM
14 hours, 10 minutes ago
A

Client Experience Specialist - Work From Home

AO Garcia Agency Insurance

Virtual consultant role focused on assessing client needs, explaining options, and maintaining client relationships after the initial meeting while managing related administrative tasks.

United States Mid Level Customer Success
CRM
14 hours, 25 minutes ago
A

Remote Client Experience Manager

AO Garcia Agency Insurance

Virtual Consultant who assesses client needs, explains relevant options, and maintains relationships remotely while managing follow-up and administrative tasks.

United States Full-time Mid Level Customer Success
CRM
14 hours, 25 minutes ago
A

Client Success Associate - Work From Home

AO Garcia Agency Insurance

Remote financial-services sales role focused on speaking with warm leads who are seeking income and future protection, with structured training and a pathway to leadership.

Canada Full-time Entry Level Customer Success
14 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers