RemoteLeaf Logo
Log in Sign up

Applied AI Operations Lead

1 month, 3 weeks ago
Anywhere, United States
Full-time
Lead
AI Engineer
Artificial Intelligence and Machine Learning
HIPAA
Apply Now
Canvas Medical

Canvas Medical

Canvas Medical is a digital health company that offers an EMR development and payments platform for healthcare. They provide tools for care delivery companies to see patients, run protocols, handle payments, and integrate necessary tools for good medic...

Health Care Providers & Services
51-250
Founded 2015
$44M raised
View All Jobs 5

Description

  • Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation.
  • Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI.
  • Configure and optimize agent performance using prompt engineering, context management, and tool selection tailored to customer requirements.
  • Create and maintain customer-specific evaluation frameworks and monitoring systems to demonstrate agent effectiveness and build stakeholder confidence.
  • Maintain and operationalize AI governance frameworks to ensure safe, reliable agent operations in production healthcare environments.
  • Design and implement monitoring for agent performance, including accuracy tracking, drift detection, and quality assurance protocols.
  • Partner with clinical, compliance, and product teams to ensure deployed agents meet regulatory requirements, operational standards, and inform product improvements.
  • Develop and deliver training programs and change-management materials that enable care teams to collaborate effectively with AI agents.
  • Build and maintain a library of best practices, implementation templates, and governance playbooks to accelerate repeatable customer success.
  • Serve as a strategic, trusted AI advisor—lead executive conversations, create impact narratives and ROI analyses, and support sales on strategic opportunities.

Requirements

  • 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering) with a track record of enterprise implementations and measurable outcomes.
  • 2+ years of hands-on experience deploying and managing LLM-based systems in production environments.
  • Hands-on experience with foundation model providers and APIs (OpenAI, Anthropic, Google/Claude/Gemini) and familiarity with AI low-code automation tools and server-side SDKs (e.g., Canvas SDK).
  • Practical experience with prompt/context engineering, adversarial testing, evaluation frameworks, A/B testing, and performance monitoring for AI systems.
  • Understanding of AI safety, alignment, governance principles, and experience implementing monitoring and QA protocols (accuracy tracking, drift detection).
  • Healthcare technology experience required, with ability to advise on clinical workflows and construct automations that meet healthcare user needs.
  • Familiarity with clinical documentation standards, EMR systems, HIPAA, and healthcare compliance considerations.
  • Strong project management skills and ability to manage multiple customer engagements simultaneously.
  • Exceptional written and verbal communication skills, experience creating technical content and delivering technical training to diverse audiences.
  • Comfort with ambiguity, strong analytical and problem-solving abilities, and a consultative approach to customer engagement.

Benefits

  • $175,000–$250,000 annual salary range
  • Competitive salary with equity package
  • Health insurance with an option for 100% family coverage
  • 401(k) retirement plan
  • Paid maternity/paternity leave (12 weeks)
  • Flexible/unlimited PTO and support for remote/distributed work
  • Home office stipend

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Nerdy

Senior Software Engineer (AI-Native) (Full-time Contractor)

Nerdy 51-250 Diversified Consumer Services

Nerdy is hiring Senior Software Engineers in LATAM to build and operate AI-native learning products on a modern JavaScript/TypeScript stack within an AWS-based, services-oriented engineering environment.

Colombia Contract Senior AI Engineer Software Engineer
AWS C# C++ CI/CD EC2 Generative AI GitHub Actions Java JavaScript Linux Netlify SEO Supabase TypeScript Vercel
5 minutes ago
Calyxo

Connecticut based Clinical Specialist - Remote, USA

Calyxo 11-50 Health Care Providers & Services

Calyxo, Inc. is seeking a Clinical Specialist to provide case coverage, surgical team training, and clinical support for its kidney stone treatment device across assigned territories.

United States Full-time Senior Customer Success Sales Engineer
$100k-$140k
5 minutes ago
Angi

Project Advisor

Angi 1K-5K Professional Services

Angi is hiring a remote Project Advisor on its Homeowner Success team to support homeowners by handling service-related calls, guiding them through available solutions, and helping ensure customer needs are met.

United States Full-time Junior Customer Success
$45k-$52k
20 minutes ago
Airtable

AI Agent Architect, Customer Experience

Airtable 1K-5K IT Services

Airtable is hiring a CX AI Architect to design the technical foundation for its AI-native customer support experience, with the goal of making AI agents reliably resolve customer issues at scale.

United States Full-time Lead AI Engineer Technical Support Engineer
$177k-$278k
LLM
35 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers