Applied AI Operations Lead

3 months ago
Full-time
Lead
Artificial Intelligence and Machine Learning
Canvas Medical

Canvas Medical

Canvas Medical is a digital health company that offers an EMR development and payments platform for healthcare. They provide tools for care delivery companies to see patients, run protocols, handle payments, and integrate necessary tools for good medic...

Health Care Providers & Services
51-250
Founded 2015
$44M raised

Description

  • Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation.
  • Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI.
  • Configure and optimize agent performance using prompt engineering, context management, and tool selection tailored to customer requirements.
  • Create and maintain customer-specific evaluation frameworks and monitoring systems to demonstrate agent effectiveness and build stakeholder confidence.
  • Maintain and operationalize AI governance frameworks to ensure safe, reliable agent operations in production healthcare environments.
  • Design and implement monitoring for agent performance, including accuracy tracking, drift detection, and quality assurance protocols.
  • Partner with clinical, compliance, and product teams to ensure deployed agents meet regulatory requirements, operational standards, and inform product improvements.
  • Develop and deliver training programs and change-management materials that enable care teams to collaborate effectively with AI agents.
  • Build and maintain a library of best practices, implementation templates, and governance playbooks to accelerate repeatable customer success.
  • Serve as a strategic, trusted AI advisor—lead executive conversations, create impact narratives and ROI analyses, and support sales on strategic opportunities.

Requirements

  • 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering) with a track record of enterprise implementations and measurable outcomes.
  • 2+ years of hands-on experience deploying and managing LLM-based systems in production environments.
  • Hands-on experience with foundation model providers and APIs (OpenAI, Anthropic, Google/Claude/Gemini) and familiarity with AI low-code automation tools and server-side SDKs (e.g., Canvas SDK).
  • Practical experience with prompt/context engineering, adversarial testing, evaluation frameworks, A/B testing, and performance monitoring for AI systems.
  • Understanding of AI safety, alignment, governance principles, and experience implementing monitoring and QA protocols (accuracy tracking, drift detection).
  • Healthcare technology experience required, with ability to advise on clinical workflows and construct automations that meet healthcare user needs.
  • Familiarity with clinical documentation standards, EMR systems, HIPAA, and healthcare compliance considerations.
  • Strong project management skills and ability to manage multiple customer engagements simultaneously.
  • Exceptional written and verbal communication skills, experience creating technical content and delivering technical training to diverse audiences.
  • Comfort with ambiguity, strong analytical and problem-solving abilities, and a consultative approach to customer engagement.

Benefits

  • $175,000–$250,000 annual salary range
  • Competitive salary with equity package
  • Health insurance with an option for 100% family coverage
  • 401(k) retirement plan
  • Paid maternity/paternity leave (12 weeks)
  • Flexible/unlimited PTO and support for remote/distributed work
  • Home office stipend

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sr. Full Stack Software Engineer - Agents team (Fixed Term 6 Months)

Mitek Systems 251-1K Communications Equipment

Mitek is hiring a remote Senior Full Stack Software Engineer for its Agents team to evolve and improve products that support mobile banking and identity authentication over a fixed 6-month contract.

Agile AWS Bash CI/CD CloudFormation CSS Cypress Docker EC2 Git Go Groovy HTML Java JavaScript Jenkins Microservices MongoDB Python React Serverless Terraform TypeScript
25 minutes ago

Senior GenAI Integrated Designer

Brandtech+ 501-1000 Marketing services

Brandtech+ is hiring a Senior GenAI Integrated Designer to create and adapt digital, social, e-commerce, and motion content using GenAI workflows for high-profile brands.

After Effects Digital Marketing E-commerce Figma Generative AI Illustrator Instagram API Photoshop Social Media Marketing TikTok
1 hour ago

AI Data Engineer

Influur 11-50 Media

Influur is hiring an AI Data Engineer in London/remote to own the full data-to-agent lifecycle for its production influencer-marketing AI system.

AWS GCP LLM Python
2 hours, 3 minutes ago

Remote | Customer Experience Associate | Entry Level

Aisle and Abroad Travel & Tourism

Aisle & Abroad is hiring a Remote Customer Experience Associate to support client communication, scheduling, and coordination for weddings, events, and destination experiences.

2 hours, 9 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers