Applied AI Operations Lead

1 month ago
Full-time
Lead
Artificial Intelligence and Machine Learning
Canvas Medical

Canvas Medical

Canvas Medical is a digital health company that offers an EMR development and payments platform for healthcare. They provide tools for care delivery companies to see patients, run protocols, handle payments, and integrate necessary tools for good medic...

Health Care Providers & Services
51-250
Founded 2015
$44M raised

Description

  • Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation.
  • Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI.
  • Configure and optimize agent performance using prompt engineering, context management, and tool selection tailored to customer requirements.
  • Create and maintain customer-specific evaluation frameworks and monitoring systems to demonstrate agent effectiveness and build stakeholder confidence.
  • Maintain and operationalize AI governance frameworks to ensure safe, reliable agent operations in production healthcare environments.
  • Design and implement monitoring for agent performance, including accuracy tracking, drift detection, and quality assurance protocols.
  • Partner with clinical, compliance, and product teams to ensure deployed agents meet regulatory requirements, operational standards, and inform product improvements.
  • Develop and deliver training programs and change-management materials that enable care teams to collaborate effectively with AI agents.
  • Build and maintain a library of best practices, implementation templates, and governance playbooks to accelerate repeatable customer success.
  • Serve as a strategic, trusted AI advisor—lead executive conversations, create impact narratives and ROI analyses, and support sales on strategic opportunities.

Requirements

  • 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering) with a track record of enterprise implementations and measurable outcomes.
  • 2+ years of hands-on experience deploying and managing LLM-based systems in production environments.
  • Hands-on experience with foundation model providers and APIs (OpenAI, Anthropic, Google/Claude/Gemini) and familiarity with AI low-code automation tools and server-side SDKs (e.g., Canvas SDK).
  • Practical experience with prompt/context engineering, adversarial testing, evaluation frameworks, A/B testing, and performance monitoring for AI systems.
  • Understanding of AI safety, alignment, governance principles, and experience implementing monitoring and QA protocols (accuracy tracking, drift detection).
  • Healthcare technology experience required, with ability to advise on clinical workflows and construct automations that meet healthcare user needs.
  • Familiarity with clinical documentation standards, EMR systems, HIPAA, and healthcare compliance considerations.
  • Strong project management skills and ability to manage multiple customer engagements simultaneously.
  • Exceptional written and verbal communication skills, experience creating technical content and delivering technical training to diverse audiences.
  • Comfort with ambiguity, strong analytical and problem-solving abilities, and a consultative approach to customer engagement.

Benefits

  • $175,000–$250,000 annual salary range
  • Competitive salary with equity package
  • Health insurance with an option for 100% family coverage
  • 401(k) retirement plan
  • Paid maternity/paternity leave (12 weeks)
  • Flexible/unlimited PTO and support for remote/distributed work
  • Home office stipend

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Engineer - FDE (Forward Deployed Engineer)

Databricks 1K-5K IT Services

Databricks is hiring an AI Forward Deployed Engineer (FDE) to work directly with customers and internal teams to design, deliver, and productionize GenAI applications that solve real-world problems and influence product and strategic priorities.

Apache Spark AWS Azure Databricks GCP MLflow Pandas Python PyTorch Scikit-learn SQL
1 month ago

IN Associate - Customer Success (Gurugram)

Sporty Group 51-250 Media

Customer Success Representative at Sporty, joining a remote Customer Success team to manage initial customer interactions, educate users about Sporty products, and ensure a positive, solution-focused customer journey.

CRM
1 month ago

Senior ServiceNow ITSM Architect with AI & ITAM exposure

Muller Internet Software & Services

ServiceNow AI & ITSM Solution Architect at Müller Solutions responsible for designing, leading, and delivering AI-enabled ServiceNow solutions across ITSM, FSM, and Asset Management to align platform capabilities with business processes, data foundations, and measurable operational outcomes.

Agile Generative AI JavaScript Machine Learning
1 month ago

Customer Reliability Engineer

Sysdig 251-1K IT Services

Customer Reliability Engineer at Sysdig (remote, flexible for Italy/Spain) delivering senior-level technical support and escalation management to ensure customers run and secure cloud/container environments reliably.

AWS Azure Bash Cassandra Elasticsearch GCP Kafka Kubernetes Linux PostgreSQL Python Shell Scripting
1 month ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers