RemoteLeaf Logo
Log in Sign up

Manager, AI Operations

1 month ago
United States
Full-time
Senior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
AWS Datadog Generative AI Machine Learning MLOps
Apply Now
Xsolis

Xsolis

Xsolis is a healthcare AI vendor that automates decision-making for providers and payers using advanced technology like CORTEX, improving care efficiency.

IT Services
251-1K
Founded 2013
$75M raised
View All Jobs

Description

  • Own deployment support, monitoring, and day-to-day reliability of AI systems in production.
  • Lead incident response and root-cause troubleshooting for AI/ML services, including agentic systems.
  • Partner with MLOps, Cloud Engineering, and Infrastructure teams to maintain robust deployment pipelines.
  • Build and maintain observability practices across drift detection, latency, uptime, accuracy decay, and action-level tracing.
  • Define production health metrics, identify performance degradation, and route issues to the appropriate build team.
  • Establish dashboards and alerting for real-time visibility into AI system health.
  • Serve as the primary liaison between AI systems and Security, Infrastructure, and IT teams.
  • Support AI Governance by instrumenting fairness, safety, and bias-monitoring metrics.
  • Coordinate handoffs from the AI Build team into production, including production-readiness reviews.
  • Lead and grow a small production support and observability team, including priorities, capacity, mentoring, and on-call culture.

Requirements

  • 7+ years of experience in AI/ML operations, MLOps, or production data science.
  • 2+ years of people or team leadership experience.
  • Hands-on experience operating traditional ML and GenAI systems in production.
  • Strong understanding of observability practices, including drift detection, model performance monitoring, logging, and alerting at scale.
  • Experience partnering with Security and Infrastructure teams on production risk and access controls.
  • Excellent communication skills and ability to translate operational risk for technical and business stakeholders.
  • Prior experience in healthcare, health tech, payer, or provider organizations (preferred).
  • Experience operating agentic AI systems, including tool-use monitoring, guardrails, and action-level tracing (preferred).
  • Familiarity with MLOps/observability tools such as Datadog, AWS CloudWatch, and LangFuse, plus native AWS capabilities (preferred).
  • Experience working alongside a dedicated AI Governance function (preferred).
  • Must pass a background check and have access to sensitive information including proprietary data and PHI.
  • Must be authorized to work in the United States full-time and permanently without visa sponsorship.

Benefits

  • Medical, dental, and vision insurance.
  • 401(k) company match.
  • Flexible paid time off.
  • Paid parental leave.
  • HSA/FSA options.
  • Educational reimbursement program.
  • Employer-paid EAP and mental health services.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AssetWatch®

Field Coordination Manager

AssetWatch® 51-250 Construction & Engineering

AssetWatch is hiring a Field Coordination Manager to lead real-time field support and escalations, resolve operational issues, and protect customer experience for global manufacturing clients.

United States Full-time Mid Level Operations Manager
$90k-$110k
CRM Salesforce
8 hours, 32 minutes ago
Sunrise Group

Supply Chain & Procurement Manager

Sunrise Group 51-250 Internet Software & Services

Sunrise Group is seeking a Supply Chain & Procurement Manager to oversee materials, inventory, procurement, manufacturing coordination, logistics, and 3PL operations supporting its medical-device production and Dreem Health clinics.

Europe Senior Operations Manager
$76k-$86k
ERP
8 hours, 32 minutes ago
LBC Mortgage

Operations Manager

LBC Mortgage 11-50 Real Estate

LBC Mortgage is seeking an experienced Operations Manager to oversee daily operations, improve cross-functional processes, and build scalable systems for its growing U.S. mortgage brokerage.

Philippines Argentina Portugal Dominican Republic Mid Level Operations Manager
9 hours, 47 minutes ago
NewRocket

AI/ML Architect

NewRocket 251-1K Internet Software & Services

NewRocket is hiring an AI/ML Architect in India to support a large global client by designing, deploying, and maintaining scalable machine learning and AI applications.

India Senior AI (Artificial Intelligence)
Apache Spark AWS Azure BERT GCP Generative AI GPT Hugging Face LLM Machine Learning Matplotlib MongoDB MySQL NLP NumPy Pandas PostgreSQL Power BI Python PyTorch Scikit-learn Seaborn Snowflake SQL Tableau TensorFlow Vertex AI
9 hours, 47 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers