Staff, Machine Learning Engineer

2 weeks, 6 days ago
Full-time
Lead
Software Development
Fullscript

Fullscript

Fullscript provides a platform that enables healthcare practitioners to create personalized supplement plans and recommend professional-grade supplements to their patients, enhancing patient care and treatment adherence through convenient ordering and ...

Health Care Providers & Services
251-1K
Founded 2011
$267M raised

Description

  • Lead the design, development, and deployment of production multi-turn LLM-powered features such as summarization tools and clinician-facing conversational agents.
  • Own backend services in Python that integrate LLM agents with Fullscript’s platform for reliable production use.
  • Define technical direction for prompting, grounding, safety, and orchestration strategies across clinical AI workflows.
  • Establish and improve evaluation methods for LLM outputs, including accuracy, hallucinations, edge cases, and overall feature quality.
  • Shape engineering patterns for model-related workflows, including testing, CI/CD, observability, and version control.
  • Partner with medical, product, analytics, and engineering teams to identify high-value AI opportunities and turn them into scalable product capabilities.
  • Work cross-functionally with medical SMEs and other stakeholders to refine requirements and ensure system design supports clinical use cases.
  • Provide technical leadership by clarifying ambiguous problems, guiding tradeoff decisions, and raising the quality bar for the team.
  • Stay current with the latest LLM research and emerging AI technologies and assess where they can be applied at Fullscript.

Requirements

  • 6+ years of experience building and implementing machine learning applications in production.
  • Meaningful experience with LLM-powered agents, conversational experiences, or agent-based workflows.
  • Track record of owning complex technical problems end to end and shaping implementation beyond immediate code contributions.
  • Experience designing and deploying AI systems that answer open-ended questions, support follow-up interactions, and operate reliably in production.
  • Strong experience with LLM application frameworks and tooling such as LangChain, LangGraph, or similar orchestration and RAG frameworks.
  • Familiarity with evaluation and monitoring frameworks for LLM outputs, conversational quality, and system reliability.
  • Knowledge of MCP, agent orchestration patterns, or related approaches for building multi-step AI systems.
  • Strong proficiency in Python and SQL.
  • Experience making sound technical decisions around quality, safety, maintainability, and scalability in production AI systems.
  • Strong communication and collaboration skills for working effectively across technical and non-technical stakeholders.
  • Experience defining technical direction for AI or machine learning systems across multiple projects or teams (bonus).
  • Experience building clinician-facing, healthcare-adjacent, or other high-trust AI experiences (bonus).
  • Experience with recommendation systems, personalization, or other applied ML systems beyond LLMs (bonus).
  • Experience with modern retrieval, grounding, or evaluation patterns for LLM applications (bonus).
  • Experience working closely with domain experts in complex or highly contextual problem spaces (bonus).

Benefits

  • Flexible PTO and competitive pay.
  • RRSP match and stock options.
  • Customizable benefits with flexible coverage, paramedical services, and an HSA.
  • Fullscript discounts on wellness products.
  • Continuous learning support with a training budget and company-wide initiatives.
  • Hybrid and remote work flexibility.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Machine Learning Engineer, AI Platform

Affinity 251-1K IT Services

Affinity is hiring a Senior Machine Learning Engineer for its AI Platform team to build production ML systems that extract, retrieve, and rank insights from massive relationship and business interaction data for its CRM platform.

CI/CD Feature Engineering Machine Learning Python PyTorch Scikit-learn
19 minutes ago

AI Tech Lead - Staff Machine Learning Engineer

Sumo Logic 251-1K Internet Software & Services

Sumo Logic is hiring a Staff Machine Learning Engineer – AI Tech Lead to lead the design and production delivery of agentic AI systems for Security Operations Center use cases at global scale.

Apache Airflow AWS Azure Docker GCP Kubernetes LLM Machine Learning MLflow Python PyTorch System Design Vertex AI
39 minutes ago

AI/ML Engineer (AWS)

Reply 10K-50K Internet Software & Services

Valorem Reply is hiring a Senior AI/ML Engineer in Irvine or Los Angeles to build and evolve AWS-based machine learning and Generative AI applications for enterprise customers.

Agile AWS CI/CD Generative AI LLM Machine Learning Python
2 hours, 40 minutes ago

Machine Learning Principal Solutions Architect

phData 251-1K IT Services

phData is hiring a Principal Solutions Architect to lead delivery of AI/ML solutions for enterprise clients while also driving strategic account growth and client engagement.

AWS Azure Databricks dbt Django Docker Flask GCP Java Keras Kubernetes Machine Learning MLflow Python SageMaker Scala Scikit-learn Snowflake Spring TensorFlow Vertex AI
3 hours, 13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers