Staff, Machine Learning Engineer

2 months, 2 weeks ago
Full-time
Lead
Software Development
Fullscript

Fullscript

Fullscript provides a platform that enables healthcare practitioners to create personalized supplement plans and recommend professional-grade supplements to their patients, enhancing patient care and treatment adherence through convenient ordering and ...

Health Care Providers & Services
251-1K
Founded 2011
$267M raised

Description

  • Lead the design, development, and deployment of production multi-turn LLM-powered features such as summarization tools and clinician-facing conversational agents.
  • Own backend services in Python that integrate LLM agents with Fullscript’s platform for reliable production use.
  • Define technical direction for prompting, grounding, safety, and orchestration strategies across clinical AI workflows.
  • Establish and improve evaluation methods for LLM outputs, including accuracy, hallucinations, edge cases, and overall feature quality.
  • Shape engineering patterns for model-related workflows, including testing, CI/CD, observability, and version control.
  • Partner with medical, product, analytics, and engineering teams to identify high-value AI opportunities and turn them into scalable product capabilities.
  • Work cross-functionally with medical SMEs and other stakeholders to refine requirements and ensure system design supports clinical use cases.
  • Provide technical leadership by clarifying ambiguous problems, guiding tradeoff decisions, and raising the quality bar for the team.
  • Stay current with the latest LLM research and emerging AI technologies and assess where they can be applied at Fullscript.

Requirements

  • 6+ years of experience building and implementing machine learning applications in production.
  • Meaningful experience with LLM-powered agents, conversational experiences, or agent-based workflows.
  • Track record of owning complex technical problems end to end and shaping implementation beyond immediate code contributions.
  • Experience designing and deploying AI systems that answer open-ended questions, support follow-up interactions, and operate reliably in production.
  • Strong experience with LLM application frameworks and tooling such as LangChain, LangGraph, or similar orchestration and RAG frameworks.
  • Familiarity with evaluation and monitoring frameworks for LLM outputs, conversational quality, and system reliability.
  • Knowledge of MCP, agent orchestration patterns, or related approaches for building multi-step AI systems.
  • Strong proficiency in Python and SQL.
  • Experience making sound technical decisions around quality, safety, maintainability, and scalability in production AI systems.
  • Strong communication and collaboration skills for working effectively across technical and non-technical stakeholders.
  • Experience defining technical direction for AI or machine learning systems across multiple projects or teams (bonus).
  • Experience building clinician-facing, healthcare-adjacent, or other high-trust AI experiences (bonus).
  • Experience with recommendation systems, personalization, or other applied ML systems beyond LLMs (bonus).
  • Experience with modern retrieval, grounding, or evaluation patterns for LLM applications (bonus).
  • Experience working closely with domain experts in complex or highly contextual problem spaces (bonus).

Benefits

  • Flexible PTO and competitive pay.
  • RRSP match and stock options.
  • Customizable benefits with flexible coverage, paramedical services, and an HSA.
  • Fullscript discounts on wellness products.
  • Continuous learning support with a training budget and company-wide initiatives.
  • Hybrid and remote work flexibility.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Software Engineer - Machine Learning (Behaviors)

Motional 1K-5K Automotive

Motional’s Behaviors team is hiring an engineer to develop machine learning models that help autonomous vehicles understand and predict traffic behavior in complex real-world driving scenarios.

C++ Computer Vision Deep Learning Machine Learning Neural Networks Python PyTorch
1 day, 14 hours ago

PyTorch & MLOps AI Specialist

Weekday 11-50 Construction & Engineering

A leading AI lab’s Generative AI team is hiring an MLOps and ML Systems Engineer to support the development and evaluation of next-generation large language models and the training data that powers them.

Generative AI LLM MLOps PyTorch
1 day, 14 hours ago

Junior Python Developer - AI & Innovation Team

Adzuna 51-250 Internet Software & Services

Adzuna is hiring a Junior Python Developer to help build and maintain AI-powered jobseeker products and the production systems behind them for a remote team working in London hours.

Apache Spark AWS CSS EC2 Git GitHub HTML LLM Machine Learning MySQL Playwright PostgreSQL Python React Selenium Solr SQL Tailwind CSS
1 day, 15 hours ago

Staff AI/ML Engineer

Burq 11-50 Air Freight & Logistics

Burq is hiring a Staff AI/ML Engineer to build the core AI systems that automate logistics operations and improve real-time decision-making for the company’s delivery platform.

Computer Vision FastAPI MLOps Python Reinforcement Learning
1 day, 15 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers