RemoteLeaf Logo
Log in Sign up

Senior Large Language Model (LLM) Operations Engineer

1 month, 2 weeks ago
United States
Full-time
Senior
AI Engineer
DevOps and Infrastructure
AWS Azure CI/CD Databricks Docker GCP GitHub Actions HIPAA Jenkins Kubernetes LLM Machine Learning MLflow MLOps Python
Apply Now
N-Power Medicine

N-Power Medicine

N-Power Medicine accelerates drug development by creating a research-ready network that integrates standard of care patients and diverse populations into clinical trials, facilitating informed decision-making for phase II to phase III studies in oncology.

Biotechnology
11-50
Founded 2021
View All Jobs 6

Description

  • Architect and build scalable AI infrastructure for production machine learning and LLM systems.
  • Lead the design and implementation of MLOps components such as CI/CD, monitoring, and automated feedback loops.
  • Own the technical direction for the MLOps and LLM Ops roadmap.
  • Define and improve validation, monitoring, and lifecycle management standards for AI products.
  • Drive automation and solve complex deployment and infrastructure challenges.
  • Collaborate with AI Data Science and Software Engineering teams to move solutions from research into production.
  • Establish best practices for model and data versioning, experiment tracking, and reproducibility.
  • Mentor team members and influence architectural standards and organizational practices.
  • Evaluate and integrate modern MLOps technologies and frameworks.
  • Apply safeguards for HIPAA, privacy, quality, and security in model deployment and data pipelines.

Requirements

  • 3+ years of professional experience in MLOps, DevOps, or Software Engineering focused on machine learning systems.
  • BSc, MSc, or equivalent experience in engineering, computer science, or a related field; PhD is a plus.
  • Deep hands-on expertise in Python and modern software development practices.
  • Hands-on experience with a major cloud platform such as AWS, GCP, or Azure.
  • Strong experience with containerization and orchestration tools such as Docker and Kubernetes.
  • Experience building and maintaining CI/CD pipelines for complex applications, including data and model versioning.
  • Proven track record of technical leadership and scaling production machine learning systems.
  • Ability to independently architect solutions for ambiguous infrastructure problems and articulate business value.
  • Experience decomposing large-scale systems and guiding teams through incremental delivery.
  • Exceptional written, verbal, and presentation skills with the ability to influence stakeholders at all levels.
  • Recognized technical leader who is proactive, strategic, and comfortable taking end-to-end ownership.
  • Generous, Curious, and Humble values alignment.
  • Direct experience productionizing LLMs, including prompting strategies, RAG, and fine-tuning, is preferred.
  • Deep expertise with Databricks, including MLflow, Delta Tables, and Unity Catalog, is preferred.
  • Experience building data annotation and Human-in-the-Loop systems from scratch is preferred.
  • Familiarity with vector databases such as Pinecone or Chroma and serving frameworks such as Ray Serve, Triton, or Databricks/Mosaic is preferred.
  • Experience working in a regulated healthcare environment and with HIPAA is preferred.
  • Ability to travel up to 10% may be required.
  • Must be currently authorized to work in the U.S. on a full-time basis; visa sponsorship is not available.

Benefits

  • Base salary range of $165,000 to $205,000.
  • Equity at hire.
  • Discretionary annual bonus based on company performance.
  • Eligibility for company benefits.
  • 401(k) plan.
  • Balanced and flexible work environment.
  • Competitive industry benefits.
  • Additional company perks.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

instacart.careers

Senior Software Engineer II, (ML/AI Platform)

instacart.careers 1K-5K Internet Software & Services

Instacart is hiring a Senior Engineer for its ML/AI Platform team to build the internal platform that powers organization-wide AI model training, deployment, and advanced inference workflows.

United States Full-time Senior Machine Learning Engineer Software Engineer
$192k-$242k
43 minutes ago
Process Street

Senior Software Engineer | Remote | AI SaaS Software Role

Process Street 51-250 Internet Software & Services

Process Street is hiring a Senior Software Engineer to help evolve its remote, AI-native product and engineering organization by building and shaping backend systems, frontend features, and agent-driven development workflows.

United States Canada Europe Mexico Full-time Senior AI Engineer Full-stack Engineer
AWS C# Chakra UI CircleCI Docker JavaScript LLM Play Framework PostgreSQL React Redis Ruby Scala Storybook
1 hour, 9 minutes ago
Quanata

Senior AIOps Engineer, Incident Response [Remote-US]

Quanata 201-500 information technology & services

Quanata is hiring an experienced production operations and reliability leader to oversee production health, incident response, and operational support for its AI-driven insurance technology platform.

United States Full-time Senior AI Engineer Site Reliability Engineer (SRE)
$215k-$280k
AWS Confluence JIRA
1 hour, 15 minutes ago
NetSpeek

Senior AI Engineer

NetSpeek 11-50 information technology & services

NetSpeek is hiring a Senior AI Engineer to own the end-to-end reasoning layer of Lena, its production AI control plane for enterprise physical infrastructure, with a focus on reliable and governed decision-making in customer environments.

United States Canada Full-time Senior AI Engineer
LLM Machine Learning .NET Python
1 hour, 56 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers