RemoteLeaf Logo
Log in Sign up

Senior Large Language Model (LLM) Operations Engineer

2 months, 2 weeks ago
United States
Full-time
Senior
AI Engineer
DevOps and Infrastructure
AWS Azure CI/CD Databricks Docker GCP GitHub Actions HIPAA Jenkins Kubernetes LLM Machine Learning MLflow MLOps Python
Apply Now
N-Power Medicine

N-Power Medicine

N-Power Medicine accelerates drug development by creating a research-ready network that integrates standard of care patients and diverse populations into clinical trials, facilitating informed decision-making for phase II to phase III studies in oncology.

Biotechnology
11-50
Founded 2021
View All Jobs 6

Description

  • Architect and build scalable AI infrastructure for production machine learning and LLM systems.
  • Lead the design and implementation of MLOps components such as CI/CD, monitoring, and automated feedback loops.
  • Own the technical direction for the MLOps and LLM Ops roadmap.
  • Define and improve validation, monitoring, and lifecycle management standards for AI products.
  • Drive automation and solve complex deployment and infrastructure challenges.
  • Collaborate with AI Data Science and Software Engineering teams to move solutions from research into production.
  • Establish best practices for model and data versioning, experiment tracking, and reproducibility.
  • Mentor team members and influence architectural standards and organizational practices.
  • Evaluate and integrate modern MLOps technologies and frameworks.
  • Apply safeguards for HIPAA, privacy, quality, and security in model deployment and data pipelines.

Requirements

  • 3+ years of professional experience in MLOps, DevOps, or Software Engineering focused on machine learning systems.
  • BSc, MSc, or equivalent experience in engineering, computer science, or a related field; PhD is a plus.
  • Deep hands-on expertise in Python and modern software development practices.
  • Hands-on experience with a major cloud platform such as AWS, GCP, or Azure.
  • Strong experience with containerization and orchestration tools such as Docker and Kubernetes.
  • Experience building and maintaining CI/CD pipelines for complex applications, including data and model versioning.
  • Proven track record of technical leadership and scaling production machine learning systems.
  • Ability to independently architect solutions for ambiguous infrastructure problems and articulate business value.
  • Experience decomposing large-scale systems and guiding teams through incremental delivery.
  • Exceptional written, verbal, and presentation skills with the ability to influence stakeholders at all levels.
  • Recognized technical leader who is proactive, strategic, and comfortable taking end-to-end ownership.
  • Generous, Curious, and Humble values alignment.
  • Direct experience productionizing LLMs, including prompting strategies, RAG, and fine-tuning, is preferred.
  • Deep expertise with Databricks, including MLflow, Delta Tables, and Unity Catalog, is preferred.
  • Experience building data annotation and Human-in-the-Loop systems from scratch is preferred.
  • Familiarity with vector databases such as Pinecone or Chroma and serving frameworks such as Ray Serve, Triton, or Databricks/Mosaic is preferred.
  • Experience working in a regulated healthcare environment and with HIPAA is preferred.
  • Ability to travel up to 10% may be required.
  • Must be currently authorized to work in the U.S. on a full-time basis; visa sponsorship is not available.

Benefits

  • Base salary range of $165,000 to $205,000.
  • Equity at hire.
  • Discretionary annual bonus based on company performance.
  • Eligibility for company benefits.
  • 401(k) plan.
  • Balanced and flexible work environment.
  • Competitive industry benefits.
  • Additional company perks.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

3Cloud

Principal Architect - AI Product Engineering

3Cloud 251-1K Internet Software & Services

3Cloud is seeking an AI Product Engineering Principal Architect to lead the design and delivery of enterprise-grade AI solutions and shape the company’s AI Product Engineering practice.

United States Full-time Lead AI Engineer Software Architect
$158k-$217k
Agile Azure C# CI/CD Databricks Generative AI GitHub Machine Learning Microservices MLOps .NET Python
5 hours, 46 minutes ago
Grafana

Staff AI Engineer - Grafana AI/ML | Canada | Remote

Grafana 1K-5K IT Services

Grafana Labs is hiring a Staff AI Engineer to build and ship AI-powered observability features that help users detect, triage, and resolve incidents across its cloud platform.

Canada Full-time Lead AI Engineer Software Engineer
$150k-$185k
AWS Azure Docker GCP Generative AI Kubernetes LLM Terraform
6 hours, 1 minute ago
Anduril Industries

AI Solutions Engineer, Talent Acquisition

Anduril Industries 1K-5K Aerospace & Defense

Anduril Industries is hiring an AI Solutions Engineer, Talent Acquisition to own AI and automation efforts for its recruiting function and build practical systems that improve hiring operations at scale.

United States Full-time Senior AI Engineer Recruiter
$129k-$171k
CI/CD Git LLM Python
6 hours, 1 minute ago
Affirm

Software Engineer II, Machine Learning (Feature Platform)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a software engineer for its ML Feature Platform team to build the self-serve data and feature infrastructure that powers machine learning and decisioning across the company.

United States Full-time Junior Data Engineer Machine Learning Engineer
$146k-$225k
AWS Kotlin Kubernetes Machine Learning MySQL Python
6 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers