RemoteLeaf Logo
Log in Sign up

Senior Large Language Model (LLM) Operations Engineer

3 weeks, 4 days ago
United States
Full-time
Senior
AI Engineer
DevOps and Infrastructure
AWS Azure CI/CD Databricks Docker GCP GitHub Actions HIPAA Jenkins Kubernetes LLM Machine Learning MLflow MLOps Python
Apply Now
N-Power Medicine

N-Power Medicine

N-Power Medicine accelerates drug development by creating a research-ready network that integrates standard of care patients and diverse populations into clinical trials, facilitating informed decision-making for phase II to phase III studies in oncology.

Biotechnology
11-50
Founded 2021
View All Jobs 7

Description

  • Architect and build scalable AI infrastructure for production machine learning and LLM systems.
  • Lead the design and implementation of MLOps components such as CI/CD, monitoring, and automated feedback loops.
  • Own the technical direction for the MLOps and LLM Ops roadmap.
  • Define and improve validation, monitoring, and lifecycle management standards for AI products.
  • Drive automation and solve complex deployment and infrastructure challenges.
  • Collaborate with AI Data Science and Software Engineering teams to move solutions from research into production.
  • Establish best practices for model and data versioning, experiment tracking, and reproducibility.
  • Mentor team members and influence architectural standards and organizational practices.
  • Evaluate and integrate modern MLOps technologies and frameworks.
  • Apply safeguards for HIPAA, privacy, quality, and security in model deployment and data pipelines.

Requirements

  • 3+ years of professional experience in MLOps, DevOps, or Software Engineering focused on machine learning systems.
  • BSc, MSc, or equivalent experience in engineering, computer science, or a related field; PhD is a plus.
  • Deep hands-on expertise in Python and modern software development practices.
  • Hands-on experience with a major cloud platform such as AWS, GCP, or Azure.
  • Strong experience with containerization and orchestration tools such as Docker and Kubernetes.
  • Experience building and maintaining CI/CD pipelines for complex applications, including data and model versioning.
  • Proven track record of technical leadership and scaling production machine learning systems.
  • Ability to independently architect solutions for ambiguous infrastructure problems and articulate business value.
  • Experience decomposing large-scale systems and guiding teams through incremental delivery.
  • Exceptional written, verbal, and presentation skills with the ability to influence stakeholders at all levels.
  • Recognized technical leader who is proactive, strategic, and comfortable taking end-to-end ownership.
  • Generous, Curious, and Humble values alignment.
  • Direct experience productionizing LLMs, including prompting strategies, RAG, and fine-tuning, is preferred.
  • Deep expertise with Databricks, including MLflow, Delta Tables, and Unity Catalog, is preferred.
  • Experience building data annotation and Human-in-the-Loop systems from scratch is preferred.
  • Familiarity with vector databases such as Pinecone or Chroma and serving frameworks such as Ray Serve, Triton, or Databricks/Mosaic is preferred.
  • Experience working in a regulated healthcare environment and with HIPAA is preferred.
  • Ability to travel up to 10% may be required.
  • Must be currently authorized to work in the U.S. on a full-time basis; visa sponsorship is not available.

Benefits

  • Base salary range of $165,000 to $205,000.
  • Equity at hire.
  • Discretionary annual bonus based on company performance.
  • Eligibility for company benefits.
  • 401(k) plan.
  • Balanced and flexible work environment.
  • Competitive industry benefits.
  • Additional company perks.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Natera

Senior AI/ML Engineer

Natera 1K-5K Pharmaceuticals

Natera is hiring a Senior AI/ML Engineer to design and scale enterprise generative AI and machine learning platforms that support internal operations and external products in a regulated healthcare environment.

United States Full-time Lead Machine Learning Engineer
$126k-$157k
Apache Spark AWS CI/CD Datadog Encryption Generative AI HIPAA Kubeflow Kubernetes LLM Machine Learning MLflow MLOps Python PyTorch TensorFlow Terraform
48 minutes ago
STR

Principal Technical Staff

STR 251-1K Aerospace & Defense

STR’s Analytics and C2 Division is seeking a Principal Technical Staff leader for the Signals Exploitation and Tracking group to drive advanced algorithm and software programs for national security customers from research and development through contract execution and transition.

United States Full-time Lead Machine Learning Engineer Program Manager
$220k-$260k
Cybersecurity Machine Learning Statistics
55 minutes ago
Spotify

Senior Machine Learning Engineer - Personalization, Horizon

Spotify Media

Spotify’s Personalization team is hiring a Senior Machine Learning Engineer to help build new AI-driven listening experiences for millions of users across the Horizon product area.

United States North America Full-time Senior Machine Learning Engineer
$184k-$263k
Apache Spark AWS GCP Generative AI LLM Machine Learning NLP
1 hour, 15 minutes ago
FutureSight

Co-Founder & CEO - AI Reverse Logistics Orchestration Platform

FutureSight 11-50 Internet Software & Services

FutureSight is seeking a Co-Founder & CEO to build and lead an AI-native reverse logistics orchestration venture that helps commerce and supply chain organizations control post-sale costs, risk, and recovered value.

United States Full-time Lead Machine Learning Engineer Operations Manager
E-commerce Google Tag Manager LLM
1 hour, 23 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers