RemoteLeaf Logo
Log in Sign up

Senior Machine Learning Engineer

2 weeks, 6 days ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
LLM Python PyTorch Vertex AI
Apply Now
Rubrik

Rubrik

Rubrik provides cutting-edge data security and protection solutions, including Zero Trust Data Protection and ransomware recovery, to ensure data readiness and business resilience.

IT Services
1K-5K
Founded 2014
$553M raised
View All Jobs 38

Description

  • Own the full lifecycle of production small language models and classifiers, from base-model selection and training through deployment and iteration.
  • Train, fine-tune, distill, and optimize models using supervised fine-tuning, preference optimization, adversarial training, and post-training techniques.
  • Build real-time and batch inference infrastructure for low-latency enforcement, offline scoring, back-testing, and corpus mining.
  • Optimize serving performance using GPU pooling, KV-cache-aware routing, continuous batching, quantization, and speculative decoding.
  • Design and maintain canary, shadow, and A/B traffic workflows to validate model changes on live customer traffic.
  • Build synthetic data pipelines, policy back-testing systems, and online/offline evaluation frameworks that detect regressions and quality issues.
  • Mine production signals, customer feedback, and agent-session insights to improve policies, reduce false positives, and surface security gaps.
  • Diagnose model failures across data, training, architecture, and serving layers and implement the correct fix in the right layer.
  • Partner with product, customer-facing, security, and platform teams to translate governance needs into modeling work and integrate models safely into production.
  • Provide technical leadership on a pillar of the model stack and mentor engineers working on applied ML systems.

Requirements

  • Bachelor's degree or higher in Computer Science, Machine Learning, Computer Engineering, Statistics, or a closely related technical field.
  • 2+ years of professional ML experience with end-to-end ownership of models in production.
  • Proficiency in Python and PyTorch, or equivalent tools, for training and evaluation.
  • Hands-on experience training, fine-tuning, or distilling language models or classifiers in production.
  • Experience with supervised fine-tuning and at least one preference-optimization method such as DPO, RLAIF, or RLHF.
  • Production experience with serving frameworks such as vLLM, SGLang, TensorRT-LLM, or equivalent.
  • Experience optimizing inference with continuous batching, KV-cache strategies, and inference-time quantization.
  • Experience designing closed-loop ML systems that connect evaluation, telemetry, data curation, and synthetic data back into training.
  • Comfort operating at production scale in high-QPS, safety-critical request paths with customer-visible consequences.
  • Preferred: deep background in AI safety and red-teaming, including adversarial ML and prompt-injection defense.
  • Preferred: expertise in evaluation methodology such as LLM-as-judge pipelines, calibration monitoring, and adversarial benchmarks.
  • Preferred: experience with context-fusion and retrieval systems that combine sensitivity, identity, and behavioral history.
  • Preferred: production experience with low-latency inference for streaming or safety-critical systems.
  • Preferred: knowledge of label-efficient training methods such as weak supervision, active learning, and embedding-based retrieval.
  • Preferred: hands-on knowledge distillation experience transferring frontier model capabilities to smaller production models.
  • Preferred: familiarity with tool-use frameworks, model gateway architectures such as MCP or LiteLLM, and autonomous agent patterns.
  • Preferred: active open-source contributions to mainstream ML training, serving, or evaluation libraries.

Benefits

  • US base salary range of $188,500 to $282,700.
  • Role is eligible for bonus potential.
  • Role is eligible for equity.
  • Role includes benefits.
  • Equal opportunity employer with accommodations available for qualified individuals with disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

SPD Technology

ML Engineering Lead

SPD Technology Internet Software & Services

SPD Technology is hiring a Machine Learning Engineering Lead to build and deliver production-grade ML services for PitchBook, bridging data science and enterprise software engineering on a collaborative, flexible team.

Moldova Poland Romania Bulgaria Spain Ukraine Full-time Lead Machine Learning Engineer Technical Lead
Agile AWS Elasticsearch FastAPI GCP GitOps Grafana Java Kafka Kubeflow Machine Learning Microservices MLflow Prometheus Python PyTorch Redis SageMaker Scrum SQL TensorFlow
16 hours, 54 minutes ago
CodeRoad

Senior Agentic AI Engineer

CodeRoad 51-250 Internet Software & Services

Coderoad is hiring a remote Agentic AI Engineer in LATAM to build and deploy AI prototypes for its procurement platform and related products within an AWS-based environment.

Latin America Full-time Senior AI Engineer Machine Learning Engineer
AWS CI/CD Machine Learning Python
17 hours, 9 minutes ago
CodeRoad

Machine Learning Operations Engineer (MLOps)

CodeRoad 51-250 Internet Software & Services

Coderoad is hiring a remote MLOps Engineer to design, deploy, and maintain autonomous AI systems for cross-functional projects in the LATAM region.

Latin America Contract Mid Level Machine Learning Engineer
AWS Bash CI/CD Docker GCP Git Grafana Kubernetes Prometheus Python PyTorch Terraform Vertex AI
17 hours, 9 minutes ago
Total Performance Consulting

Sr. AI/ML Engineer

Total Performance Consulting 51-250 Internet Software & Services

Senior AI/ML Engineer at Perform, responsible for building and improving LLM, NLP, and automation systems that turn unstructured data into usable insights while helping shape product direction with leadership.

Chile Colombia Costa Rica Dominican Republic Ecuador El Salvador Guatemala Honduras Panama Peru Uruguay Mexico Argentina Belize Brazil Senior Machine Learning Engineer
AWS Computer Vision JavaScript LLM Machine Learning MongoDB NLP Node.js Playwright Python React Selenium
17 hours, 24 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers