Senior Machine Learning Engineer

3 weeks, 6 days ago
Full-time
Senior
Software Development
RUNWARE

RUNWARE

RUNWARE provides an affordable API that enables AI developers to efficiently run image, video, and custom generative AI models without the need for extensive infrastructure or machine learning expertise.

Internet Software & Services
1-10
Founded 2023

Description

  • Integrate open-source and third-party models into the inference platform.
  • Lead fine-tuning initiatives using LoRA, adapters, PEFT, and domain adaptation techniques.
  • Optimize inference workloads for latency, batching, memory efficiency, and throughput.
  • Benchmark model quality, cost, and performance across multiple modalities.
  • Improve inference startup times and stability under high load.
  • Build evaluation frameworks and internal tooling for model validation.
  • Collaborate with Infrastructure and Backend teams on scalable serving systems.
  • Monitor production performance and drive continuous optimization.
  • Mentor engineers and help raise the ML engineering standards across the team.

Requirements

  • Proven experience delivering machine learning systems to production environments.
  • Strong low-level Python skills and deep hands-on experience with PyTorch.
  • Experience working with diffusion models, LLMs, or multimodal architectures.
  • Practical experience fine-tuning large models using LoRA, PEFT, adapters, or similar methods.
  • Experience optimizing inference workloads in GPU environments.
  • Strong understanding of model evaluation, experimentation, and monitoring.
  • Ability to debug performance, memory, and reliability issues in production.
  • Strong systems thinking and understanding of how ML decisions impact infrastructure.
  • High ownership and comfort operating in a fast-paced startup environment.
  • Experience with vLLM or custom inference servers is preferred.
  • Experience with Kubernetes or containerised ML workloads is preferred.
  • Experience working in high-throughput distributed systems is preferred.
  • Background in AI media generation, including image, video, or audio, is preferred.
  • Experience building internal ML tooling or developer-facing APIs is preferred.
  • Experience with CUDA/C++ kernels is preferred.

Benefits

  • Remote-first setup with the ability to work from home anywhere the company can employ you.
  • Flexible hours outside core collaboration blocks.
  • Generous paid time off, including vacation, sick days, and public holidays.
  • Meaningful stock options.
  • Paid family leave for maternity, paternity, and caregiver time.
  • Company retreats twice a year in inspiring locations.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Co-founder & Chief Technology Officer - AI ROI Measurement Platform

FutureSight 11-50 Internet Software & Services

FutureSight is seeking a Co-Founder & CTO to build and lead a new AI ROI measurement and governance platform for enterprise customers from the ground up.

GitHub JIRA LLM
43 minutes ago

Machine Learning Developer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking part-time machine learning specialists for project-based work creating and evaluating computational STEM problems for AI systems.

Generative AI LLM Machine Learning MLOps NumPy Pandas Python PyTorch Scikit-learn SciPy SQL TensorFlow
5 hours ago

Machine Learning Developer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking part-time ML specialists for project-based AI work focused on testing, evaluating, and improving AI systems through the creation and verification of challenging computational STEM problems.

Generative AI LLM Machine Learning MLOps NumPy Pandas Python PyTorch Scikit-learn SciPy SQL TensorFlow
5 hours, 32 minutes ago

Systems & AI Cloud Architect

Endeavour. Inspired Infrastructure. 11-50 Electric Utilities

Endeavour is seeking a remote Systems & AI Cloud Architect to support its IT ecosystem by shaping enterprise architecture, modernizing infrastructure, and enabling scalable AI and cloud solutions for sustainable infrastructure initiatives.

AWS Azure CI/CD Cybersecurity GCP Generative AI Machine Learning Microservices MLOps
6 hours, 31 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers