Senior Machine Learning Engineer

4 months ago
Full-time
Senior
Software Development
RUNWARE

RUNWARE

RUNWARE provides an affordable API that enables AI developers to efficiently run image, video, and custom generative AI models without the need for extensive infrastructure or machine learning expertise.

Internet Software & Services
1-10
Founded 2023

Description

  • Integrate open-source and third-party models into the inference platform.
  • Lead fine-tuning initiatives using LoRA, adapters, PEFT, and domain adaptation techniques.
  • Optimize inference workloads for latency, batching, memory efficiency, and throughput.
  • Benchmark model quality, cost, and performance across multiple modalities.
  • Improve inference startup times and stability under high load.
  • Build evaluation frameworks and internal tooling for model validation.
  • Collaborate with Infrastructure and Backend teams on scalable serving systems.
  • Monitor production performance and drive continuous optimization.
  • Mentor engineers and help raise the ML engineering standards across the team.

Requirements

  • Proven experience delivering machine learning systems to production environments.
  • Strong low-level Python skills and deep hands-on experience with PyTorch.
  • Experience working with diffusion models, LLMs, or multimodal architectures.
  • Practical experience fine-tuning large models using LoRA, PEFT, adapters, or similar methods.
  • Experience optimizing inference workloads in GPU environments.
  • Strong understanding of model evaluation, experimentation, and monitoring.
  • Ability to debug performance, memory, and reliability issues in production.
  • Strong systems thinking and understanding of how ML decisions impact infrastructure.
  • High ownership and comfort operating in a fast-paced startup environment.
  • Experience with vLLM or custom inference servers is preferred.
  • Experience with Kubernetes or containerised ML workloads is preferred.
  • Experience working in high-throughput distributed systems is preferred.
  • Background in AI media generation, including image, video, or audio, is preferred.
  • Experience building internal ML tooling or developer-facing APIs is preferred.
  • Experience with CUDA/C++ kernels is preferred.

Benefits

  • Remote-first setup with the ability to work from home anywhere the company can employ you.
  • Flexible hours outside core collaboration blocks.
  • Generous paid time off, including vacation, sick days, and public holidays.
  • Meaningful stock options.
  • Paid family leave for maternity, paternity, and caregiver time.
  • Company retreats twice a year in inspiring locations.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Machine Learning Infrastructure Engineer, Embedding Platform

Reddit 1K-5K Internet Software & Services

Reddit is hiring a Senior Machine Learning Infrastructure Engineer to build large-scale learning systems that improve recommendation and personalization across its platform.

Deep Learning Machine Learning Python PyTorch System Design TensorFlow
11 hours, 3 minutes ago

Mid Machine Learning Engineer

Coforge 10K-50K IT Services

Coforge is hiring a Mid Machine Learning Engineer to build and operate production machine learning solutions and pipelines in a remote role for candidates based in Costa Rica, Peru, Colombia, or Bolivia.

Agile Apache Airflow dbt Git LLM Machine Learning MLflow MLOps Python SageMaker Snowflake SQL Vertex AI
11 hours, 48 minutes ago

Senior AI Full Stack Engineer

Coforge 10K-50K IT Services

Coforge is hiring a remote Senior AI Full Stack Engineer in LATAM to build AI-enabled data and application solutions across big-data, cloud, and customer-facing systems.

Angular Azure CI/CD Databricks Generative AI GraphQL Java Microservices Node.js Python React REST API Scala Vue.js
11 hours, 48 minutes ago

(Canada) Principal ML System Engineer

PointClickCare 1K-5K Health Care Providers & Services

PointClickCare is hiring a Principal AI Machine Learning Platform Engineer to lead the strategy and architecture for its ML and generative AI platform used across the company.

AWS Azure CI/CD Databricks Docker GCP Java Kubeflow Kubernetes Machine Learning MLflow MLOps Network Security Python Serverless
1 day, 11 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers