RemoteLeaf Logo
Log in Sign up

Senior Software Developer: Models Team (Token Factory)

2 months, 3 weeks ago
Netherlands
Full-time
Senior
AI Engineer
Software Development
Go Kubernetes LLM Python Serverless
Apply Now
Nebius

Nebius

Nebius enables B2B companies to build local hyperscaling cloud platforms with cost-effective GPUs, InfiniBand network, and 50% less compute cost. They offer managed Kubernetes and a launch-ready business model for innovative cloud solutions.

Internet Software & Services
51-250
View All Jobs 85

Description

  • Onboard state-of-the-art open-source models into Nebius Token Factory.
  • Serve large language models in production with strong reliability and scale.
  • Design and operate highly scalable, highly available distributed services.
  • Build and improve advanced inference and systems optimization techniques.
  • Maintain and extend forks of inference frameworks such as vLLM and TRT-LLM.
  • Support Solutions Architects on demanding customer proof-of-concepts.
  • Develop tooling and automation for testing, rollout, diagnostics, observability, and deployment optimization.
  • Collaborate with model builders, open-source communities, Nebius Cloud teams, and hardware vendors.
  • Work closely with teams focused on cloud infrastructure, observability, reliability, fault tolerance, and platform engineering.

Requirements

  • Experience serving LLMs in production.
  • Strong programming skills in Python and/or Go.
  • Experience designing and operating highly scalable, highly available distributed services.
  • Contributions to vLLM, SGLang, TRT-LLM, or NVIDIA ecosystem open-source projects are preferred.
  • Deep understanding of KV cache management, speculative decoding, and quantization is preferred.
  • Experience with LLM evaluation frameworks is preferred.
  • Hands-on experience with performance benchmarking and optimization is preferred.
  • Deep understanding of Kubernetes is preferred.
  • Familiarity with distributed serving architectures and autoscaling is preferred.
  • Knowledge of InfiniBand, RoCE, or high-performance networking is preferred.
  • Applicants must be authorized to work in the country where they apply and provide proof of employment eligibility.

Benefits

  • Competitive compensation.
  • Career growth and learning opportunities.
  • Flexibility and ownership in how work is done.
  • Collaborative and innovative team culture.
  • Opportunity to work on impactful AI projects.
  • International environment with talented teams.
  • Remote-friendly collaboration with periodic in-person team meetups.
  • Equal opportunity employer with inclusive hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Typeform

Staff AI Engineer - US

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow and other customer-facing products, from experimentation through scalable production delivery.

United States United Kingdom Netherlands Portugal Spain Germany Ireland Full-time Lead AI Engineer
$170k-$210k
Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning Microservices MLflow OpenSearch Python PyTorch REST API SageMaker Snowflake SQL Terraform
27 minutes ago
Tailscale

Backend Engineer, Control Plane

Tailscale 51-250 Diversified Telecommunication Services

Tailscale is hiring a full-time Software Engineer for its fully distributed Control Plane Team to build and operate secure control-plane software, relay infrastructure, identity integrations, and related services.

United Kingdom Full-time Mid Level Backend Engineer
$164k-$227k
Go SQL
27 minutes ago
Harford County Public Library

[Crédito] Software Engineer III - C#

Harford County Public Library 51-250 Diversified Consumer Services

A Stone busca uma pessoa Software Engineer Pleno para desenvolver soluções em C# e atuar na resolução de problemas complexos relacionados a produtos financeiros e plataformas de engenharia.

Brazil Full-time Mid Level Backend Engineer
Azure C# CI/CD Datadog Docker Elasticsearch GCP Git GitFlow Kafka Kanban Microservices RabbitMQ Scrum Solid.js
42 minutes ago
Typeform

Staff AI Engineer - EU

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow, turning research concepts into secure, scalable, and dependable customer experiences.

United Kingdom Netherlands Portugal Spain Germany Ireland Full-time Lead AI Engineer
Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning MLflow OpenSearch Python PyTorch SageMaker Snowflake SQL Terraform
1 hour, 12 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers