RemoteLeaf Logo
Log in Sign up

Senior Software Developer: Models Team (Token Factory)

1 month, 2 weeks ago
Netherlands
Full-time
Senior
AI Engineer
Software Development
Go Kubernetes LLM Python Serverless
Apply Now
Nebius

Nebius

Nebius enables B2B companies to build local hyperscaling cloud platforms with cost-effective GPUs, InfiniBand network, and 50% less compute cost. They offer managed Kubernetes and a launch-ready business model for innovative cloud solutions.

Internet Software & Services
51-250
View All Jobs 102

Description

  • Onboard state-of-the-art open-source models into Nebius Token Factory.
  • Serve large language models in production with strong reliability and scale.
  • Design and operate highly scalable, highly available distributed services.
  • Build and improve advanced inference and systems optimization techniques.
  • Maintain and extend forks of inference frameworks such as vLLM and TRT-LLM.
  • Support Solutions Architects on demanding customer proof-of-concepts.
  • Develop tooling and automation for testing, rollout, diagnostics, observability, and deployment optimization.
  • Collaborate with model builders, open-source communities, Nebius Cloud teams, and hardware vendors.
  • Work closely with teams focused on cloud infrastructure, observability, reliability, fault tolerance, and platform engineering.

Requirements

  • Experience serving LLMs in production.
  • Strong programming skills in Python and/or Go.
  • Experience designing and operating highly scalable, highly available distributed services.
  • Contributions to vLLM, SGLang, TRT-LLM, or NVIDIA ecosystem open-source projects are preferred.
  • Deep understanding of KV cache management, speculative decoding, and quantization is preferred.
  • Experience with LLM evaluation frameworks is preferred.
  • Hands-on experience with performance benchmarking and optimization is preferred.
  • Deep understanding of Kubernetes is preferred.
  • Familiarity with distributed serving architectures and autoscaling is preferred.
  • Knowledge of InfiniBand, RoCE, or high-performance networking is preferred.
  • Applicants must be authorized to work in the country where they apply and provide proof of employment eligibility.

Benefits

  • Competitive compensation.
  • Career growth and learning opportunities.
  • Flexibility and ownership in how work is done.
  • Collaborative and innovative team culture.
  • Opportunity to work on impactful AI projects.
  • International environment with talented teams.
  • Remote-friendly collaboration with periodic in-person team meetups.
  • Equal opportunity employer with inclusive hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

ShopMy

Senior Full Stack Engineer

ShopMy 11-50 Internet Software & Services

Senior Full Stack Engineer at ShopMy, working on the platform behind creator-driven commerce to build and scale APIs, user interfaces, and internal systems.

Europe Full-time Senior Backend Engineer Full-stack Engineer
AWS JavaScript Node.js React Sass UI Design
15 hours, 45 minutes ago
Eltropy

Senior Backend Engineer

Eltropy 51-250 Communications Equipment

Senior Backend Engineer at a remote company, responsible for building and supporting backend systems and APIs that are efficient, scalable, and reliable.

India Senior Backend Engineer
AWS Docker Git Go Java Kubernetes MongoDB Node.js PHP PostgreSQL Redis SQL
16 hours ago
Underdog Fantasy

Senior Software Engineer - Exchange

Underdog Fantasy Media

Underdog is hiring an engineer to build and scale the core exchange infrastructure powering its prediction markets offering, with a focus on low-latency, high-reliability systems.

United States Full-time Senior Backend Engineer
$160k-$240k
C C++ Go Java REST API Rust System Design WebSockets
16 hours ago
PandaDoc

Senior Python Engineer, Document App

PandaDoc 251-1K Internet Software & Services

PandaDoc is hiring a Senior Python Engineer for its Document App Track to help evolve the core document domain that powers document creation, editing, and management across its global platform.

Ukraine Full-time Senior Backend Engineer
Agile AWS Django Docker Grafana Kafka Kubernetes Memcached Microservices NATS PostgreSQL Python RabbitMQ Redis SQL
16 hours, 30 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers