RemoteLeaf Logo
Log in Sign up

Senior Software Developer: Models Team (Token Factory)

2 months ago
Netherlands
Full-time
Senior
AI Engineer
Software Development
Go Kubernetes LLM Python Serverless
Apply Now
Nebius

Nebius

Nebius enables B2B companies to build local hyperscaling cloud platforms with cost-effective GPUs, InfiniBand network, and 50% less compute cost. They offer managed Kubernetes and a launch-ready business model for innovative cloud solutions.

Internet Software & Services
51-250
View All Jobs 95

Description

  • Onboard state-of-the-art open-source models into Nebius Token Factory.
  • Serve large language models in production with strong reliability and scale.
  • Design and operate highly scalable, highly available distributed services.
  • Build and improve advanced inference and systems optimization techniques.
  • Maintain and extend forks of inference frameworks such as vLLM and TRT-LLM.
  • Support Solutions Architects on demanding customer proof-of-concepts.
  • Develop tooling and automation for testing, rollout, diagnostics, observability, and deployment optimization.
  • Collaborate with model builders, open-source communities, Nebius Cloud teams, and hardware vendors.
  • Work closely with teams focused on cloud infrastructure, observability, reliability, fault tolerance, and platform engineering.

Requirements

  • Experience serving LLMs in production.
  • Strong programming skills in Python and/or Go.
  • Experience designing and operating highly scalable, highly available distributed services.
  • Contributions to vLLM, SGLang, TRT-LLM, or NVIDIA ecosystem open-source projects are preferred.
  • Deep understanding of KV cache management, speculative decoding, and quantization is preferred.
  • Experience with LLM evaluation frameworks is preferred.
  • Hands-on experience with performance benchmarking and optimization is preferred.
  • Deep understanding of Kubernetes is preferred.
  • Familiarity with distributed serving architectures and autoscaling is preferred.
  • Knowledge of InfiniBand, RoCE, or high-performance networking is preferred.
  • Applicants must be authorized to work in the country where they apply and provide proof of employment eligibility.

Benefits

  • Competitive compensation.
  • Career growth and learning opportunities.
  • Flexibility and ownership in how work is done.
  • Collaborative and innovative team culture.
  • Opportunity to work on impactful AI projects.
  • International environment with talented teams.
  • Remote-friendly collaboration with periodic in-person team meetups.
  • Equal opportunity employer with inclusive hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

MKS2 Technologies

Artificial Intelligence Engineer

MKS2 Technologies 51-250 Internet Software & Services

MKS2 Technologies is seeking a remote Artificial Intelligence Engineer to technically lead the design, deployment, and optimization of AI and machine learning systems supporting a federal government program.

United States Full-time Lead AI Engineer
$180k-$210k
Cybersecurity Feature Engineering Generative AI Machine Learning NLP
16 hours, 37 minutes ago
Resolve to Save Lives

Backend Engineer

Resolve to Save Lives 51-250 Capital Markets

Resolve to Save Lives is seeking a remote Backend Engineer in India, Nigeria, or Ethiopia to build and maintain reliable digital health tools and integrations supporting large-scale cardiovascular, hypertension, and diabetes programs.

Ethiopia India Nigeria Contract Junior Backend Engineer
ActiveRecord AWS CI/CD Docker Grafana Java Kubernetes Machine Learning MLOps PostgreSQL Prometheus Python Ruby Ruby on Rails SQL
17 hours, 22 minutes ago
C

Senior Full-Stack AI Product Engineer

CGS Immersive 5001-10000 Enterprise learning

CGS is seeking a Senior Full-Stack AI Product Engineer to turn product requirements and UX concepts into polished, LLM-powered web products and evolve successful prototypes into maintainable production systems.

Canada Full-time Senior AI Engineer Full-stack Engineer
LLM Next.js React UX Design
17 hours, 52 minutes ago
3Pillar Global

Senior Software Engineer -Java( AI+Telecom)

3Pillar Global 1K-5K Internet Software & Services

As a Java Software Engineer at 3Pillar Global, you will build and deliver scalable, high-availability enterprise applications and collaborate with global client teams from technical design through launch.

India Full-time Senior Backend Engineer
Agile Apache C++ Hibernate HTTP JSON Microservices Oracle PostgreSQL Redis Spring Spring Boot SQL XML
18 hours, 7 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers