RemoteLeaf Logo
Log in Sign up

Senior Software Developer: Models Team (Token Factory)

3 months, 2 weeks ago
Netherlands
Full-time
Senior
AI Engineer
Software Development
Go Kubernetes LLM Python Serverless
Apply Now
Nebius

Nebius

Nebius enables B2B companies to build local hyperscaling cloud platforms with cost-effective GPUs, InfiniBand network, and 50% less compute cost. They offer managed Kubernetes and a launch-ready business model for innovative cloud solutions.

Internet Software & Services
51-250
View All Jobs 76

Description

  • Onboard state-of-the-art open-source models into Nebius Token Factory.
  • Serve large language models in production with strong reliability and scale.
  • Design and operate highly scalable, highly available distributed services.
  • Build and improve advanced inference and systems optimization techniques.
  • Maintain and extend forks of inference frameworks such as vLLM and TRT-LLM.
  • Support Solutions Architects on demanding customer proof-of-concepts.
  • Develop tooling and automation for testing, rollout, diagnostics, observability, and deployment optimization.
  • Collaborate with model builders, open-source communities, Nebius Cloud teams, and hardware vendors.
  • Work closely with teams focused on cloud infrastructure, observability, reliability, fault tolerance, and platform engineering.

Requirements

  • Experience serving LLMs in production.
  • Strong programming skills in Python and/or Go.
  • Experience designing and operating highly scalable, highly available distributed services.
  • Contributions to vLLM, SGLang, TRT-LLM, or NVIDIA ecosystem open-source projects are preferred.
  • Deep understanding of KV cache management, speculative decoding, and quantization is preferred.
  • Experience with LLM evaluation frameworks is preferred.
  • Hands-on experience with performance benchmarking and optimization is preferred.
  • Deep understanding of Kubernetes is preferred.
  • Familiarity with distributed serving architectures and autoscaling is preferred.
  • Knowledge of InfiniBand, RoCE, or high-performance networking is preferred.
  • Applicants must be authorized to work in the country where they apply and provide proof of employment eligibility.

Benefits

  • Competitive compensation.
  • Career growth and learning opportunities.
  • Flexibility and ownership in how work is done.
  • Collaborative and innovative team culture.
  • Opportunity to work on impactful AI projects.
  • International environment with talented teams.
  • Remote-friendly collaboration with periodic in-person team meetups.
  • Equal opportunity employer with inclusive hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lingaro

Fullstack Data Scientist - freelancer

Lingaro 5K-10K IT Services

Lead GenAI engineering initiatives by designing, building, evaluating, and governing production-ready AI applications and architectures for enterprise use cases.

Poland Freelance Senior AI Engineer Data Scientist
Apache Spark AWS Azure CI/CD Databricks Docker Generative AI GitHub Actions GitLab Kubernetes Machine Learning Microservices Python
3 hours, 58 minutes ago
CI&T

[Job-00023] Senior AI Engineer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior AI Engineer to build reliable AI-powered information extraction solutions and enhance a web application using LLMs, document intelligence, and full-stack engineering.

Brazil Full-time Senior AI Engineer Full-stack Engineer
Next.js Python React
3 hours, 58 minutes ago
CI&T

[Job 32221] SR. AI Engineer -Foco em Criação e Orquestração de Agentes (Agentic SDLC)

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Software Engineer Mid-Senior para arquitetar, construir e entregar soluções de software para clientes, usando agentic SDLC e IA aplicada da arquitetura ao código em produção.

Brazil Full-time Senior AI Engineer
CI/CD Microservices NestJS Node.js TypeScript
4 hours, 13 minutes ago
CareDx

Senior Data & AI Engineer

CareDx 251-1K Pharmaceuticals

CareDx is seeking a Senior Data and AI Engineer to build production data engineering and clinical NLP solutions that convert structured and unstructured EMR data into standardized, reliable transplant-focused clinical data for patient care, research, and business operations.

United States Full-time Senior AI Engineer
$126k-$158k
CI/CD Deep Learning Git HIPAA Machine Learning NLP Pandas Python PyTorch SQL TensorFlow
4 hours, 43 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers