Nebius

Nebius

Nebius enables B2B companies to build local hyperscaling cloud platforms with cost-effective GPUs, InfiniBand network, and 50% less compute cost. They offer managed Kubernetes and a launch-ready business model for innovative cloud solutions.

Internet Software & Services
51-250

Description

  • Develop and improve advanced fine-tuning methods for large language models, including LoRA-based and full-parameter approaches.
  • Identify and reduce LLM inference bottlenecks to improve production speed and efficiency.
  • Build model training and evaluation pipelines in JAX for speculative decoding and scaling experiments.
  • Experiment with different model architectures, including dense and MoE and auto-regressive and parallel approaches.
  • Investigate low-precision training and inference methods such as FP8 and NVFP4/MXFP4 for supervised fine-tuning and reinforcement learning.
  • Work on large-scale AI systems that train and deploy foundation models across text, vision, audio, and multimodal use cases.
  • Collaborate on resource allocation decisions by deriving scaling laws and evaluating hardware and performance tradeoffs.
  • Contribute to the development of reliable, high-performance infrastructure for training and deploying models at massive scale.

Requirements

  • Strong theoretical understanding of machine learning and reinforcement learning.
  • Deep expertise in modern deep learning for language processing and generation.
  • Experience training large models across multiple computational nodes.
  • Understanding of large neural network performance topics such as sharding strategies, custom kernels, and hardware features.
  • Strong software engineering skills, with Python as the primary language.
  • Deep experience with modern deep learning frameworks, especially JAX.
  • Experience with contemporary software engineering practices, including CI/CD, version control, and unit testing.
  • Strong communication and leadership abilities.
  • Previous experience working with language models or similar NLP technologies is preferred.
  • Familiarity with LLM concepts such as MHA, RoPE, ZeRO/FSDP, Flash Attention, and quantization is preferred.
  • Experience building and delivering products in a dynamic startup-like environment is preferred.
  • Experience developing large distributed systems or high-load web services is preferred.
  • Open-source projects that demonstrate engineering ability are preferred.
  • Excellent English writing, articulation, and communication skills are preferred.

Benefits

  • Competitive salary and comprehensive benefits package.
  • Opportunities for professional growth within Nebius.
  • Flexible working arrangements.
  • A dynamic and collaborative work environment that values initiative and innovation.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior AI/ML Engineer

ALX Africa 1K-5K Diversified Consumer Services

ALX Africa is hiring a Senior AI/ML Engineer to build the core learner competency navigation engine for its AI learning platform, Project A.

LLM Machine Learning MLflow Python
3 hours, 12 minutes ago

LLMOps Engineer

ALX Africa 1K-5K Diversified Consumer Services

ALX Africa is hiring a full-time LLMOps Engineer to measure and improve the performance of its AI learning platform through evaluation, reporting, and collaboration with product and AI teams.

Python Statistics
3 hours, 27 minutes ago

Principal Applied AI Solutions Architect

phData 251-1K IT Services

phData is seeking a Principal Solutions Architect to lead client-facing AI/ML solution architecture, implementation, and lifecycle management for enterprise data and AI projects.

Apache Spark AWS Azure Databricks dbt Docker GCP HDFS Kafka Keras Kubernetes Linux MLflow MySQL Oracle Python SageMaker SAP Scikit-learn Snowflake SQL TensorFlow
4 hours, 42 minutes ago

Perception Engineer

Motional 1K-5K Automotive

Motional is hiring a Perception Engineer in Boston or remote U.S. to develop and improve AI perception systems for autonomous vehicles.

C++ Git Machine Learning Python PyTorch
1 day, 3 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers