Senior Research Engineer (Code World Models)

1 month ago
JetBrains

JetBrains

JetBrains provides cutting-edge development tools like IntelliJ IDEA and Kotlin, automating tasks to boost productivity and foster innovation.

Internet Software & Services
1K-5K
Founded 2000

Description

  • Design and run pre-training, continued pre-training, and mid-training experiments for code models.
  • Build and improve large-scale data pipelines for model training, including filtering, deduplication, mixture design, and dataset quality checks.
  • Work with code corpora, repositories, tests, execution traces, and synthetic data.
  • Develop evaluations for complex repository-level code reasoning tasks.
  • Collaborate with researchers and engineers working on machine learning for code and AI developer tools.

Requirements

  • Hands-on experience with model pre-training, continued training, or mid-training.
  • Strong engineering skills in Python and experience with modern machine learning frameworks.
  • Understanding of large-scale ML training workflows, including data processing, distributed training, checkpointing, evaluation, experiment tracking, and debugging.
  • Experience working with large datasets and attention to data quality, contamination, sampling, and reproducibility.
  • Background in NLP, ML for software engineering, or a similar domain.
  • Ability to work on high-uncertainty research problems and turn ideas into working experiments.
  • Experience training or adapting models for code generation, code understanding, software agents, program repair, test generation, or repository-level reasoning is a plus.
  • Experience with execution-based data such as unit tests, traces, logs, compiler feedback, runtime states, or sandboxed code execution is a plus.
  • Experience with large-scale distributed training of models with 70B+ parameters is a plus.
  • Understanding of evaluation challenges for code models, including benchmark contamination, flaky tests, execution-based scoring, and long-horizon task evaluation is a plus.
  • Contributions to ML infrastructure, open-source projects, or research systems is a plus.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Security Engineer - Node.js Proactive Defense (worldwide remote, work anywhere)

CloudLinux 51-250 IT Services

CloudLinux is hiring an engineer-researcher to build a new runtime protection product for Node.js web apps running on managed hosting, from design through production rollout.

JavaScript Node.js PHP WAF WordPress
16 hours, 37 minutes ago

Senior Numerical Optimization Engineer

Anduril Industries 1K-5K Aerospace & Defense

Anduril Industries is hiring a Senior Numerical Optimization Engineer to build scheduling and optimization systems for its Maritime Digital Production team, supporting shipbuilding operations with rapid production replanning.

C++ CI/CD ERP IoT Java Microservices NumPy Pandas Python Rust SciPy
1 day, 16 hours ago

PhD Studentship: Causal Reinforcement Learning

Phaidra 51-250 Internet Software & Services

Phaidra is offering a fully funded 4-year PhD studentship with the University of Cambridge to research causal inference and reinforcement learning for robust AI control systems in industrial and data centre environments.

Machine Learning NumPy Python PyTorch Reinforcement Learning Scikit-learn SciPy
2 days, 16 hours ago

Research Contractor

FUTURESEARCH Internet Software & Services

FutureSearch is hiring a research contractor to help develop tasks for training and benchmarking frontier AI models in a highly research-driven environment.

3 days, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers