JetBrains

JetBrains

JetBrains provides cutting-edge development tools like IntelliJ IDEA and Kotlin, automating tasks to boost productivity and foster innovation.

Internet Software & Services
1K-5K
Founded 2000

Description

  • Design, implement, and maintain SFT and RL post-training pipelines for multi-step coding agents.
  • Train and adapt large language models for planning, tool use, and multi-step interactions in JetBrains IDEs.
  • Build simulation and evaluation environments where coding agents can perform and be measured on realistic developer tasks.
  • Design evaluation frameworks and metrics for agent behavior, and use traces and logs to improve training, data, and reward design.
  • Analyze training and evaluation results to improve model architectures, training recipes, and datasets.
  • Work with distributed GPU clusters and MapReduce-style infrastructure for training and data processing.
  • Collaborate with research, product, and infrastructure teams to turn product goals into models, experiments, and shipped features.

Requirements

  • Extensive hands-on experience training LLMs in pre-training, fine-tuning, or post-training settings.
  • Deep expertise in PyTorch and specialized LLM training stacks such as Megatron, NeMo, or verl.
  • Strong understanding of LLM fundamentals, including architectures, tokenization, data pipelines, batching, mixed precision, distributed training, and debugging unstable runs.
  • Ability to own projects end to end from problem definition through design, experimentation, implementation, and iteration.
  • Product-aware mindset with the ability to translate developer needs and failure modes into modeling and evaluation work.
  • At least 3 years of Python experience writing clean, maintainable code in modern ML codebases.
  • Experience with ML orchestrators or workflow tools such as Kubeflow, Dagster, Airflow, or ZenML, or schedulers like Kubernetes or SLURM (preferred).
  • Experience with large-scale data and training pipelines, including MapReduce-style clusters, multi-node GPU training, or workloads around 1M+ CPU/GPU hours (preferred).
  • Experience designing and maintaining evaluation pipelines for LLMs or agents, including metrics, dashboards, experiment tracking, and automated regression checks (preferred).
  • Experience with AI agent development, including tool-using agents, planners, or multi-step coding workflows (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lead Bioinformatician (cfDNA Algorithms and Pipelines)

Natera 1K-5K Pharmaceuticals

Natera is hiring a Lead Bioinformatician to develop and support the computational methods behind diagnostic sequencing assays for women’s and organ health.

Prototyping Python
1 day, 11 hours ago

Associate Director of Bioinformatics (Women's Health and Organ Health)

Natera 1K-5K Pharmaceuticals

Natera is hiring an Associate Director to lead bioinformatics research and assay-development work for women’s health and organ health diagnostics, with responsibility for guiding a team and transitioning new methods into production.

AWS CI/CD Docker GCP Git Java Kubernetes Machine Learning Python R Shell Scripting
1 day, 12 hours ago

Senior Security Research Engineer

PlayStation 100K+ Household Durables

Sony Interactive Entertainment is hiring a Senior Security Research Engineer to lead Global Vulnerability Management efforts that advance its Threat Exposure Management program and strengthen security risk reduction across the PlayStation ecosystem.

Bash CI/CD Domo Git JavaScript PowerShell Python Snowflake SQL
4 days, 12 hours ago

Research Engineer

Weekday 11-50 Construction & Engineering

Weekday is hiring a Research Engineer for one of its clients to help develop next-generation AI/ML voice agents for production conversational systems in India.

AWS Azure Deep Learning GCP Generative AI Hugging Face LLM Machine Learning NLP Python PyTorch TensorFlow Transformers
4 days, 12 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers