RemoteLeaf Logo
Log in Sign up

Research Engineer (Agentic Models)

5 months, 3 weeks ago
Serbia, Spain, United Kingdom, Czech Republic, Germany, Netherlands, Poland, Cyprus, Armenia
Senior
Research Scientist
Software Development
Apache Airflow Dagster Kubeflow Kubernetes LLM MapReduce MLflow Python PyTorch
Apply Now
JetBrains

JetBrains

JetBrains provides cutting-edge development tools like IntelliJ IDEA and Kotlin, automating tasks to boost productivity and foster innovation.

Internet Software & Services
1K-5K
Founded 2000
View All Jobs 13

Description

  • Design, implement, and maintain SFT and RL post-training pipelines for multi-step coding agents.
  • Train and adapt large language models for planning, tool use, and multi-step interactions in JetBrains IDEs.
  • Build simulation and evaluation environments where coding agents can perform and be measured on realistic developer tasks.
  • Design evaluation frameworks and metrics for agent behavior, and use traces and logs to improve training, data, and reward design.
  • Analyze training and evaluation results to improve model architectures, training recipes, and datasets.
  • Work with distributed GPU clusters and MapReduce-style infrastructure for training and data processing.
  • Collaborate with research, product, and infrastructure teams to turn product goals into models, experiments, and shipped features.

Requirements

  • Extensive hands-on experience training LLMs in pre-training, fine-tuning, or post-training settings.
  • Deep expertise in PyTorch and specialized LLM training stacks such as Megatron, NeMo, or verl.
  • Strong understanding of LLM fundamentals, including architectures, tokenization, data pipelines, batching, mixed precision, distributed training, and debugging unstable runs.
  • Ability to own projects end to end from problem definition through design, experimentation, implementation, and iteration.
  • Product-aware mindset with the ability to translate developer needs and failure modes into modeling and evaluation work.
  • At least 3 years of Python experience writing clean, maintainable code in modern ML codebases.
  • Experience with ML orchestrators or workflow tools such as Kubeflow, Dagster, Airflow, or ZenML, or schedulers like Kubernetes or SLURM (preferred).
  • Experience with large-scale data and training pipelines, including MapReduce-style clusters, multi-node GPU training, or workloads around 1M+ CPU/GPU hours (preferred).
  • Experience designing and maintaining evaluation pipelines for LLMs or agents, including metrics, dashboards, experiment tracking, and automated regression checks (preferred).
  • Experience with AI agent development, including tool-using agents, planners, or multi-step coding workflows (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Gramian Consultancy Group

Life Sciences Researcher (AI Evaluation)

Gramian Consultancy Group Professional Services

Gramian Consultancy is seeking experienced Life Sciences researchers and subject-matter experts to create rigorous, non-coding scientific reasoning tasks for an AI evaluation benchmark in biology and related disciplines.

Mexico Argentina Brazil Chile Colombia Peru Egypt Saudi Arabia Turkey Bangladesh India Indonesia Nepal Sri Lanka Ghana Nigeria Contract Lead AI (Artificial Intelligence) Research Scientist
20 hours, 54 minutes ago
Edmentum

Research Scientist, Applied AI Research

Edmentum 1K-5K Diversified Consumer Services

Edmentum is seeking a Research Scientist to conduct applied AI and psychometric research evaluating the reliability, validity, and fairness of educational products, collaborating with internal teams and external researchers in a remote-first environment.

United States Full-time Junior Research Scientist
$90k-$100k
Python R Statistics
4 days, 20 hours ago
Halo Materials

Head of Atmospheric Research - Remote

Halo Materials

Roadrunner Venture Studios is seeking a Head of Atmospheric Research for a portfolio company developing rainfall enhancement technology, leading atmospheric science, modeling, validation, and deployment operations.

United States Full-time Executive Research Scientist
C++ Fortran Linux Machine Learning Python
5 days, 20 hours ago
Edmentum

Manager, Applied AI Research

Edmentum 1K-5K Diversified Consumer Services

Edmentum is seeking a Manager, Applied AI Research to lead evidence-based research evaluating the reliability, validity, and fairness of AI-enabled educational features and guide product and policy decisions.

United States Full-time Lead Research Scientist
$145k-$155k
Statistics
6 days, 20 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers