Senior Research Engineer

1 month, 2 weeks ago
Full-time
Senior
Software Development
AssemblyAI

AssemblyAI

AssemblyAI is a leading provider of AI models for transcribing and understanding speech. Their Speech AI models offer accurate speech-to-text conversion, speaker detection, sentiment analysis, and more, enabling users to extract valuable insights from ...

Media
51-250
Founded 2017
$63M raised

Description

  • Increase experimental velocity by improving experiment launching, measurement, and debugging workflows.
  • Maintain and evolve the JAX training framework for scalable distributed TPU training.
  • Investigate data quality issues, build detection tools, and convert findings into measurable accuracy improvements.
  • Analyze production-model accuracy and develop evaluation harnesses to prioritize customer-impacting improvements.
  • Translate research prototypes into production-ready systems while modernizing architectures and infrastructure.
  • Optimize speech-language-model inference through serving architecture, quantization, speculative decoding, and related techniques.
  • Identify and resolve performance bottlenecks from low-level kernels, including XLA and Pallas, through high-level system design.
  • Collaborate with research, infrastructure, and production engineering teams to diagnose issues and deliver durable fixes.

Requirements

  • Expert-level proficiency with JAX, TPUs, Flax, Optax, and the XLA compilation pipeline.
  • Strong experience optimizing production inference systems, ideally for LLMs or speech models.
  • Deep understanding of large-scale distributed training, modern deep learning systems, and ML infrastructure practices.
  • Familiarity with continuous batching, KV-cache management, sharding strategies, and quantization.
  • Strong Python skills; C++ or Rust experience for kernel-level work is preferred.
  • Ability to define success metrics, rigorously evaluate results, and investigate unexplained improvements.
  • Willingness to work across the full ML pipeline, including data, evaluation, training, and production systems.
  • Experience refactoring and improving existing systems for performance and reliability.
  • Strong communication skills and a collaborative approach to prioritizing high-impact work.
  • Speech-to-text expertise, including ASR architectures, audio processing, or streaming inference, is preferred.

Benefits

  • Salary range of $270,000–$310,000 for U.S.-based candidates.
  • Opportunities for substantial ownership and impact on a small Research team.
  • Work on Voice AI systems serving millions of inference calls and extensive audio-processing workloads.
  • Inclusive workplace committed to equal opportunity and supporting employees from diverse backgrounds.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sr. Applied AI/ML Scientist (B2B)

Sprout Social 251-1K Professional Services

NewsWhip by Sprout Social is hiring a Senior Applied AI/ML Scientist in Poland to build and guide production LLM systems that transform real-time news data into reliable intelligence for journalists, PR professionals, and global brands.

Datadog Python
1 week, 5 days ago

Research Scientist, Applied AI Research

Edmentum 1K-5K Diversified Consumer Services

Edmentum is seeking a Research Scientist to conduct applied AI and psychometric research evaluating the reliability, validity, and fairness of educational products, collaborating with internal teams and external researchers in a remote-first environment.

Python R Statistics
2 weeks, 5 days ago

Manager, Applied AI Research

Edmentum 1K-5K Diversified Consumer Services

Edmentum is seeking a Manager, Applied AI Research to lead evidence-based research evaluating the reliability, validity, and fairness of AI-enabled educational features and guide product and policy decisions.

Statistics
3 weeks ago

Staff Research Scientist

Turing 251-1K Internet Software & Services

Turing is hiring Research Scientists to develop rigorous benchmarks, datasets, and methodologies for evaluating and improving frontier AI systems in collaboration with leading AI labs and enterprises.

Machine Learning Python Reinforcement Learning
3 weeks, 4 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers