Senior Research Engineer

2 hours, 5 minutes ago
Full-time
Senior
Software Development
AssemblyAI

AssemblyAI

AssemblyAI is a leading provider of AI models for transcribing and understanding speech. Their Speech AI models offer accurate speech-to-text conversion, speaker detection, sentiment analysis, and more, enabling users to extract valuable insights from ...

Media
51-250
Founded 2017
$63M raised

Description

  • Increase experimental velocity by improving experiment launching, measurement, and debugging workflows.
  • Maintain and evolve the JAX training framework for scalable distributed TPU training.
  • Investigate data quality issues, build detection tools, and convert findings into measurable accuracy improvements.
  • Analyze production-model accuracy and develop evaluation harnesses to prioritize customer-impacting improvements.
  • Translate research prototypes into production-ready systems while modernizing architectures and infrastructure.
  • Optimize speech-language-model inference through serving architecture, quantization, speculative decoding, and related techniques.
  • Identify and resolve performance bottlenecks from low-level kernels, including XLA and Pallas, through high-level system design.
  • Collaborate with research, infrastructure, and production engineering teams to diagnose issues and deliver durable fixes.

Requirements

  • Expert-level proficiency with JAX, TPUs, Flax, Optax, and the XLA compilation pipeline.
  • Strong experience optimizing production inference systems, ideally for LLMs or speech models.
  • Deep understanding of large-scale distributed training, modern deep learning systems, and ML infrastructure practices.
  • Familiarity with continuous batching, KV-cache management, sharding strategies, and quantization.
  • Strong Python skills; C++ or Rust experience for kernel-level work is preferred.
  • Ability to define success metrics, rigorously evaluate results, and investigate unexplained improvements.
  • Willingness to work across the full ML pipeline, including data, evaluation, training, and production systems.
  • Experience refactoring and improving existing systems for performance and reliability.
  • Strong communication skills and a collaborative approach to prioritizing high-impact work.
  • Speech-to-text expertise, including ASR architectures, audio processing, or streaming inference, is preferred.

Benefits

  • Salary range of $270,000–$310,000 for U.S.-based candidates.
  • Opportunities for substantial ownership and impact on a small Research team.
  • Work on Voice AI systems serving millions of inference calls and extensive audio-processing workloads.
  • Inclusive workplace committed to equal opportunity and supporting employees from diverse backgrounds.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Research Engineer, Threat Intelligence

SecurityScorecard 251-1K IT Services

SecurityScorecard is hiring an engineering-focused Threat Intelligence team member to turn research findings into production-ready detections, feeds, and platform capabilities for STRIKE.

AWS CI/CD Cybersecurity Go Node.js Python Splunk SQL TypeScript
1 week, 3 days ago

Engineering Lead, Inference Optimization

Venice AI is hiring an Inference Optimization leader to drive technical strategy and scale privacy-focused LLM inference performance across its GPU infrastructure.

C++ Go Python Rust
1 week, 5 days ago

Senior Scientific Platform Engineer

VivoSense 11-50 Professional Services

VivoSense is hiring a Senior Scientific Platform Engineer to transform scientific and digital health workflows into scalable, production-ready platform capabilities for clinical studies and customer deliverables.

AWS C# CI/CD .NET Python R Serverless
1 week, 5 days ago

Associate Research Scientist, Real World Evidence

Precision AQ 1001-5000 Business Consulting and Services

Precision AQ is hiring a fully remote Associate Research Scientist on its Real-World Evidence team to support real-world studies in the pharmaceutical and biotech space.

Python R SQL
2 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers