RemoteLeaf Logo
Log in Sign up

Senior Engineering Manager, AI

1 month, 2 weeks ago
United States
Full-time
Lead
Engineering Manager
Software Development
Envoy Java LLM Python
Apply Now
Alphasense

Alphasense

Alphasense is a global leader in providing high-quality gas sensors and air quality monitors to industrial OEMs. With over 25 years of experience, the company offers a wide range of innovative gas sensor technologies for various applications, including...

Industrial Conglomerates
51-250
Founded 1996
View All Jobs 77

Description

  • Manage, mentor, and grow a team of up to 10 senior and staff software engineers.
  • Build a high-performance culture focused on technical excellence, predictable delivery, and career growth.
  • Own the strategy and architecture of the enterprise AI Gateway.
  • Ensure high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms for LLM traffic.
  • Lead the integration, evaluation, and management of 6+ major LLM vendors and 50+ models.
  • Optimize gateway performance across latency, cost, and reliability.
  • Partner with product management, AI research, and executive engineering leaders to align roadmap and goals.
  • Define and champion engineering best practices, architectural standards, and token-based cost-tracking telemetry.
  • Participate in high-level architectural discussions and provide technical direction and feedback.

Requirements

  • Strong track record of managing and growing high-performing teams of senior and staff engineers.
  • Deep experience running high-performance teams in an engineering leadership role.
  • Background in designing, building, and operating high-throughput, low-latency distributed systems.
  • Experience with complex routing, caching, queueing, or rate limiting in enterprise-scale systems.
  • Hands-on familiarity with multi-vendor integrations.
  • Exceptional communication and strategic collaboration skills.
  • Ability to align engineering objectives with business strategy and stakeholder expectations.
  • Nice to have: experience in applied AI or with LangChain, LangGraph, LiteLLM, or OpenRouter.
  • Nice to have: experience with orchestrators and proxies such as Temporal or Envoy.
  • Nice to have: experience with Python, Java, and highly distributed caching/queueing systems.

Benefits

  • Base salary range of $275,000 to $375,000 USD.
  • Potential equity grant.
  • Generous benefits program.
  • Equal-opportunity employer with a respectful and inclusive work environment.
  • Reasonable accommodation for qualified employees with protected disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Rush Street Interactive

Manager, Software Engineering

Rush Street Interactive 251-1K Hotels, Restaurants & Leisure

Rush Street Interactive is hiring a Manager, Software Engineering to lead engineering teams and cross-functional delivery for its online casino and sports betting platforms, with accountability for people development, quality, reliability, and business outcomes.

Colombia Full-time Mid Level Engineering Manager
Agile
2 days, 22 hours ago
Plume

Engineering Manager

Plume 51-250 Family Services

Plume is hiring an Engineering Manager to lead software and QA teams while contributing hands-on to the architecture, quality, security, and delivery of its gender-affirming telehealth platform.

United States Full-time Lead Engineering Manager
$162k-$170k
Agile AWS CI/CD Cypress HIPAA Jest Node.js Playwright PostgreSQL Python React Terraform
2 days, 23 hours ago
Warner Music Group

Engineering Manager, Forward Deployed Engineering

Warner Music Group 5K-10K Media

Warner Music Group is hiring an Engineering Manager for its Forward Deployed Engineering team to lead embedded engineers and build a scalable, governed model for delivering AI and automation solutions across global business units.

Canada Full-time Lead Engineering Manager
Agile Databricks Machine Learning
3 days, 22 hours ago
BlackSky

Mission Management, Software Engineering Manager

BlackSky 251-1K Professional Services

BlackSky is seeking a Software Engineering Manager to lead the Mission Management team developing and operating autonomous software that plans imaging and communications across its satellite constellation.

United States Full-time Lead Engineering Manager
$165k-$205k
Ansible AWS Azure C++ CI/CD Git Go Kubernetes Microservices Nomad Python Terraform
3 days, 23 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers