RemoteLeaf Logo
Log in Sign up

Senior Engineering Manager, AI

2 months, 1 week ago
United States
Full-time
Lead
Engineering Manager
Software Development
Envoy Java LLM Python
Apply Now
Alphasense

Alphasense

Alphasense is a global leader in providing high-quality gas sensors and air quality monitors to industrial OEMs. With over 25 years of experience, the company offers a wide range of innovative gas sensor technologies for various applications, including...

Industrial Conglomerates
51-250
Founded 1996
View All Jobs 80

Description

  • Manage, mentor, and grow a team of up to 10 senior and staff software engineers.
  • Build a high-performance culture focused on technical excellence, predictable delivery, and career growth.
  • Own the strategy and architecture of the enterprise AI Gateway.
  • Ensure high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms for LLM traffic.
  • Lead the integration, evaluation, and management of 6+ major LLM vendors and 50+ models.
  • Optimize gateway performance across latency, cost, and reliability.
  • Partner with product management, AI research, and executive engineering leaders to align roadmap and goals.
  • Define and champion engineering best practices, architectural standards, and token-based cost-tracking telemetry.
  • Participate in high-level architectural discussions and provide technical direction and feedback.

Requirements

  • Strong track record of managing and growing high-performing teams of senior and staff engineers.
  • Deep experience running high-performance teams in an engineering leadership role.
  • Background in designing, building, and operating high-throughput, low-latency distributed systems.
  • Experience with complex routing, caching, queueing, or rate limiting in enterprise-scale systems.
  • Hands-on familiarity with multi-vendor integrations.
  • Exceptional communication and strategic collaboration skills.
  • Ability to align engineering objectives with business strategy and stakeholder expectations.
  • Nice to have: experience in applied AI or with LangChain, LangGraph, LiteLLM, or OpenRouter.
  • Nice to have: experience with orchestrators and proxies such as Temporal or Envoy.
  • Nice to have: experience with Python, Java, and highly distributed caching/queueing systems.

Benefits

  • Base salary range of $275,000 to $375,000 USD.
  • Potential equity grant.
  • Generous benefits program.
  • Equal-opportunity employer with a respectful and inclusive work environment.
  • Reasonable accommodation for qualified employees with protected disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sunrise Group

Software engineering manager

Sunrise Group 51-250 Internet Software & Services

Sunrise Group, a digital health company operating the Dreem Health online sleep clinic, is hiring an Engineering Manager to lead multiple product squads building at-home sleep diagnosis and treatment products.

Belgium Full-time Lead Engineering Manager
Django React
4 hours, 52 minutes ago
RUNWARE

Engineering Manager

RUNWARE 1-10 Internet Software & Services

Runware is hiring a hands-on Engineering Manager to lead and grow core engineering teams while driving predictable delivery, technical quality, and the scalability of its platform in a fully remote environment.

United Kingdom Full-time Lead Engineering Manager
CI/CD Go PHP Python Rust System Design
5 hours, 7 minutes ago
CoreWeave

Engineering Manager, Launch & Sandboxes

CoreWeave 251-1K Internet Software & Services

CoreWeave is seeking an Engineering Manager to lead its Launch & Sandboxes team, building infrastructure that connects developer workflows with GPU-enabled compute and helps customers run and scale AI workloads.

United States Full-time Lead Engineering Manager
$165k-$242k
Go Kubernetes Python
1 day, 4 hours ago
Vestd

Engineering Manager - India

Vestd 51-250 Capital Markets

Vestd is seeking an India-based Engineering Manager to lead and develop software engineers, improve delivery practices, and contribute hands-on to its remote-first equity-management platform.

India Full-time Lead Engineering Manager
Up to $65k
Prototyping
2 days, 4 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers