RemoteLeaf Logo
Log in Sign up

Senior Engineering Manager, AI

4 weeks, 2 days ago
United States
Full-time
Lead
Engineering Manager
Software Development
Envoy Java LLM Python
Apply Now
Alphasense

Alphasense

Alphasense is a global leader in providing high-quality gas sensors and air quality monitors to industrial OEMs. With over 25 years of experience, the company offers a wide range of innovative gas sensor technologies for various applications, including...

Industrial Conglomerates
51-250
Founded 1996
View All Jobs 73

Description

  • Manage, mentor, and grow a team of up to 10 senior and staff software engineers.
  • Build a high-performance culture focused on technical excellence, predictable delivery, and career growth.
  • Own the strategy and architecture of the enterprise AI Gateway.
  • Ensure high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms for LLM traffic.
  • Lead the integration, evaluation, and management of 6+ major LLM vendors and 50+ models.
  • Optimize gateway performance across latency, cost, and reliability.
  • Partner with product management, AI research, and executive engineering leaders to align roadmap and goals.
  • Define and champion engineering best practices, architectural standards, and token-based cost-tracking telemetry.
  • Participate in high-level architectural discussions and provide technical direction and feedback.

Requirements

  • Strong track record of managing and growing high-performing teams of senior and staff engineers.
  • Deep experience running high-performance teams in an engineering leadership role.
  • Background in designing, building, and operating high-throughput, low-latency distributed systems.
  • Experience with complex routing, caching, queueing, or rate limiting in enterprise-scale systems.
  • Hands-on familiarity with multi-vendor integrations.
  • Exceptional communication and strategic collaboration skills.
  • Ability to align engineering objectives with business strategy and stakeholder expectations.
  • Nice to have: experience in applied AI or with LangChain, LangGraph, LiteLLM, or OpenRouter.
  • Nice to have: experience with orchestrators and proxies such as Temporal or Envoy.
  • Nice to have: experience with Python, Java, and highly distributed caching/queueing systems.

Benefits

  • Base salary range of $275,000 to $375,000 USD.
  • Potential equity grant.
  • Generous benefits program.
  • Equal-opportunity employer with a respectful and inclusive work environment.
  • Reasonable accommodation for qualified employees with protected disabilities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AssureSoft

Engineering Manager

AssureSoft 51-250 Internet Software & Services

AssureSoft is seeking a Software Engineering Manager to lead distributed, multidisciplinary development teams and oversee the delivery of high-quality software for world-class clients and long-term projects.

Latin America Full-time Lead Engineering Manager
Agile CI/CD Confluence JIRA Kanban Microservices Scrum
20 hours, 43 minutes ago
Signifyd

Engineering Manager

Signifyd 251-1K IT Services

Signifyd is seeking an Engineering Manager to lead an ML-focused engineering team building and operating AI-powered systems that help ecommerce merchants prevent fraud and deliver reliable customer experiences.

United States Full-time Senior Engineering Manager
$200k-$235k
Apache Airflow Apache Spark Databricks Machine Learning MLOps System Design Vertex AI
1 day, 19 hours ago
Fullscript

Engineering Manager, Patient Experience

Fullscript 251-1K Health Care Providers & Services

Fullscript is hiring a hands-on Engineering Manager to lead the Patient Experience pod and shape the technical and product foundations of Care Mode, a platform connecting patients with care teams between visits.

Canada Full-time Lead Engineering Manager
GraphQL Prototyping React React Native Ruby on Rails System Design
1 day, 19 hours ago
Bellese Technologies

Engineering Manager

Bellese Technologies 51-250 Internet Software & Services

Bellese is seeking an Engineering Manager to lead its largest engineering team delivering secure, scalable digital services for civic healthcare programs and improving public health outcomes.

United States Full-time Lead Engineering Manager
$139k-$163k
Agile AWS CI/CD Databricks DevSecOps
1 day, 19 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers