RemoteLeaf Logo
Log in Sign up

AI产品经理-AI Router方向

3 weeks, 1 day ago
Asia
Full-time
Junior
Product Manager
Artificial Intelligence and Machine Learning
LLM Load Balancing Microservices Prototyping REST API Wireframing
Apply Now
Gate.com

Gate.com

Gate.com offers premium Managed WordPress hosting with top-notch security, management tools, and 24/7 support for small and medium-sized businesses, ensuring an enterprise-grade experience at an affordable price.

IT Services
51-250
Founded 1996
View All Jobs 18

Description

  • Lead the overall planning and product evolution of the AI model relay station and Multi-LLM aggregation platform.
  • Standardize the integration, adaptation, and packaging of large language models such as OpenAI, Anthropic, and DeepSeek into compatible API interfaces.
  • Design and iterate AI traffic routing strategies, including intelligent routing, dynamic load balancing, rate limiting, model degradation, and circuit breaking.
  • Build enterprise AI permission controls, multi-tenant account systems, usage quota management, and token metering and billing capabilities.
  • Design logging, audit, and anti-fraud systems to support large-scale commercial access from enterprise and consumer users.
  • Collaborate with engineering, testing, and operations teams to drive release delivery and resolve production issues end to end.
  • Optimize platform throughput, performance, and overall cost structure.
  • Track AI industry trends and model iteration directions, translating customer pain points into standardized platform capabilities.
  • Work closely with algorithm experts, infrastructure engineers, and data scientists to deliver a highly available, low-latency AI routing middle platform.

Requirements

  • 2-3 years of product experience in AI products, large model platforms, API middle platforms, or high-performance SaaS platforms.
  • Strong understanding of large model call flows, API forwarding logic, network protocols, concurrency control, timeout handling, and retries.
  • Familiarity with the capabilities of mainstream global LLMs.
  • Solid foundational knowledge of fine-tuning, RAG, context management, dialogue memory, and prompt engineering.
  • Strong logic abstraction and architecture design ability, with the capacity to independently produce high-quality PRDs, sequence diagrams, and high-fidelity prototypes.
  • Strong ownership, data sensitivity, and project execution ability, with the resilience to work under pressure and take on technical challenges.
  • Preferred: experience delivering an AI relay platform, API distribution platform, compute scheduling center, or enterprise AI middle platform from 0 to 1.
  • Preferred: familiarity with large model adaptation layers, chat interfaces, and embedding/vector API call logic.
  • Preferred: experience with B2B high-concurrency SaaS monetization, multi-level permission systems, and anti-arbitrage risk control design.
  • Preferred: proficiency with modern full-stack development tools such as Cursor or Claude Code, with code-level communication skills and product thinking.

Benefits

  • Remote work arrangement.
  • Opportunity to work on a core AI infrastructure growth area with significant business momentum.
  • High technical ownership across model orchestration, high-concurrency scheduling, and commercialization workflows.
  • Fast career growth through exposure to cutting-edge AI technology evolution and business models.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Civitas Learning

Senior Product Manager

Civitas Learning 51-250 Education Services

Civitas Learning is hiring a Senior Product Manager to lead execution of Compass AI initiatives for higher education, turning AI strategy into customer-validated products that improve student outcomes at scale.

United States Full-time Senior Product Manager
$145k-$155k
Asana Confluence JIRA LLM Machine Learning
14 hours, 27 minutes ago
Civitas Learning

Senior Product Manager

Civitas Learning 51-250 Education Services

Civitas Learning is hiring a Senior Product Manager to lead AI product execution for Compass AI, turning strategy into shipped tooling and workflows that improve student outcomes in higher education.

Latin America Full-time Senior Product Manager
$60k-$70k
Asana Confluence JIRA LLM
14 hours, 42 minutes ago
DataGrail

Senior Product Manager, Intelligence

DataGrail 51-250 IT Services

DataGrail is hiring a Senior Product Manager to lead its Intelligence Suite and shape AI-driven privacy products that help enterprises discover, manage, and protect personal data at scale.

United States Full-time Senior Product Manager
$180k-$215k
Machine Learning Microservices Prototyping REST API
14 hours, 57 minutes ago
Ottimate

Product Manager

Ottimate IT Services

Ottimate is hiring a Product Manager to own a defined area of its AI-native accounts payable automation and payments platform, driving products from discovery through launch for mid-market finance teams.

United States Full-time Junior Product Manager
$100k-$130k
ERP Machine Learning Neural Networks
14 hours, 57 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers