RemoteLeaf Logo
Log in Sign up

AI产品经理-AI Router方向

2 months ago
Asia
Full-time
Junior
Product Manager
Artificial Intelligence and Machine Learning
LLM Load Balancing Microservices Prototyping REST API Wireframing
Apply Now
Gate.com

Gate.com

Gate.com offers premium Managed WordPress hosting with top-notch security, management tools, and 24/7 support for small and medium-sized businesses, ensuring an enterprise-grade experience at an affordable price.

IT Services
51-250
Founded 1996
View All Jobs 19

Description

  • Lead the overall planning and product evolution of the AI model relay station and Multi-LLM aggregation platform.
  • Standardize the integration, adaptation, and packaging of large language models such as OpenAI, Anthropic, and DeepSeek into compatible API interfaces.
  • Design and iterate AI traffic routing strategies, including intelligent routing, dynamic load balancing, rate limiting, model degradation, and circuit breaking.
  • Build enterprise AI permission controls, multi-tenant account systems, usage quota management, and token metering and billing capabilities.
  • Design logging, audit, and anti-fraud systems to support large-scale commercial access from enterprise and consumer users.
  • Collaborate with engineering, testing, and operations teams to drive release delivery and resolve production issues end to end.
  • Optimize platform throughput, performance, and overall cost structure.
  • Track AI industry trends and model iteration directions, translating customer pain points into standardized platform capabilities.
  • Work closely with algorithm experts, infrastructure engineers, and data scientists to deliver a highly available, low-latency AI routing middle platform.

Requirements

  • 2-3 years of product experience in AI products, large model platforms, API middle platforms, or high-performance SaaS platforms.
  • Strong understanding of large model call flows, API forwarding logic, network protocols, concurrency control, timeout handling, and retries.
  • Familiarity with the capabilities of mainstream global LLMs.
  • Solid foundational knowledge of fine-tuning, RAG, context management, dialogue memory, and prompt engineering.
  • Strong logic abstraction and architecture design ability, with the capacity to independently produce high-quality PRDs, sequence diagrams, and high-fidelity prototypes.
  • Strong ownership, data sensitivity, and project execution ability, with the resilience to work under pressure and take on technical challenges.
  • Preferred: experience delivering an AI relay platform, API distribution platform, compute scheduling center, or enterprise AI middle platform from 0 to 1.
  • Preferred: familiarity with large model adaptation layers, chat interfaces, and embedding/vector API call logic.
  • Preferred: experience with B2B high-concurrency SaaS monetization, multi-level permission systems, and anti-arbitrage risk control design.
  • Preferred: proficiency with modern full-stack development tools such as Cursor or Claude Code, with code-level communication skills and product thinking.

Benefits

  • Remote work arrangement.
  • Opportunity to work on a core AI infrastructure growth area with significant business momentum.
  • High technical ownership across model orchestration, high-concurrency scheduling, and commercialization workflows.
  • Fast career growth through exposure to cutting-edge AI technology evolution and business models.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Aegis Ventures

Product Manager

Aegis Ventures 51-250 Professional Services

Avandra Imaging is hiring a Product Manager to lead its enterprise imaging platform strategy and launch digital image exchange products that improve medical image sharing and support the company’s imaging data network.

United States Full-time Senior Product Manager
Agile
20 hours, 10 minutes ago
PHIZENIX

Product Manager- Workflows

PHIZENIX 11-50 information technology & services

Product Manager at an AI-first insurance platform that automates workflows for brokers, MGAs, and wholesalers across employee benefits and commercial insurance.

Anywhere Full-time Senior Product Manager Technical Product Manager
$130k-$180k
Google Tag Manager SQL
20 hours, 10 minutes ago
A1M Solutions

Senior Product Manager

A1M Solutions 11-50 Professional Services

A1M Solutions is hiring a Senior Product Manager to lead product strategy and delivery for cross-functional government healthcare work with policy, technical, and stakeholder teams.

United States Full-time Senior Product Manager
$125k-$140k
Agile
20 hours, 25 minutes ago
People.ai

Senior Product Manager, Data Platform

People.ai 251-1K IT Services

Backstory is hiring a Senior PM for Platform to drive execution across matching, activity capture, and CRM integrations while expanding ownership of the broader platform domain.

Canada Full-time Senior Product Manager
Microsoft Dynamics 365 Salesforce
20 hours, 39 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers