RemoteLeaf Logo
Log in Sign up

AI产品经理-AI Router方向

2 days, 1 hour ago
Asia
Full-time
Junior
Product Manager
Artificial Intelligence and Machine Learning
LLM Load Balancing Microservices Prototyping REST API Wireframing
Apply Now
Gate.com

Gate.com

Gate.com offers premium Managed WordPress hosting with top-notch security, management tools, and 24/7 support for small and medium-sized businesses, ensuring an enterprise-grade experience at an affordable price.

IT Services
51-250
Founded 1996
View All Jobs 16

Description

  • Lead the overall planning and product evolution of the AI model relay station and Multi-LLM aggregation platform.
  • Standardize the integration, adaptation, and packaging of large language models such as OpenAI, Anthropic, and DeepSeek into compatible API interfaces.
  • Design and iterate AI traffic routing strategies, including intelligent routing, dynamic load balancing, rate limiting, model degradation, and circuit breaking.
  • Build enterprise AI permission controls, multi-tenant account systems, usage quota management, and token metering and billing capabilities.
  • Design logging, audit, and anti-fraud systems to support large-scale commercial access from enterprise and consumer users.
  • Collaborate with engineering, testing, and operations teams to drive release delivery and resolve production issues end to end.
  • Optimize platform throughput, performance, and overall cost structure.
  • Track AI industry trends and model iteration directions, translating customer pain points into standardized platform capabilities.
  • Work closely with algorithm experts, infrastructure engineers, and data scientists to deliver a highly available, low-latency AI routing middle platform.

Requirements

  • 2-3 years of product experience in AI products, large model platforms, API middle platforms, or high-performance SaaS platforms.
  • Strong understanding of large model call flows, API forwarding logic, network protocols, concurrency control, timeout handling, and retries.
  • Familiarity with the capabilities of mainstream global LLMs.
  • Solid foundational knowledge of fine-tuning, RAG, context management, dialogue memory, and prompt engineering.
  • Strong logic abstraction and architecture design ability, with the capacity to independently produce high-quality PRDs, sequence diagrams, and high-fidelity prototypes.
  • Strong ownership, data sensitivity, and project execution ability, with the resilience to work under pressure and take on technical challenges.
  • Preferred: experience delivering an AI relay platform, API distribution platform, compute scheduling center, or enterprise AI middle platform from 0 to 1.
  • Preferred: familiarity with large model adaptation layers, chat interfaces, and embedding/vector API call logic.
  • Preferred: experience with B2B high-concurrency SaaS monetization, multi-level permission systems, and anti-arbitrage risk control design.
  • Preferred: proficiency with modern full-stack development tools such as Cursor or Claude Code, with code-level communication skills and product thinking.

Benefits

  • Remote work arrangement.
  • Opportunity to work on a core AI infrastructure growth area with significant business momentum.
  • High technical ownership across model orchestration, high-concurrency scheduling, and commercialization workflows.
  • Fast career growth through exposure to cutting-edge AI technology evolution and business models.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Elastic

Principal Product Manager, AI agents - Search

Elastic 1K-5K Internet Software & Services

Elastic is seeking a Principal Product Manager to define and execute the strategy for Elastic Agent Builder, shaping how enterprises build and scale context for AI agents within its cloud-based Search AI platform.

United Kingdom Full-time Lead Product Manager
AWS Azure Elasticsearch GCP LLM Machine Learning
18 minutes ago
Elastic

Principal Product Manager, AI agents - Search

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Principal Product Manager to define and execute the vision for Elastic Agent Builder, shaping how enterprises build and scale context for AI agents within a global AI ecosystem.

Portugal Full-time Lead Product Manager
$78k-$122k
AWS Azure Elasticsearch GCP LLM Machine Learning
18 minutes ago
Fandom

Sr Product Manager 2, Brand Safety & Compliance

Fandom 251-1K Internet Software & Services

Fandom is hiring a remote Sr Product Manager 2 to lead brand safety, compliance, and marketplace integrity initiatives across its monetization ecosystem.

Poland Full-time Senior Product Manager
$2k-$2k
Machine Learning
33 minutes ago
Stronger Consulting

Product Manager

Stronger Consulting 11-50 Professional Services

Achievement Network (ANet) is seeking a strategic Product Manager to develop tools that support educational equity by turning organizational priorities into a high-impact roadmap for educators and students.

United States Full-time Senior Product Manager
$115k-$191k
Agile
48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers