Gate.com

Gate.com offers premium Managed WordPress hosting with top-notch security, management tools, and 24/7 support for small and medium-sized businesses, ensuring an enterprise-grade experience at an affordable price.

IT Services

Information Technology

51-250 (75)

Founded 1996

18 open positions

Links

View All Jobs

AI产品经理-AI Router方向

1 month, 1 week ago

Asia

Full-time

Junior

Product Manager

Artificial Intelligence and Machine Learning

LLM Load Balancing Microservices Prototyping REST API Wireframing

Apply Now

Gate.com

IT Services

51-250

Founded 1996

View All Jobs 18

Description

Lead the overall planning and product evolution of the AI model relay station and Multi-LLM aggregation platform.
Standardize the integration, adaptation, and packaging of large language models such as OpenAI, Anthropic, and DeepSeek into compatible API interfaces.
Design and iterate AI traffic routing strategies, including intelligent routing, dynamic load balancing, rate limiting, model degradation, and circuit breaking.
Build enterprise AI permission controls, multi-tenant account systems, usage quota management, and token metering and billing capabilities.
Design logging, audit, and anti-fraud systems to support large-scale commercial access from enterprise and consumer users.
Collaborate with engineering, testing, and operations teams to drive release delivery and resolve production issues end to end.
Optimize platform throughput, performance, and overall cost structure.
Track AI industry trends and model iteration directions, translating customer pain points into standardized platform capabilities.
Work closely with algorithm experts, infrastructure engineers, and data scientists to deliver a highly available, low-latency AI routing middle platform.

Requirements

2-3 years of product experience in AI products, large model platforms, API middle platforms, or high-performance SaaS platforms.
Strong understanding of large model call flows, API forwarding logic, network protocols, concurrency control, timeout handling, and retries.
Familiarity with the capabilities of mainstream global LLMs.
Solid foundational knowledge of fine-tuning, RAG, context management, dialogue memory, and prompt engineering.
Strong logic abstraction and architecture design ability, with the capacity to independently produce high-quality PRDs, sequence diagrams, and high-fidelity prototypes.
Strong ownership, data sensitivity, and project execution ability, with the resilience to work under pressure and take on technical challenges.
Preferred: experience delivering an AI relay platform, API distribution platform, compute scheduling center, or enterprise AI middle platform from 0 to 1.
Preferred: familiarity with large model adaptation layers, chat interfaces, and embedding/vector API call logic.
Preferred: experience with B2B high-concurrency SaaS monetization, multi-level permission systems, and anti-arbitrage risk control design.
Preferred: proficiency with modern full-stack development tools such as Cursor or Claude Code, with code-level communication skills and product thinking.

Benefits

Remote work arrangement.
Opportunity to work on a core AI infrastructure growth area with significant business momentum.
High technical ownership across model orchestration, high-concurrency scheduling, and commercialization workflows.
Fast career growth through exposure to cutting-edge AI technology evolution and business models.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Product Management Director (Platform)

Epic Games 5K-10K Internet Software & Services

Epic Games is seeking a Product Management Director (Platform) to shape strategy and execution for mobile, PC, and console experiences across its products and businesses.

United States Full-time Senior Technical Product Manager

$210k-$369k

Game Development Unreal Engine

16 hours, 13 minutes ago

Apply

16 hours, 13 minutes ago

Staff Product Manager, Partnerships

Coursera 1K-5K Internet Software & Services

Coursera is hiring a Staff Product Manager to shape AI-driven product strategy and the end-to-end content creation experience across Coursera and Udemy, driving scalable learner and creator experiences.

United States Full-time Lead Product Manager

$212k-$265k

Figma Generative AI JIRA Microservices UX Design

16 hours, 13 minutes ago

Apply

16 hours, 13 minutes ago

Lead Product Manager, Consumer Platform

Playlist 11-50 Media

Playlist/Mindbody is hiring a senior product leader to own the consumer platform roadmap and modernize the API and service foundation that powers consumer wellness experiences across multiple front-end squads.