Senior Product Manager, Observability Tools

1 month, 2 weeks ago
Full-time
Senior
Product Management
ASAPP

ASAPP

ASAPP provides generative AI solutions for contact centers, automating interactions, boosting agent productivity, and enhancing customer experiences.

IT Services
251-1K
Founded 2014
$380M raised

Description

  • Own simulation-agent tools for generating and curating realistic test scenarios.
  • Define evaluation surfaces for mistake monitoring and structured-data extraction accuracy.
  • Own the Previewer, enabling builders to assess configuration changes in simulated conversations.
  • Lead Conversation Explorer for reviewing production conversations, including agent reasoning and actions.
  • Partner with Sales, Customer Success, and Research to demonstrate the value of simulation-driven quality.
  • Collaborate with Research and Engineering on agent architecture, reasoning traces, tool calls, and scenario-generation methods.
  • Identify and resolve trust issues such as simulation-to-production discrepancies, incomplete traces, and unclear mistake categorization.
  • Run user discovery and translate findings into product requirements, quality metrics, and review workflows.

Requirements

  • 5+ years of product management experience, including work on testing, quality, review, or analytics products in enterprise B2B SaaS.
  • Direct experience building products involving LLMs, AI agents, or applied AI systems.
  • Experience shipping tools that simulate, test, or preview system behavior before production.
  • Experience building review or audit tooling for complex, unstructured content.
  • Ability to partner with research and engineering teams on reasoning traces, tool-use logs, and evaluation methodologies.
  • Track record of conducting user discovery and translating insights into structured requirements.
  • Excellent written and verbal communication, including PRD writing and customer presentations.
  • Experience with contact centers, conversational AI, or CX analytics is preferred.
  • Experience with generative-AI evaluation methods, including offline evaluations, human review, or automated mistake detection, is preferred.
  • Startup or fast-scaling company experience is preferred.

Benefits

  • Competitive compensation.
  • Stock options.
  • Family healthcare coverage.
  • Mac equipment.
  • USD 150 per month in flexible benefits.
  • Three weeks of vacation.
  • English lessons.
  • Remote work opportunity.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Product Director

Zone & Co 251-1K Diversified Financial Services

Zone & Co. is hiring a Director of Procure-to-Pay Product Suite to lead the vision, development, and scaling of its AI-powered financial operations platform for Oracle NetSuite customers worldwide.

NetSuite
5 hours, 27 minutes ago

Product Director

Zone & Co 251-1K Diversified Financial Services

Zone & Co., an ERP-native AI platform for NetSuite financial operations, is seeking a Director of Procure-to-Pay Product Suite to define, build, and scale its procurement and payment platform for global customers.

ERP NetSuite
5 hours, 27 minutes ago

PBM Product Partnerships Manager

AffirmedRx 1-10 Insurance

AffirmedRx is seeking a Manager to connect client needs with pharmacy benefit products and vendor solutions, leading partnerships from discovery through launch and ongoing performance management to improve client and member outcomes.

5 hours, 27 minutes ago

Game Producer: Platform Games

Atari 11-50 Consumer Goods

Atari is seeking a remote Game Producer in its India team to lead the end-to-end development and live operations of short-session platform games based on its classic arcade catalog for channels such as Reddit and MSN.

Agile HTML Scrum Unity
5 hours, 42 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers