Sr. Product Manager, AI

57 minutes ago
Full-time
Senior
Product Management
Flodesk

Flodesk

Flodesk provides intuitive software tools for designing emails and sales pages, helping businesses grow and engage customers effectively.

Internet Software & Services
11-50
Founded 2018

Description

  • Manage member-facing AI behavior across email creation, editing, segmentation, scheduling, analytics, and recommendations.
  • Create, test, version, and document prompts and agent instructions.
  • Define required context, member data, tools, and product state, translating them into requirements and acceptance criteria.
  • Own AI evaluation practices, including datasets, scenarios, scoring rubrics, regression coverage, and human review.
  • Run quality monitoring, establish baselines, and set release gates for prompt, model, and agent changes.
  • Review traces and interactions to diagnose failures across prompts, context, models, tools, product structure, and implementation.
  • Turn research, support feedback, analytics, and production failures into experiments, priorities, and regression cases.
  • Set product direction for the AI experience and collaborate with product, design, marketing, copy, and engineering teams.

Requirements

  • Experience shaping or materially improving real LLM or agentic products with measurable user or quality improvements.
  • Practical knowledge of prompts, context, tools, agent behavior, and AI evaluation in production environments.
  • Hands-on experience with prompt iteration, evaluation tools, trace review, JSON, schemas, and structured outputs.
  • Strong product judgment and ability to translate ambiguous needs into quality definitions and testable hypotheses.
  • Experience designing representative test sets, failure taxonomies, and rigorous experiments.
  • Systems thinking and ability to develop reusable patterns across evolving AI product surfaces.
  • Clear communication across technical and non-technical disciplines, with sound tradeoff judgment involving quality, latency, reliability, cost, and member value.
  • Preferred: experience in AI product behavior, conversation design, computational linguistics, or prompt systems.
  • Preferred: experience building content-generation, creative, or marketing tools.
  • Preferred: experience with Langfuse, Braintrust, or comparable evaluation and observability platforms.

Benefits

  • $150,000–$200,000 base salary, depending on location and experience.
  • Fully paid individual health insurance.
  • 16 weeks paid parental leave for non-birthing parents and 22 weeks for birthing parents.
  • Unlimited flexible time off.
  • 401(k) match for US employees.
  • $1,000 annual learning and development stipend.
  • Remote-first work environment with globally distributed teams and regional hubs.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

VP, Product Management

Beauty For All Industries (BFA) 51-200 information technology & services

IPSY is seeking a remote Vice President of Product Management to lead Product Management and UX, defining and scaling web, mobile, and internal platform strategies across its beauty subscription business.

E-commerce Machine Learning UX Design
57 minutes ago

Customer Success & Product Manager

Wing Assistant 51-250 Professional Services

Customer Success & Product Manager at Central, working across customer success, product, and solutions engineering to implement AI-powered workflows, resolve customer needs, and turn feedback into product improvements.

1 hour, 12 minutes ago

Customer Success & Product Manager

Wing Assistant 51-250 Professional Services

Join the company as a Customer Success & Product Manager, helping customers implement and maximize its SaaS platform while translating their workflows and feedback into product improvements.

1 hour, 12 minutes ago

Customer Success & Product Manager

Wing Assistant 51-250 Professional Services

Join the company as a Customer Success & Product Manager, helping customers implement and adopt its SaaS platform while translating their workflows and feedback into technical solutions and product improvements.

1 hour, 27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers