Sr. Staff Software Engineer, AI Platform

10 hours, 3 minutes ago
Full-time
Lead
Software Development
Pinterest

Pinterest

Pinterest is the world's first visual discovery engine, offering a vast dataset of ideas with over 200 billion recipes, home hacks, and style inspiration. With a mission to inspire everyone to create a life they love, Pinterest empowers its employees t...

Internet Software & Services
5K-10K
Founded 2010

Description

  • Identify modernization opportunities and expand the roadmap for Pinterest’s company-wide AI/ML evaluation system.
  • Define cross-team technical strategy, align partner teams, and drive adoption of shared evaluation capabilities.
  • Make durable architectural decisions that improve platform reliability and user experience.
  • Establish evaluation standards balancing automated metrics, expert judgment, human feedback, safety, and business outcomes.
  • Lead complex cross-team workstreams, resolve technical tradeoffs and risks, and deliver measurable impact.
  • Partner with engineering, research, product, and safety teams on evaluation, launch, and quality decisions.

Requirements

  • 3+ years of hands-on experience designing and operating evaluation systems for GenAI and complex ML systems.
  • Experience with benchmark design, golden datasets, automated metrics, human evaluation, model-based grading, and failure analysis.
  • Strong Python programming skills and understanding of distributed systems principles.
  • Experience iterating with AI tools for coding and system design.
  • Familiarity with GenAI and recommender-system evaluation frameworks such as AutoEvals, OpenEvals, and Ragas.
  • 5+ years of experience building scalable platforms for distributed experimentation, data and model versioning, orchestration, observability, release management, and production monitoring.
  • Strong judgment regarding GenAI risks, including robustness, bias, privacy, security, and automated evaluation limitations.
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
  • Ability to work in a Pinterest office 1–2 times per quarter; role can be based anywhere in the country.

Benefits

  • Base salary range of $208,592–$429,454 USD for US-based applicants.
  • Equity eligibility.
  • Flexible PinFlex work model with limited in-office collaboration.
  • Equal opportunity workplace with application accommodations available.
  • No relocation assistance is provided.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer, Interoperability

Clover Health 251-1K Insurance

Counterpart Health, a Clover Health subsidiary, is hiring a Senior Software Engineer to build healthcare interoperability systems that improve data exchange and support better patient outcomes.

AWS GCP Go gRPC JavaScript MySQL PostgreSQL Python REST API Snowflake SQL
9 hours, 33 minutes ago

Senior Software Engineer (Customer Platform)

Chainguard 51-250 Internet Software & Services

Chainguard is hiring a Senior Software Engineer for its remote Platform team to build reliable customer-facing backend services and public APIs supporting multiple products.

Go Kubernetes Microservices
9 hours, 48 minutes ago

Cybersecurity & Software Engineering Specialist (AI Projects)

Gramian Consultancy Group Professional Services

Gramian Consultancy is seeking remote Cybersecurity and Software Engineering Specialists to debug code, identify vulnerabilities, improve backend systems, and provide technical insights for an AI training project.

C++ Cybersecurity Go Java Penetration Testing Python Rust TypeScript
10 hours, 3 minutes ago

Senior Software Engineer (Customer Platform)

Chainguard 51-250 Internet Software & Services

Chainguard is hiring a Senior Software Engineer for its Platform team to build reliable backend services and public APIs that support multiple products and customer experiences.

Go Kubernetes Microservices
10 hours, 3 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers