Strategic Project Lead - AI Post-Training (United States)

4 hours, 46 minutes ago
Full-time
Mid Level
Artificial Intelligence and Machine Learning
Appen

Appen

Appen is a global leader in providing high-quality data management services for AI development. With over 1 million crowd workers, Appen supports the world's top technology companies in enhancing their products and services. The company offers a divers...

IT Services
1001-5000
Founded 1996
$59M raised

Description

  • Own end-to-end project delivery, including scope, timelines, budgets, staffing, and risk management.
  • Lead client communications, status reporting, planning sessions, and issue escalations.
  • Translate model-improvement objectives into data requirements, workflows, rubrics, and evaluation plans.
  • Define quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs.
  • Monitor delivery quality, investigate inconsistencies, and resolve ambiguous requirements with clients.
  • Advise on data design, evaluation approaches, and project feasibility.
  • Develop reusable guidelines, standard operating procedures, and QA frameworks.
  • Mentor Operations Specialists and support project scoping, pilots, and new capability development.

Requirements

  • 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a generative or frontier AI environment.
  • Familiarity with at least one AI post-training or model-evaluation workflow.
  • Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients.
  • Understanding of data quality, annotation workflows, and quality-assurance methods.
  • Ability to turn evolving requirements into clear workflows, rubrics, and measurable quality standards.
  • Strong troubleshooting and organizational skills, with the ability to manage multiple priorities.
  • Interest in frontier models and AI post-training approaches.
  • Experience with RLHF, preference data, or model response evaluation (preferred).
  • Familiarity with rubric design, model comparison, benchmark development, or evaluation creation (preferred).
  • Bilingual proficiency, particularly in German or a Nordic language (preferred).

Benefits

  • Flexible ways of working to support you and your team.
  • Tools, resources, and development opportunities to build capability over time.
  • Opportunities to work on complex AI challenges across industries and geographies.
  • Collaborative culture focused on curiosity, accountability, and quality.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Project Manager (IT infrastructure & application projects)_Lithuanian Citizens only

HITCONTRACT 11-50 Professional Services

Lead infrastructure upgrades, system decommissioning, and application and data migrations for a large-scale insurance project in Lithuania.

4 hours, 31 minutes ago

Technical Project Manager

PeopleGrove 51-200 Diversified Consumer Services

PeopleGrove is hiring a remote Technical Project Manager in India for a 6-month contract to streamline request intake, backlog operations, and release communications for its CORE clinical education platforms.

Confluence JIRA
4 hours, 46 minutes ago

Project Lead (US)

ALTEN Mexico is seeking a Project Leader to manage technical project delivery, lead cross-functional teams, and ensure quality, cost, and schedule performance for engineering and technology initiatives.

Embedded Systems Java Python Scrum
1 day, 14 hours ago

Development Project Manager

Lever 201-500 Professional Services

elk Marketing is seeking a Development Project Manager to lead Shopify development projects from client intake through launch, coordinating clients and technical teams to deliver high-quality work on time.

Asana Facebook Ads SEO Shopify
2 days, 4 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers