Labeler / Annotator – AI Response Evaluation (French)

3 weeks, 2 days ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context in French.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations.
  • Review AI responses across Q&A, web search, file/image-based, and conversation tasks.
  • Participate in training, calibration, and qualification review before production work.

Requirements

  • Native or professional fluency in French.
  • Strong English reading comprehension for reviewing guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization (preferred).
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis (preferred).

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of COP $46,900–$53,400.
  • Estimated monthly equivalent of COP $7,506,000–$8,541,000 for full-time work.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits such as paid vacation, aguinaldo, and vacation premium.
  • Social security and healthcare contributions (IMSS).
  • Additional benefits aligned with local market practices.
  • Structured onboarding with training sessions, practice exercises, calibration, and qualification review.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

SWE Fellow - Human Frontier Collective (UK)

Scale AI 251-1K Diversified Consumer Services

The Human Frontier Collective Fellowship at Scale is a fully remote contract role supporting AI research by designing, evaluating, and interpreting advanced generative AI systems with interdisciplinary experts and partner labs.

C++ Generative AI Java JavaScript Machine Learning Python Rust Swift
16 hours, 58 minutes ago

Norwegian Post-Editor | Technology Company

OLIVER 1K-5K Media

A tech company is seeking a Norwegian Post-Editor to support MTPE projects by refining marketing copy and product descriptions for AI-driven content development.

17 hours, 29 minutes ago

Founding BDR — AI Consulting (Outbound + Pipeline)

PHIZENIX 11-50 information technology & services

Phizenix is hiring its first outbound sales rep to generate and qualify leads for AI agent services and keep a strong pipeline moving to founder-led closing.

CRM Salesforce
1 day, 16 hours ago

GenAI Motion Graphics Designer

OLIVER 1K-5K Media

OLIVER is hiring a remote GenAI Motion Designer in Toronto to create and localize high-volume motion and static marketing assets for a leading vacuum and floorcare brand across the U.S. and other markets.

Copywriting Design Systems E-commerce Generative AI Illustrator Photoshop
1 day, 17 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers