Labeler / Annotator – AI Response Evaluation (French)

1 month, 1 week ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context in French.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations.
  • Review AI responses across general Q&A, web search results, file- and image-based outputs, and conversation tasks.

Requirements

  • Native or professional fluency in French.
  • Strong English reading comprehension for understanding guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization is preferred.
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis is preferred.

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of BRL R$75–R$85.
  • Estimated monthly equivalent of BRL R$11,900–R$13,600 for full-time work.
  • Structured onboarding with training sessions and practice exercises.
  • Calibration against quality benchmarks before production work.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits may include paid vacation, aguinaldo, and vacation premium.
  • Social security and healthcare contributions (IMSS).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Biosecurity & AI Safety Fellowship

10A Labs Internet Software & Services

10a Labs is hiring Biology Subject Matter Experts for a short-term remote contract supporting biological content review, risk assessment, and AI safety and biosecurity systems.

17 hours, 45 minutes ago

Data Annotator for AI Models - Spanish (Spain) in Brazil

RWS Group 5K-10K Internet Software & Services

RWS Group is hiring Brazil-based Spanish Data Annotators to annotate, evaluate, and curate text, video, and geographic data used to train and improve generative AI and machine learning models.

Machine Learning
18 hours, 15 minutes ago

AI Trainer - Freelance Data Annotator

Toloka 251-1K Internet Software & Services

Mindrift is seeking freelance AI annotators to review and label data for project-based efforts that test, evaluate, and improve AI systems when projects are available.

18 hours, 15 minutes ago

Speech Data Collection Contributor (Arabic-United Arab EmiratesExternal_Recruitment)

CrowdGen by Appen Internet Software & Services

Record 500 short Gulf Arabic sentences in the Appen Mobile app for a speech data project supporting AI speech recognition development.

1 day, 17 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers