Labeler / Annotator – AI Response Evaluation (French)

1 hour, 47 minutes ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context across French.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations across tasks.
  • Review AI responses in general-purpose Q&A, web search, file-based, image-based, and generation tasks.
  • Evaluate both single-turn and multi-turn conversation outputs.

Requirements

  • Native or professional fluency in French.
  • Strong English reading comprehension for understanding guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization is preferred.
  • Experience in AI evaluation, data annotation, or search relevance/content quality analysis is preferred.

Benefits

  • Estimated hourly compensation of R$75–R$85 BRL.
  • Estimated monthly equivalent compensation of R$12,000–R$13,600 BRL for full-time work.
  • Locally compliant benefits through an Employer of Record (EOR) arrangement.
  • Statutory benefits such as paid leave and 13th salary where applicable.
  • Social security and healthcare contributions.
  • Additional benefits aligned with local market practices.
  • Structured onboarding with training sessions and practice exercises.
  • Calibration and qualification review before moving into production work.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Freelance n8n Workflow Developer - AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote n8n Workflow Developer for the Tendem project to design and optimize automation workflows in a hybrid AI + human environment.

Generative AI JSON
1 hour, 19 minutes ago

Freelance Mathematics Expert - AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking mathematicians for project-based AI evaluation work that involves testing and improving AI systems through rigorous problem design and structured assessment.

1 hour, 45 minutes ago

Lead GTM Data Operations Analyst, AI Workflows

Klaviyo 1K-5K IT Services

Klaviyo is hiring an onshore GTM Data Strategy & Operations specialist to operate and extend its live agentic AI pipeline for data quality, enrichment, and hierarchy management in production.

Python Salesforce Shell Scripting Snowflake SQL
2 hours, 20 minutes ago

Head of AI Platform, GM

MongoDB 1K-5K Internet Software & Services

MongoDB is hiring a Head of AI Platform, GM to lead a new AI Applications Platform business, owning its product vision, execution, and commercial growth from early stage to scale.

AWS Azure GCP MongoDB
2 hours, 34 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers