Labeler / Annotator – AI Response Evaluation (French)

1 day, 13 hours ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context in French.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations.
  • Review AI responses across general Q&A, web search, file-based, image-based, and generation tasks.
  • Evaluate both single-turn and multi-turn conversations.

Requirements

  • Native or professional fluency in French.
  • Strong English reading comprehension for understanding guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization (preferred).
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis (preferred).

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of CLP $13,500–$15,350.
  • Estimated monthly equivalent of CLP $2,158,000–$2,455,000 for full-time work.
  • Structured onboarding with training sessions and practice exercises.
  • Calibration against quality benchmarks before production work.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits may include paid vacation, aguinaldo, and vacation premium.
  • Social security and healthcare contributions (IMSS).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Automation Specialist

JustMarkets 1-10 Capital Markets

JustMarkets is hiring an AI Automation Specialist to transform its marketing department by replacing manual workflows with scalable AI and automation systems that accelerate campaigns, content production, and global operations.

CRM JSON OAuth REST API Selenium SQL
12 hours, 25 minutes ago

Sr. Product Manager AI

Mitratech 1K-5K Professional Services

Mitratech Legal Solutions is hiring a Senior Product Manager, AI to drive enterprise legal software AI initiatives from concept to production across a shared platform and customer-facing experiences.

Generative AI LLM Machine Learning
12 hours, 40 minutes ago

Level 3 Support Analyst - AI Specialist

Anaplan 1K-5K Internet Software & Services

Anaplan is hiring a Level 3 Support professional to resolve complex customer technical issues across its AI-focused planning platform while partnering with engineering, product, operations, and customer success teams.

Grafana LLM Machine Learning
12 hours, 55 minutes ago

AI Operations Manager

Power Digital is hiring an AI Operations Manager to run enterprise AI platform operations and keep the Innovation team’s roadmap, priorities, and executive support tightly aligned.

13 hours, 10 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers