Labeler / Annotator – AI Response Evaluation (Italian)

2 hours, 6 minutes ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context in Italian responses.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations across tasks.
  • Review AI outputs across general Q&A, web search, file-based, image-based, and generation scenarios.
  • Evaluate both single-turn and multi-turn conversation outputs.

Requirements

  • Native or professional fluency in Italian.
  • Strong English reading comprehension for understanding guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization (preferred).
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis (preferred).

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of MXN $255–$290.
  • Estimated monthly equivalent of MXN $40,800–$46,400 for full-time work.
  • Locally compliant benefits through an Employer of Record partner.
  • Statutory benefits such as paid vacation, aguinaldo, and vacation premium.
  • Social security and healthcare contributions (IMSS).
  • Structured onboarding with training sessions, practice exercises, and calibration.
  • Opportunity to work on cutting-edge AI systems with a global, multilingual team.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Project Lyra Mandarin Culture Expert (United States)

Welo Global Professional Services

Welo Data is hiring a remote Mandarin Culture Expert in the United States to evaluate and refine AI language outputs for a short-term freelance project focused on improving Mandarin-language data quality.

LLM
56 minutes ago

First-Person Video AI Trainer (Worldwide)

Toloka 251-1K Internet Software & Services

Toloka Annotators is seeking freelance contributors to capture point-of-view video of everyday household tasks for AI training projects.

1 hour, 1 minute ago

Statistics & Python Expert - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking statistics specialists for project-based AI work focused on designing and validating computational mathematics problems for leading tech companies.

C MATLAB NumPy Pandas Python R SciPy SQL
1 hour, 56 minutes ago

First-Person Video AI Trainer (Worldwide)

Toloka 251-1K Internet Software & Services

Toloka Annotators is hiring freelance contributors to record point-of-view video of everyday household tasks for AI training projects.

2 hours, 4 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers