Labeler / Annotator – AI Response Evaluation (Italian)

2 weeks, 6 days ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate AI outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context across Italian.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations.
  • Evaluate responses across general-purpose Q&A, web search results, file-based and image-based responses, image and file generation tasks, and single-turn and multi-turn conversations.
  • Complete structured onboarding, including training sessions, practice exercises, calibration against quality benchmarks, and qualification review before production work.

Requirements

  • Native or professional fluency in Italian.
  • Strong English reading comprehension for understanding guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization is preferred.
  • Experience in AI evaluation is preferred.
  • Experience in data annotation is preferred.
  • Experience in search relevance or content quality analysis is preferred.

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of ARS 15,000–ARS 17,000.
  • Estimated monthly equivalent for full-time work of ARS 2,400,000–ARS 2,720,000.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits including paid vacation and aguinaldo / Sueldo Anual Complementario (SAC).
  • Social security contributions and healthcare coverage (Obra Social).
  • Additional benefits aligned with local market practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Senior Consultant, AI Services

AHEAD 1K-5K IT Services

AHEAD is seeking an AI Senior Consultant to advise enterprise clients on AI strategy, readiness, governance, and adoption roadmaps within its Solutions Development team.

Machine Learning MLOps
40 minutes ago

Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Toloka AI’s Mindrift team is launching a management consulting domain and seeks experienced strategy consultants to turn real engagement work into structured learning environments for AI systems.

Machine Learning Reinforcement Learning
1 hour, 41 minutes ago

AI Voice Trainer

Wing Assistant 51-250 Professional Services

Wing Data is hiring a freelance, project-based AI Voice Trainer in Karnataka to complete short remote voice sessions that support client AI speech training projects.

2 hours, 21 minutes ago

Linguistic AI Auditor (Thai)

RWS Group 5K-10K Internet Software & Services

RWS TrainAI is hiring a Thai-speaking linguistic auditor for a remote, temporary contract project evaluating AI chatbot conversations.

2 hours, 34 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers