RemoteLeaf Logo
Log in Sign up

Labeler / Annotator – AI Response Evaluation (Italian)

1 hour, 18 minutes ago
Brazil
Full-time
Junior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Apply Now
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013
View All Jobs 25

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context across Italian responses.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations across tasks.
  • Review AI responses in general-purpose Q&A, web search, file-based, image-based, generation, and conversation scenarios.
  • Complete structured onboarding, training exercises, calibration, and qualification review before production work.

Requirements

  • Native or professional fluency in Italian.
  • Strong English reading comprehension for understanding guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization (preferred).
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis (preferred).
  • Ability to work within an Employer of Record (EOR) employment structure and comply with local labor/payroll requirements.

Benefits

  • Estimated hourly compensation of R$75–R$85 BRL.
  • Estimated monthly equivalent compensation of R$12,000–R$13,600 BRL for full-time work.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits such as paid leave and 13th salary where applicable.
  • Social security and healthcare contributions.
  • Additional benefits aligned with local market practices.
  • Structured onboarding with training sessions, practice exercises, and calibration.
  • Opportunity to work on cutting-edge AI systems in a global, multilingual team.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Fortis Games

AI Solutions Architect (IT)

Fortis Games 251-1K Internet Software & Services

Fortis Games is hiring an AI Solutions Architect to lead the design and modernization of internal IT systems and automation with a focus on secure, scalable, AI-driven operations.

Canada Senior AI (Artificial Intelligence) Infrastructure Engineer
AWS Azure Game Development GCP Generative AI LLM MLOps
3 minutes ago
Karat

Interview Engineer (Romania)

Karat 251-1K Internet Software & Services

Karat is seeking contractor/freelancer Interview Engineers to facilitate and evaluate technical interviews for software developers through its platform.

Romania Freelance Mid Level AI (Artificial Intelligence) Software Engineer
3 minutes ago
Databricks

Sr. Alliance Director, AI GTM

Databricks 1K-5K IT Services

Databricks is hiring a Sr. Alliance Director, AI GTM to lead go-to-market strategy and co-sell programs with strategic AI partners across the Cloud and AI ecosystem.

United States Full-time Lead AI (Artificial Intelligence) Partnerships Manager
Apache Spark Generative AI MLflow
3 minutes ago
Mindrift.ai: Be the “I” in AI

Low-Code Automation Engineer - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a part-time freelance Low-Code Automation Engineer for the Tendem project to design and optimize reliable automation workflows across integrated systems in a hybrid AI + human environment.

Italy Part-time Mid Level AI (Artificial Intelligence) AI Engineer
$52k-$52k
CRM JavaScript JSON Notion
20 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers