RemoteLeaf Logo
Log in Sign up

Labeler / Annotator – AI Response Evaluation (Castilian Spanish)

21 minutes ago
Argentina
Full-time
Junior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Apply Now
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013
View All Jobs 10

Description

  • Perform side-by-side comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context across Castilian Spanish.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations.
  • Review AI responses across general Q&A, web search, file-based, image-based, and generation tasks.
  • Evaluate both single-turn and multi-turn conversations.
  • Complete training, calibration, and qualification review before production work.

Requirements

  • Native or professional fluency in Castilian Spanish.
  • Strong English reading comprehension for guideline review.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization (preferred).
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis (preferred).

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of ARS 15,000–ARS 17,000.
  • Estimated monthly equivalent of ARS 2,400,000–ARS 2,720,000 for full-time work.
  • Locally compliant benefits through an Employer of Record partner.
  • Statutory benefits including paid vacation and aguinaldo/SAC.
  • Social security contributions and healthcare coverage (Obra Social).
  • Additional benefits aligned with local market practices.
  • Structured onboarding with training, practice exercises, and calibration.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

S

Director of Customer Service, Enablement and AI

Skylight / Skylight Frame 51-200 Consumer electronics

Skylight is hiring an AI Support Operations lead to own customer-facing and internal AI across its customer service function as the company scales its family-focused products.

United States Full-time Lead AI (Artificial Intelligence)
$150k-$185k
LLM
51 minutes ago
Coconut VA

🌴 AI Automations Specialist - Job Code: 1785267917380

Coconut VA 11-50 Professional Services

Coconut is hiring a part-time AI Automations Specialist to build and support remote automation systems, data workflows, and AI-driven business processes across multiple client priorities.

Philippines Part-time Mid Level AI (Artificial Intelligence) AI Engineer
$11k-$14k
CRM Git LLM NLP Power BI Python REST API SQL
51 minutes ago
Fidus Systems

Chief AI Officer

Fidus Systems 51-250 Professional Services

Fidus is seeking a Chief AI Officer to lead company-wide AI transformation, strategy, and adoption across its engineering services business.

United States Full-time Executive AI (Artificial Intelligence)
LLM Machine Learning MLOps Prototyping
51 minutes ago
Devsu

Revenue Operations Engineer (RevOps) | HubSpot, Automation & AI

Devsu 51-250 Internet Software & Services

RevOps Engineer – Growth at an unspecified company, responsible for reporting, CRM operations, GTM systems, and automation to improve data accuracy and support data-driven growth decisions.

Mexico Colombia Full-time Mid Level AI (Artificial Intelligence)
CRM Google Tag Manager HubSpot JavaScript JSON Power BI Python SEMrush SEO SQL
1 hour, 6 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers