RemoteLeaf Logo
Log in Sign up

Labeler / Annotator – AI Response Evaluation (Korean)

1 day, 2 hours ago
Mexico
Full-time
Junior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Apply Now
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013
View All Jobs 25

Description

  • Perform side-by-side (SBS) comparisons of AI-generated responses.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context across Korean.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations.
  • Review AI responses across general Q&A, web search, file-based, image-based, and generation tasks.
  • Assess both single-turn and multi-turn conversations.
  • Complete onboarding, practice exercises, calibration, and qualification review before production work.

Requirements

  • Native or professional fluency in Korean.
  • Strong English reading comprehension for understanding evaluation guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization is preferred.
  • Experience in AI evaluation is preferred.
  • Experience in data annotation is preferred.
  • Experience in search relevance or content quality analysis is preferred.

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of MXN $255–$290.
  • Estimated monthly equivalent of MXN $40,800–$46,400 for full-time.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits may include paid vacation, aguinaldo, and vacation premium.
  • Social security and healthcare contributions (IMSS).
  • Additional benefits aligned with local market practices.
  • Structured onboarding with training sessions, practice exercises, calibration, and qualification review.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Toloka

First-Person Video AI Trainer (Worldwide)

Toloka 251-1K Internet Software & Services

Toloka Annotators is hiring freelance contributors to record point-of-view videos of everyday household tasks that will be used to train generative AI systems.

Guyana Haiti Jamaica Nicaragua Peru Suriname Part-time Entry Level AI (Artificial Intelligence)
Generative AI
1 hour, 30 minutes ago
Mindrift.ai: Be the “I” in AI

Statistics & Python Expert - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking statistics specialists for project-based AI work focused on designing and validating computational mathematics problems for leading tech companies.

United Kingdom Part-time Junior AI (Artificial Intelligence)
Up to $0k
C MATLAB NumPy Pandas Python R SciPy SQL
1 hour, 33 minutes ago
Mindrift.ai: Be the “I” in AI

Optical Engineer - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking optical and physics specialists for project-based AI work focused on creating and verifying challenging optics and physics problems for leading tech companies.

Austria Belgium Sweden Denmark Finland Ireland Part-time Junior AI (Artificial Intelligence)
Up to $94k
1 hour, 56 minutes ago
MongoDB

Head of AI Platform, GM

MongoDB 1K-5K Internet Software & Services

MongoDB is hiring a Head of AI Platform, GM to lead a new AI Applications Platform business, owning its product vision, execution, and commercial growth from early stage to scale.

United States Full-time Lead AI (Artificial Intelligence) Technical Product Manager
$203k-$399k
AWS Azure GCP MongoDB
2 hours, 4 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers