Labeler / Annotator – AI Response Evaluation (Japanese)

1 hour, 9 minutes ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side comparisons of AI-generated responses from different models.
  • Evaluate outputs for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context in Japanese responses.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations across tasks.
  • Review AI responses across general-purpose Q&A, web search, file-based, image-based, and conversation tasks.
  • Support the evaluation of both single-turn and multi-turn interactions.
  • Complete training, calibration, and qualification activities before moving into production work.

Requirements

  • Native or professional fluency in Japanese.
  • Strong English reading comprehension for following evaluation guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization is preferred.
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis is preferred.

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of R$75–R$85 BRL.
  • Estimated monthly equivalent of R$12,000–R$13,600 BRL for full-time work.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits such as paid leave and 13th salary where applicable.
  • Social security and healthcare contributions.
  • Additional benefits aligned with local market practices.
  • Structured onboarding with training sessions, practice exercises, calibration, and qualification review.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI, Intern

G-P/Globalization Partners 1K-5K Professional Services

G-P is hiring a 3rd year Computer Science intern to join its Generative AI and NLP team and help develop, test, and improve AI systems for its global HR platform.

Agile AWS Azure Deep Learning GCP Generative AI Git Machine Learning Neural Networks NLP NLTK Python PyTorch spaCy TensorFlow
1 hour, 9 minutes ago

AI Solutions Architect (IT)

Fortis Games 251-1K Internet Software & Services

Fortis Games is hiring an AI Solutions Architect to lead AI-driven IT architecture and automation across its internal systems, with a focus on security, scalability, and operational efficiency.

AWS Azure GCP Generative AI LLM MLOps
1 hour, 9 minutes ago

AI Field Consultant

instacart.careers 1K-5K Internet Software & Services

Instacart’s Enterprise AI Pod is hiring an AI Field Consultant to work directly with B2B retail and CPG partners to identify high-value AI use cases, shape requirements, and drive adoption in the field.

ERP LLM Looker Machine Learning Oracle Power BI SAP Snowflake Tableau
1 hour, 24 minutes ago

Statistics & Python Expert - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking statistics specialists for project-based AI work focused on designing and validating computational mathematics problems for leading tech companies.

C MATLAB NumPy Pandas Python R SciPy SQL
1 hour, 35 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers