Labeler / Annotator – AI Response Evaluation (German)

1 month, 1 week ago
Full-time
Junior
Artificial Intelligence and Machine Learning
Blueprint Technologies

Blueprint Technologies

Blueprint Technologies specializes in delivering tailored business management and IT solutions that optimize cloud spending, enhance productivity, and drive innovation across various industries, including manufacturing, retail, finance, and healthcare.

Internet Software & Services
251-1K
Founded 2013

Description

  • Perform side-by-side (SBS) comparisons of AI-generated responses.
  • Evaluate responses for accuracy, relevance, clarity, and instruction-following.
  • Identify nuances in tone, meaning, and cultural context across German.
  • Apply detailed, scenario-specific annotation guidelines.
  • Maintain consistency and high-quality evaluations.
  • Review AI outputs across general Q&A, web search results, file-based and image-based responses, image and file generation tasks, and single-turn and multi-turn conversations.
  • Participate in structured onboarding, practice exercises, calibration, and qualification review before production work.

Requirements

  • Native or professional fluency in German.
  • Strong English reading comprehension for understanding guidelines.
  • Prior experience with side-by-side (SBS) labeling or annotation.
  • Excellent analytical thinking and attention to detail.
  • Ability to quickly understand and apply structured evaluation frameworks.
  • Background in linguistics, translation, or localization (preferred).
  • Experience in AI evaluation, data annotation, search relevance, or content quality analysis (preferred).

Benefits

  • Competitive compensation aligned with local markets and experience.
  • Estimated hourly range of ARS 15,000–ARS 17,000.
  • Estimated monthly equivalent for full-time work of ARS 2,400,000–ARS 2,720,000.
  • Locally compliant benefits through an Employer of Record (EOR) partner.
  • Statutory benefits such as paid vacation and aguinaldo/Sueldo Anual Complementario (SAC).
  • Social security contributions and healthcare coverage (Obra Social).
  • Additional benefits aligned with local market practices.
  • Structured onboarding with training sessions, practice exercises, and calibration against quality benchmarks.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Solutions Architect- Federal

HiddenLayer 11-50 IT Services

HiddenLayer is hiring a remote AI Solutions Architect for federal pursuits to lead technical pre-sales, design and deploy AI security platform implementations, and help mission owners secure AI systems across government environments.

AWS Azure CI/CD Docker GitHub Helm Hugging Face Kubernetes Machine Learning MLOps OpenShift Python PyTorch
18 hours, 49 minutes ago

AI Engagement Manager

instacart.careers 1K-5K Internet Software & Services

Instacart is hiring an AI Engagement Manager for its Enterprise AI Pod to coordinate complex B2B retail and CPG AI engagements from discovery through adoption and help translate field delivery into scalable execution.

Asana Confluence E-commerce JIRA Looker Power BI Salesforce Tableau
18 hours, 49 minutes ago

AI Creative (Illustrator)

Superside 251-1K Media

Superside is hiring a remote Illustrator to create brand, campaign, editorial, social, and digital visuals for leading brands, with the main goal of combining strong illustration craft and generative AI to deliver polished, on-brand creative at scale.

Generative AI Photoshop
19 hours, 19 minutes ago

AI Video Content Creator

Ejam 11-50 Media

eJam is hiring an entry-level AI Video Content Creator to support its consumer brand marketing work by turning ideas and images into video assets for fast-moving creative production.

19 hours, 19 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers