AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (Canada)

23 hours, 12 minutes ago
Contract
Entry Level
Artificial Intelligence and Machine Learning
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide clear, structured feedback to support improvements in AI performance.
  • Communicate complex language requirements to both linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Participate in required client-facing meetings with camera on.
  • Submit daily work reports and meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
  • A degree or certification in Italian, where required.
  • Strong analytical skills and exceptional attention to detail.
  • Ability to identify patterns, errors, inconsistencies, and subtle language issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required.
  • Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements.
  • Strong organization and task-management skills.
  • Ability to commit to the project for a minimum of six months, work consecutive eight-hour shifts, and remain available during 8:00 AM–5:00 PM PST, including daily meetings between 10:00 AM–12:00 PM PST.
  • Must reside outside the listed restricted countries.
  • Independent contractor engagement with only approved and properly logged hours compensated.

Benefits

  • $14 to $18.00 USD per hour for Italian, with rates varying by language and project requirements.
  • Project-specific training, guidance, and ongoing feedback.
  • Practical experience on a global AI project.
  • Opportunity to build skills in AI evaluation, annotation, prompt review, and language quality.
  • Experience working with QA Leads, international teams, and client stakeholders.
  • No paid holidays or paid time off, as this is an independent contractor engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Managing Principal - AI Strategy

3Cloud 251-1K Internet Software & Services

3Cloud is hiring a Managing Principal, AI Strategy to lead its enterprise AI center of excellence and advise clients on complex AI transformations across strategy, architecture, delivery, and adoption.

Azure Databricks Generative AI Machine Learning
23 hours, 12 minutes ago

Senior Python Engineer - AI Coding Agent Evaluation (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a project-based software specialist to create and evaluate realistic AI coding tasks and test criteria for benchmarking coding agents in simulated developer environments.

Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript
23 hours, 12 minutes ago

Freelance Annotator (English) - AI Trainer

Toloka 251-1K Internet Software & Services

Toloka is hiring freelance annotators to support generative AI projects by reviewing and labeling online content for accuracy, quality, and safety when work is available.

Generative AI
23 hours, 12 minutes ago

Freelance: grabación de tareas cotidianas para proyecto de IA

Toloka 251-1K Internet Software & Services

Persona para grabar actividades cotidianas en primera persona con una app móvil para ayudar a entrenar sistemas de IA y robótica.

23 hours, 12 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers