RemoteLeaf Logo
Log in Sign up

AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (Canada)

1 month ago
Canada
Contract
Entry Level
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Machine Learning
Apply Now
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250
View All Jobs 55

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide clear, structured feedback to support improvements in AI performance.
  • Communicate complex language requirements to both linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Participate in required client-facing meetings with camera on.
  • Submit daily work reports and meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
  • A degree or certification in Italian, where required.
  • Strong analytical skills and exceptional attention to detail.
  • Ability to identify patterns, errors, inconsistencies, and subtle language issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required.
  • Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements.
  • Strong organization and task-management skills.
  • Ability to commit to the project for a minimum of six months, work consecutive eight-hour shifts, and remain available during 8:00 AM–5:00 PM PST, including daily meetings between 10:00 AM–12:00 PM PST.
  • Must reside outside the listed restricted countries.
  • Independent contractor engagement with only approved and properly logged hours compensated.

Benefits

  • $14 to $18.00 USD per hour for Italian, with rates varying by language and project requirements.
  • Project-specific training, guidance, and ongoing feedback.
  • Practical experience on a global AI project.
  • Opportunity to build skills in AI evaluation, annotation, prompt review, and language quality.
  • Experience working with QA Leads, international teams, and client stakeholders.
  • No paid holidays or paid time off, as this is an independent contractor engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Toloka

Creador(a) de Contenido POV para IA - Remoto

Toloka 251-1K Internet Software & Services

Proyecto remoto de entrenamiento de IA que solicita grabar actividades domésticas cotidianas desde casa para contribuir al desarrollo de sistemas de IA y robótica.

Ecuador Part-time Entry Level Data Annotator
$12k-$12k
19 hours, 29 minutes ago
Toloka

Freelance: grabación de tareas cotidianas para proyecto de IA

Toloka 251-1K Internet Software & Services

Participa como creador de datos para proyectos de IA y robótica grabando actividades cotidianas en primera persona mediante una aplicación móvil.

United States Part-time Entry Level Data Annotator
$21k-$21k
19 hours, 29 minutes ago
phData

AI & Data Strategy Architect

phData 251-1K IT Services

The AI & Data Strategy Architect at phData advises enterprise clients on using data and AI for business transformation, developing strategies and roadmaps while leading advisory engagements and expanding the practice.

United States Full-time Lead AI (Artificial Intelligence)
AWS Azure dbt Machine Learning Snowflake
1 day, 17 hours ago
Nimble Gravity

Senior Architect, Anthropic Enablement

Nimble Gravity 51-250 IT Services

Nimble Gravity is hiring a remote US Senior Architect to lead Anthropic-focused technical presales, enablement, and delivery sessions that help clients adopt Claude Code and Claude Cowork for measurable business outcomes.

United States Senior AI (Artificial Intelligence) Sales Engineer
CI/CD
1 day, 18 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers