RemoteLeaf Logo
Log in Sign up

AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian

2 hours, 57 minutes ago
Albania, Italy, Romania
Contract
Entry Level
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Machine Learning
Apply Now
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250
View All Jobs 50

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide clear, structured feedback to support improvements in AI performance.
  • Communicate complex language requirements to linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Participate in required client-facing meetings with your camera on.
  • Submit daily work reports and consistently meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • Bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience.
  • A degree or certification in Italian, where required.
  • Strong analytical skills and exceptional attention to detail.
  • Ability to identify patterns, errors, inconsistencies, and subtle language issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required.
  • Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements.
  • Strong organization and task-management skills.
  • Ability to commit to the project for a minimum of six months and maintain consistent availability.
  • Work consecutive eight-hour shifts and remain available during core hours of 8:00 AM–5:00 PM PST.
  • Attend daily client meetings scheduled between 10:00 AM–12:00 PM PST.

Benefits

  • Gain practical experience working on a global Artificial Intelligence project.
  • Build skills in AI evaluation, annotation, prompt review, and language quality.
  • Work directly with QA Leads, international teams, and client stakeholders.
  • Receive project-specific training, guidance, and ongoing feedback.
  • Italian rate of $14 to $16.00 USD per hour.
  • Independent contractor engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

INFUSE

Production AI Innovation Lead (Contract, Remote)

INFUSE 251-1K Professional Services

INFUSE Academy is hiring a design-and-AI specialist to create learning experiences by developing, testing, and scaling new production workflows and learning assets.

Bulgaria Contract Senior AI (Artificial Intelligence) UX Researcher
Figma Illustrator Photoshop
2 hours, 12 minutes ago
INFUSE

Production AI Innovation Lead (Contract, Remote)

INFUSE 251-1K Professional Services

INFUSE Academy is seeking a design-and-operations-focused learning experience role to develop, test, standardize, and scale AI-enabled workflows for course and learning asset production.

Italy Contract Senior AI (Artificial Intelligence) Design Lead
Figma
2 hours, 12 minutes ago
INFUSE

Production AI Innovation Lead (Contract, Remote)

INFUSE 251-1K Professional Services

INFUSE Academy is hiring a design-and-AI-focused learning experience creator to develop, test, and scale workflows that power course and learning asset production.

Slovenia Contract Senior AI (Artificial Intelligence) Design Lead
Figma Illustrator Photoshop
2 hours, 12 minutes ago
INFUSE

Production AI Innovation Lead (Contract, Remote)

INFUSE 251-1K Professional Services

INFUSE Academy is seeking a design-and-operations focused learning experience creator to develop, test, and scale AI-enabled workflows for building courses and learning assets.

Poland Contract Senior AI (Artificial Intelligence) Design Lead
Figma
2 hours, 27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers