RemoteLeaf Logo
Log in Sign up

AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (US)

4 hours, 24 minutes ago
United States
Contract
Lead
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Machine Learning
Apply Now
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250
View All Jobs 57

Description

  • Review AI-generated responses for clarity, accuracy, correctness, relevance, and overall quality.
  • Annotate and label language content according to detailed project guidelines.
  • Generate or evaluate prompts based on assignment requirements.
  • Identify linguistic errors, dataset concerns, and structural inconsistencies.
  • Provide structured feedback to improve AI performance.
  • Communicate language requirements clearly to linguistic and non-linguistic stakeholders.
  • Collaborate with QA Leads and clients to apply feedback and maintain quality standards.
  • Attend daily client-facing meetings with camera on.
  • Submit daily work reports and meet productivity and quality expectations.

Requirements

  • Professional fluency in Italian with strong written and verbal communication skills.
  • At least 8 years of experience in localization, AI training, or a related field.
  • Bachelor’s degree in linguistics, languages, computer science, or a related field, or equivalent professional experience.
  • Italian degree or certification where required.
  • Strong analytical skills and exceptional attention to detail.
  • Experience identifying language patterns, errors, inconsistencies, and subtle linguistic issues.
  • Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is preferred.
  • Interest in artificial intelligence, machine learning, language technology, or data annotation.
  • Ability to learn new tools, follow detailed guidelines, and adapt to changing requirements.
  • Ability to work independently and collaborate effectively with a global team.
  • Commitment to a minimum six-month engagement with consistent availability.
  • Availability for consecutive eight-hour shifts during core hours of 8:00 AM–5:00 PM PST and daily meetings from 10:00 AM–12:00 PM PST.
  • Applicants must reside outside the listed restricted countries and territories.

Benefits

  • Italian compensation of $14–$18 USD per hour.
  • Project-specific training, guidance, and ongoing feedback.
  • Hands-on experience on a global artificial intelligence project.
  • Opportunities to build skills in AI evaluation, annotation, prompt review, and language quality.
  • Collaboration with QA Leads, international teams, and client stakeholders.
  • Independent contractor engagement with no paid holidays or paid time off.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

B

GenAI Senior Integrated Designer

Brandtech+ 501-1000 Marketing services

Brandtech+ is seeking a remote GenAI Senior Integrated Designer to create and deliver digital, social, e-commerce, motion, and brand campaign assets using traditional design and GenAI workflows.

South Africa Senior AI (Artificial Intelligence) Graphic Designer
Digital Marketing Figma Generative AI Instagram API TikTok
3 hours, 24 minutes ago
Abacus Insights

Senior AI Systems Quality Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Senior AI Systems Quality Engineer to build and operate automated quality, evaluation, and release-readiness platforms for agentic AI systems supporting mission-critical healthcare decisions.

United States Full-time Senior AI (Artificial Intelligence) SDET (Software Development Engineer in Test)
AWS CI/CD Databricks Datadog Grafana MLflow Prometheus Python TypeScript
3 hours, 24 minutes ago
Toloka

POV Video Recording Job - Home & Daily Life Activities

Toloka 251-1K Internet Software & Services

Participate remotely in an AI training project by recording POV videos of everyday household activities using your smartphone to help improve AI and robotics systems.

Brazil Part-time Entry Level Data Annotator
$12k-$12k
4 hours, 39 minutes ago
Weekday

PDF Annotation & Transcription Experts - Odiya

Weekday 11-50 Construction & Engineering

As an Odiya document annotation specialist for a client, you will create structural annotations and exact Odiya-script transcriptions of diverse PDF pages to build training data for document-understanding models.

India Contract Mid Level Data Annotator
$26k-$26k
4 hours, 39 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers