Evaluate AI-generated responses using professional email history and account activity.
Assess outputs for accuracy, relevance, helpfulness, and personalization quality.
Identify unsupported assumptions, incorrect personalization, and irrelevant recommendations.
Compare multiple responses and select the stronger overall result.
Provide clear and structured evaluation feedback.
Follow detailed project guidelines and quality standards.
Maintain confidentiality and comply with data privacy requirements.
Complete assigned evaluations accurately and within project timelines.

Requirements

Native-level proficiency in Japanese.
At least 2 years of professional experience.
An active Google Workspace or Corporate Gmail account used regularly for professional communication.
A business inbox with predominantly Japanese-language emails and approximately 1,000 or more messages.
Gmail display language set to Japanese.
Willingness to use the business account for evaluation and sign the required consent form.
Ability to commit part-time (20 hours/week) or full-time (40 hours/week) with at least 4 hours of PST overlap.
Availability for a 16-week contractor assignment.
Remote location in India, Mexico, Bangladesh, Brazil, Colombia, or Egypt.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI/ML Engineer — Generative AI Mission Systems

Rackner 11-50 Internet Software & Services

Rackner is hiring a remote U.S.-based AI/ML Engineer to integrate generative AI capabilities into secure mission software supporting a national-security planning and decision-support application.

United States Contract Mid Level AI (Artificial Intelligence)

Cybersecurity DevSecOps Generative AI Kubernetes LLM OpenShift Python

15 minutes ago

Apply

15 minutes ago

Ex-MBB Strategy Consultant - AI Training (Remote)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift, powered by Toloka, is seeking experienced strategy consultants to help build management consulting learning environments and evaluation tasks for AI systems.

Canada Part-time Junior AI (Artificial Intelligence)

$125k-$125k

Generative AI Machine Learning Reinforcement Learning

30 minutes ago

Apply

30 minutes ago

Clinical Informaticist / Clinical AI Specialist

Curai Health 51-250 Health Care Providers & Services

Curai Health is hiring a Clinical Informaticist / Clinical AI Specialist to help shape AI-powered primary care workflows, safety standards, and research at the intersection of medicine and AI.