AI Writing Evaluators (Domain Experts) - English Expertise

1 hour, 52 minutes ago
Contract
Senior
Artificial Intelligence and Machine Learning
Volga Partners

Volga Partners

Volga Partners is a technology company that provides innovative solutions and services to clients. With expertise in ML, AI, and crowd management, we deliver high-quality software development, data annotation, content management, data mining, analytics...

Internet Software & Services
51-250

Description

  • Create structured, domain-specific prompts using relevant concepts, terminology, and professional context.
  • Evaluate AI-generated responses for accuracy, factual correctness, relevance, clarity, coherence, and logical flow.
  • Assess whether AI outputs use appropriate domain-specific language and tone.
  • Provide detailed written feedback and ratings according to project guidelines and evaluation frameworks.
  • Identify inconsistencies, gaps, and opportunities to improve AI-generated responses.
  • Participate in calibration sessions and follow task assignments communicated via email, Slack, or the client portal.
  • Maintain daily availability for 8 hours per day throughout the full 2-week project period.
  • Apply US-based contextual standards when writing and evaluating responses.

Requirements

  • Strong academic or professional background in Business Operations & Communications or Education and Academic Research.
  • Expert-level written English.
  • Strong logical reasoning and analytical skills.
  • Ability to interpret structured evaluation rubrics.
  • Meticulous attention to detail and ability to provide constructive, actionable feedback.
  • Ability to work independently while maintaining consistent daily availability for 8 hours per day.
  • Reliable high-speed internet and a functioning device such as a laptop or desktop.
  • Must be available for a fixed 2-week retainer engagement and able to start immediately after onboarding.
  • Must pass a project-specific qualification assessment, including a writing sample and evaluation exercise.
  • Familiarity with AI tools such as ChatGPT, Claude, or Gemini is preferred but not required.

Benefits

  • Remote work from any global location.
  • Retainer compensation for 8 hours per day for the full 2-week project, even if tasks are temporarily unavailable.
  • Competitive hourly rate in USD.
  • Starting compensation in Canada of USD $20–23 per hour DOE.
  • Independent contractor engagement (1099 or local equivalent).
  • Onboarding support through Gusto.com or Deel.com for global contractors.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Shape the Future of AI — Cantonese Talent Hub

Welo Global Professional Services

Welo Data, part of Welocalize, is recruiting freelance Cantonese talent to support remote AI data work for global clients by contributing to the training and evaluation of human-centered AI systems.

46 minutes ago

Senior Consultant - AI

3Cloud 251-1K Internet Software & Services

3Cloud is hiring a Senior Consultant in AI to design, build, and deliver modern AI/ML solutions for clients with a high degree of independence.

Azure Databricks Machine Learning Microservices Power BI
52 minutes ago

Freelance Annotator (English) - AI Trainer

Toloka 251-1K Internet Software & Services

Toloka is seeking freelance annotators to support generative AI projects by reviewing and labeling data, evaluating outputs, and helping improve how AI systems understand and respond to real-world content.

Generative AI
55 minutes ago

UX Writer, AI

Figma 1K-5K Internet Software & Services

Figma is hiring a Senior UX Writer to shape language and content strategy for AI-powered product experiences across its design platform, working from New York, San Francisco, or remotely in the US.

Figma GitHub
1 hour, 8 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers