AI Data Quality Control Coordinator

2 weeks ago
Freelance
Mid Level
Artificial Intelligence and Machine Learning
Welo Global

Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services
Founded 1997

Description

  • Perform sampling and quality checks on annotated datasets across text, image, audio, and video formats.
  • Identify, log, and categorize annotation defects, including labeling errors, boundary issues, and misclassification.
  • Track corrective actions and rework tasks through closure and validate re-tests.
  • Coordinate onboarding, calibration, and refresher training sessions for annotators and reviewers.
  • Maintain annotation guidelines, SOPs, and rubrics with proper version control and communication.
  • Prepare client-ready quality reports with tables, charts, and summaries.
  • Liaise with Project Managers and Operations teams on timelines, reporting, and audit requirements.
  • Manage access permissions for annotation tools, QA platforms, and shared repositories.
  • Support vendor coordination by handling documentation requests, SLAs, and quality expectations.
  • Identify process gaps and recommend improvements to QA workflows, templates, and sampling approaches.

Requirements

  • Bachelor’s degree in any discipline; Data Science, Computer Science, Linguistics, or related fields are preferred.
  • 2–4 years of experience in Quality Control or Quality Assurance within AI data annotation, data labeling, or content moderation.
  • Strong understanding of annotation workflows such as bounding boxes, segmentation, classification, and transcription.
  • Familiarity with QA metrics including accuracy, precision/recall, F1 score, and inter-annotator agreement.
  • Proficiency in MS Excel or Google Sheets, including pivot tables, dashboards, and data analysis.
  • Experience with annotation tools such as Labelbox, CVAT, Scale AI, or similar platforms.
  • Exposure to NLP, Computer Vision, or Speech datasets.
  • Basic understanding of machine learning workflows and the data lifecycle.
  • Experience working with global clients and distributed or remote annotation teams.
  • Strong attention to detail, communication, coordination, and organizational skills in a fast-paced environment.

Benefits

  • Freelance remote role with the flexibility of working from anywhere.
  • Opportunity to contribute to cutting-edge AI projects.
  • Chance to build expertise in data quality and annotation processes.
  • Work on high-quality datasets that power intelligent systems.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Survey Specialist

Hireframe 51-250 Professional Services

Hireframe is seeking a Survey Fielding & Quality Specialist to launch, monitor, and maintain the quality of online survey projects from setup through clean data delivery.

16 minutes ago

Freelance Annotator (English) - AI Trainer

Toloka 251-1K Internet Software & Services

Toloka Annotators is seeking freelance annotators to support project-based AI training work by reviewing and labeling content to help improve generative AI outputs.

Generative AI
1 hour, 33 minutes ago

AI Data Specialist - Illinois (US)

RWS Group 5K-10K Internet Software & Services

RWS is hiring a remote, part-time AI Data Specialist in Illinois to help improve AI-generated content through English-language data tasks.

Machine Learning
3 hours, 17 minutes ago

Freelance Annotator (English) - AI Trainer

Toloka 251-1K Internet Software & Services

Toloka Annotators is seeking freelance annotators to support generative AI projects by reviewing and labeling content, checking accuracy, and helping improve how AI systems interpret real-world data.

Generative AI Machine Learning
5 hours, 24 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers