Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Build realistic virtual developer environments with codebases, infrastructure, and supporting context such as tickets, docs, and conversations.
  • Design tasks from intermediate states of the simulated environments and define clear criteria for what counts as solved.
  • Write tests to verify agent solutions, accepting valid approaches and rejecting incorrect ones.
  • Review AI agent solutions, analyze failures, and refine tasks and tests based on QA feedback.
  • Iterate on evaluation criteria to make the benchmarking process fair, robust, and challenging for advanced models.
  • Ensure tasks are solvable by an AI agent while still representing realistic developer work.
  • Work within a project-based workflow to complete assigned tasks by the submission deadline.

Requirements

  • 5+ years of experience in software development.
  • Experience with Python and FastAPI.
  • Experience with JavaScript or TypeScript and React.
  • Experience with Docker, Postgres, Kafka, and Redis.
  • Experience writing functional and integration tests.
  • English proficiency at B2 level or higher.
  • Ability to evaluate coding tasks and determine whether solutions are correct and complete.
  • CV must be submitted in English.
  • Availability to complete tasks estimated at about 20 hours each, with self-directed scheduling.
  • Experience with AI coding evaluation or similar benchmarking work is a plus.

Benefits

  • Up to $50/hr equivalent compensation, depending on level and pace.
  • Project-based work with flexible scheduling.
  • Estimated 20 hours per task, with the ability to choose when and how to work.
  • Payment upon completing accepted tasks.
  • Opportunity to work on leading-edge AI evaluation projects for major tech companies.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Video Collection (LATAM) - Freelance AI Trainer Project

Meridial Marketplace, by Invisible 501-1000 information technology & services

A LATAM-based recording role with an unspecified company capturing short first-person videos of everyday manual tasks using a head-mounted smartphone.

1 hour, 27 minutes ago

Video Collection (LATAM) - Freelance AI Trainer Project

Meridial Marketplace, by Invisible 501-1000 information technology & services

LATAM-based video contributors are needed to record first-person footage of everyday manual tasks for a client project focused on real-world household and, where applicable, commercial activities.

1 hour, 27 minutes ago

Video Collection (LATAM) - Freelance AI Trainer Project

Meridial Marketplace, by Invisible 501-1000 information technology & services

LATAM-based video contributors are needed to record first-person footage of everyday manual tasks using a head-mounted smartphone for client-approved data collection.

1 hour, 42 minutes ago

Creador(a) de Contenido POV para IA - Remoto

Toloka 251-1K Internet Software & Services

Proyecto remoto y flexible con una empresa de entrenamiento de IA que paga a personas por grabar actividades cotidianas reales desde casa para ayudar a entrenar sistemas de IA y robótica.

1 hour, 57 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers