Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Information Technology

166 open positions

Links

View All Jobs

Freelance Agent Evaluation Engineer

2 days, 12 hours ago

Sweden, Belgium, Denmark, Finland, Ireland, Norway

Part-time

Senior

AI (Artificial Intelligence)

Software Development

Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript

Apply Now

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

View All Jobs 166

Description

Build realistic virtual developer environments with codebases, infrastructure, and supporting context such as tickets, documentation, and conversations.
Design tasks from intermediate states of those environments and define clear criteria for what counts as a solved task.
Write tests that validate agent solutions, accepting all correct approaches and rejecting incorrect ones.
Review agent solutions, analyze failure cases, and refine tasks and tests based on QA feedback.
Iterate on evaluation materials until the dataset is fair, robust, and effective at measuring model performance.
Ensure each task is solvable by an AI agent and grounded in realistic developer workflows.

Requirements

5+ years of experience in software development.
Core stack experience with Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis.
Experience writing functional and integration tests.
English proficiency at B2 level or higher.
Submit a CV in English.
Ability to work on a project-based basis rather than as permanent employment.
Ability to complete tasks estimated at around 20 hours each and submit them by the deadline.
Experience identifying where AI models fail in coding tasks (preferred).

Benefits

Up to $50/hr equivalent compensation, depending on level and pace.
Project-based flexibility with tasks you choose when and how to work.
Estimated 20 hours per task, allowing self-paced scheduling.
Payment for completed tasks after passing qualification(s) and joining a project.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

MBA Internship - GTM Analytics & AI Strategy

Ottimate IT Services

Ottimate is seeking a part-time MBA or graduate intern in Mexico to work with GTM leadership on AI- and data-driven initiatives that improve business performance tracking, analysis, and forecasting.

Mexico Part-time Entry Level AI (Artificial Intelligence) Data Analyst

$42k-$42k

CRM Generative AI LLM Pandas Power BI Python SQL Tableau

12 hours, 9 minutes ago

Apply

12 hours, 9 minutes ago

Part Time Instructor - Fullstack AI

Fullstack Academy 11-50 Diversified Consumer Services

Fullstack Academy is hiring a part-time online instructor for its Fullstack AI program to teach adult learners, support their progress, and connect modern full stack and AI concepts to real-world application development.

United States Part-time Senior AI (Artificial Intelligence) Teacher

$104k-$125k

Agile Angular AWS Azure CI/CD CSS Django Express.js Flask GCP Generative AI Git HTML JavaScript MongoDB Node.js Python React REST API

12 hours, 9 minutes ago

Apply

12 hours, 9 minutes ago

Creador(a) de Contenido POV para IA - Remoto

Toloka 251-1K Internet Software & Services

Proyecto remoto y flexible con una empresa de entrenamiento de IA que paga a personas por grabar actividades cotidianas desde casa para ayudar a entrenar sistemas de IA y robótica.