Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Information Technology

52 open positions

Links

View All Jobs

Freelance Agent Evaluation Engineer

1 hour, 29 minutes ago

Mexico, Chile, Peru, Colombia, Costa Rica, Uruguay

Part-time

Senior

AI (Artificial Intelligence)

Software Development

Cybersecurity Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript

Apply Now

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

View All Jobs 52

Description

Build realistic virtual developer environments with codebases, infrastructure, and supporting context such as tickets, docs, and conversations.
Design solvable evaluation tasks from intermediate environment states and define clear completion criteria.
Write tests that validate agent solutions and distinguish correct implementations from incorrect ones.
Review agent outputs, analyze failure cases, and iterate on tasks and tests based on QA feedback.
Ensure evaluation tasks are fair, robust, and capable of challenging advanced AI coding models.
Collaborate within a project-based workflow to complete tasks and receive payment per accepted task.

Requirements

5+ years of experience in software development.
Experience with the core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis.
Experience writing functional and integration tests.
English proficiency at B2 level or higher.
A Master’s degree in Computer Science, Software Engineering, Data Science/Data Analytics, Artificial Intelligence/Machine Learning, Computational Linguistics/NLP, Information Systems, or a related field.
A bachelor’s degree is accepted if the candidate has 5 years of experience in the field.
At least 3 years of professional experience in related QA-automation/testing or cybersecurity roles.
Ability to submit a CV in English and indicate English proficiency level.

Benefits

Paid per accepted task, with earnings up to the equivalent of $40/hr.
Remote, part-time freelance work that fits around other commitments.
Opportunity to work on advanced AI projects and strengthen your portfolio.
Chance to influence how future AI models perform in your area of expertise.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Quality Assurance Engineer [Zeal]

Livefront 11-50 Internet Software & Services

Zeal, now part of Livefront, is hiring a Quality Assurance Engineer in Peru to help clients deliver reliable software across web, mobile, API, and integrated systems.

Peru Mid Level QA Engineer SDET (Software Development Engineer in Test)

Appium Azure C# CI/CD Cypress Git GitHub Actions Java JavaScript Jenkins Playwright Postman Python REST API Selenium SQL TypeScript

30 minutes ago

Apply

30 minutes ago

Senior QA Engineer – API Testing

Medium 51-250 Internet Software & Services

Nuvolar is hiring a Senior QA Engineer for a remote healthcare project in Spain to shape quality strategy for a digital health platform handling sensitive data, integrations, and critical workflows.

Spain Full-time Senior QA Engineer SDET (Software Development Engineer in Test)

Agile AWS CI/CD Docker DynamoDB GitHub GitHub Actions Java Maven OpenAPI Playwright PostgreSQL Postman REST API Scrum Spring Boot SQL

59 minutes ago

Apply

59 minutes ago

AI Tutor - Hindi

x.ai 51-250 Internet Software & Services

SpaceXAI is hiring an AI Tutor focused on multilingual audio to help train Grok for better voice interactions, speech recognition, and audio understanding across languages and accents.