Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Information Technology

60 open positions

Links

View All Jobs

Freelance Agent Evaluation Engineer

1 hour, 32 minutes ago

Argentina

Part-time

Senior

AI (Artificial Intelligence)

Artificial Intelligence and Machine Learning

CI/CD Docker FastAPI GitHub Actions JavaScript Kafka Linux PostgreSQL Pytest Python React Redis REST API TypeScript

Apply Now

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

View All Jobs 60

Description

Build virtual company environments with codebases, infrastructure, conversations, documentation, and tickets that simulate real development history.
Assemble tasks from intermediate states of a virtual company by crafting prompts, defining evaluation criteria, and ensuring tasks are solvable and fair.
Design isolated developer-workstation environments with Linux tools, MCP servers, and a real web application codebase.
Write tests that accept all correct solutions and reject incorrect ones without being overly strict or overly lenient.
Iterate with an AI agent to verify tests catch real issues, do not miss bad solutions, and do not break on valid solutions.
Review agent-written code, analyze agent success or failure, and design edge cases and adversarial scenarios.
Incorporate feedback from expert QA reviewers and revise work based on quality scoring criteria.
Submit completed tasks by the deadline and meet acceptance criteria for payment.

Requirements

CV must be submitted in English.
English proficiency at B2 level.
5+ years of software development experience, primarily in Python.
Experience with FastAPI, pytest, async/await, subprocess, and file operations.
Background in full-stack development, including React-based interfaces and JavaScript/TypeScript.
Experience building robust back-end systems.
Experience writing functional and integration tests.
Experience with Docker containers and infrastructure tools such as Postgres, Kafka, and Redis.
Understanding of CI/CD, especially GitHub Actions triggers, labels, and reading results.
Degree in Computer Science, Software Engineering, or a related field (preferred).
Comfort reading and reasoning about code across the stack.
Open to part-time, non-permanent, project-based work.

Benefits

Compensation of up to $17 per hour equivalent, depending on contribution level and pace.
Project-based work with flexibility to choose when and how to work.
Estimated workload of about 20 hours per project, depending on complexity.
Opportunity to work with leading tech companies on AI evaluation projects.
Payment for completed tasks that meet acceptance criteria.
Potential access to different projects with varying earning levels on the platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Trainer - Freelance Data Annotator

Toloka 251-1K Internet Software & Services

Toloka Annotators is seeking freelance annotators to support generative AI projects by reviewing and labeling online content for factual accuracy and quality when projects are available.

United States Part-time Junior AI (Artificial Intelligence) Data Annotator

Up to $48k

Generative AI

31 minutes ago

Apply

31 minutes ago

AI Voice Trainer

Wing Assistant 51-250 Professional Services

Wing Data is hiring freelance voice data contributors in Andhra Pradesh for remote, project-based AI training work that uses short recorded prompts and guided conversations to improve speech systems.

India Freelance Entry Level AI (Artificial Intelligence)

$4k-$8k

46 minutes ago

Apply

46 minutes ago

Validation Engineer I

KPI Solutions 251-1K Industrial Conglomerates

KPI Solutions is hiring a Validation Engineer I to support the qualification and testing of complex automation systems for clients in a fast-paced, project-driven environment.