Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Information Technology

297 open positions

Links

View All Jobs

Freelance Agent Evaluation Engineer

2 days ago

France

Part-time

Senior

AI (Artificial Intelligence)

Software Development

Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript

Apply Now

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

View All Jobs 297

Description

Build realistic virtual development environments with codebases, infrastructure, and supporting context such as tickets, docs, and conversations.
Design tasks from intermediate states of those environments, including the prompt and clear criteria for what counts as a solved task.
Write functional and integration tests that validate agent solutions and distinguish correct from incorrect approaches.
Review agent outputs, analyze failures, and iterate on tasks and tests based on QA feedback.
Refine evaluation criteria to ensure tasks are fair, robust, and solvable by an AI agent.
Guide and evaluate the agent’s work rather than writing the full code from scratch.

Requirements

5+ years of experience in software development.
Experience with Python (FastAPI).
Experience with JavaScript/TypeScript (React).
Experience with Docker, Postgres, Kafka, and Redis.
Experience writing functional and integration tests.
English proficiency at B2 level or higher.
CV must be submitted in English.
Availability for project-based work with tasks estimated at about 20 hours each.
Ability to complete tasks by the deadline and meet acceptance criteria.

Benefits

Up to $50/hr equivalent compensation, depending on level and pace.
Flexible schedule with self-directed work timing.
Project-based engagement rather than permanent employment.
Estimated ~20 hours per task, depending on complexity.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Freelance Annotator (English) - AI Trainer

Toloka 251-1K Internet Software & Services

Toloka is hiring freelance annotators to support generative AI projects by reviewing and labeling online content for factual accuracy, safety, and clarity when projects are available.

India Freelance Junior AI (Artificial Intelligence) Data Annotator

Up to $19k

Generative AI

1 minute ago

Apply

1 minute ago

Freelance Annotator (English) - AI Trainer

Toloka 251-1K Internet Software & Services

Toloka is hiring freelance annotators for project-based work on generative AI tasks, helping evaluate and improve AI outputs through remote online assignments.

Portugal Part-time Junior AI (Artificial Intelligence) Data Annotator

Up to $0k

Generative AI

1 minute ago

Apply

1 minute ago

Triage Associate I (Contractor)

Latitude AI 501-1000 information technology & services

Latitude AI, a Ford Motor Company subsidiary, is hiring a Triage Operations team member to analyze autonomous vehicle test data and help identify, classify, and escalate performance issues across its ADAS development program.