Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Information Technology

19 open positions

Links

View All Jobs

Freelance Agent Evaluation Engineer

3 days, 17 hours ago

Canada

Freelance

Senior

AI (Artificial Intelligence)

Artificial Intelligence and Machine Learning

Cybersecurity Docker FastAPI JavaScript Kafka Machine Learning PostgreSQL Python React Redis TypeScript

Apply Now

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

View All Jobs 19

Description

Build realistic simulated developer environments with codebases, infrastructure, tickets, documentation, and conversation history.
Design challenging tasks from intermediate environment states, including prompts and clear success criteria.
Write functional and integration tests that accept valid solutions and reject incorrect ones.
Review AI-generated solutions and analyze failures to identify weaknesses in tasks or evaluations.
Iterate on tasks and tests based on quality-assurance feedback to ensure fair, robust assessments.
Define scenarios that reveal meaningful differences between strong and weak AI coding solutions.

Requirements

At least 5 years of software development experience.
Proficiency with Python and FastAPI.
Experience with JavaScript or TypeScript and React.
Experience with Docker, PostgreSQL, Kafka, and Redis.
Experience writing functional and integration tests.
English proficiency at B2 level or higher.
Master’s degree in computer science, software engineering, data science, artificial intelligence, NLP, information systems, or a related field.
Bachelor’s degree accepted with at least 5 years of relevant experience.
At least 3 years of professional experience in related roles; specifically required for QA automation/testing or cybersecurity roles.

Benefits

Remote, part-time freelance work that can fit around other professional or academic commitments.
Payment per accepted task, with rates based on qualification tier and efficiency.
Potential compensation of up to the equivalent of $50 per hour.
Opportunity to work on advanced AI projects and strengthen your portfolio.
Opportunity to influence how future AI models perform in software development.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Analyst, Quality Control — BSA/AML & Sanctions Operations

Pathward 251-1K Diversified Financial Services

Pathward is seeking a Senior Analyst, Quality Control to independently review BSA/AML and sanctions operations, identify documentation and disposition issues, and provide examiner-ready feedback that improves quality and compliance.

Anywhere Full-time Senior QA Engineer

$60k-$100k

17 hours, 8 minutes ago

Apply

17 hours, 8 minutes ago

Biosecurity & AI Safety Fellowship

10A Labs Internet Software & Services

10a Labs is hiring Biology Subject Matter Experts for a short-term remote contract supporting biological content review, risk assessment, and AI safety and biosecurity systems.

United States Contract Mid Level AI (Artificial Intelligence)

$166k-$250k

17 hours, 23 minutes ago

Apply

17 hours, 23 minutes ago

AI Trainer - Freelance Data Annotator

Toloka 251-1K Internet Software & Services

Mindrift is seeking freelance AI annotators to review and label data for project-based efforts that test, evaluate, and improve AI systems when projects are available.