AI Evaluation Engineer (Python, QA or Security)

14 hours, 17 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Build realistic virtual developer environments with codebases, infrastructure, tickets, docs, and conversation history.
  • Design tasks from intermediate environment states and define clear success criteria for each task.
  • Create prompts and determine what it means for an AI agent’s solution to be considered solved.
  • Write tests that validate correct solutions while rejecting incorrect ones.
  • Review agent solutions, analyze failures, and iterate on tasks and tests based on QA feedback.
  • Refine evaluation materials until they are fair, robust, and reliably assess model performance.

Requirements

  • 5+ years of experience in software development.
  • Experience with the core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis.
  • Experience writing functional and integration tests.
  • English proficiency at B2 level or higher.
  • CV must be submitted in English.
  • This is project-based work rather than permanent employment.

Benefits

  • Up to $50/hr equivalent compensation, depending on level and pace.
  • Tasks estimated at approximately 20 hours each.
  • Flexible schedule with self-managed pacing.
  • Project-based AI opportunity with leading tech companies.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Founding BDR — AI Consulting (Outbound + Pipeline)

PHIZENIX 11-50 information technology & services

Phizenix is hiring its first outbound sales rep to generate and qualify leads for AI agent services and keep a strong pipeline moving to founder-led closing.

CRM Salesforce
13 hours, 17 minutes ago

GenAI Motion Graphics Designer

OLIVER 1K-5K Media

OLIVER is hiring a remote GenAI Motion Designer in Toronto to create and localize high-volume motion and static marketing assets for a leading vacuum and floorcare brand across the U.S. and other markets.

Copywriting Design Systems E-commerce Generative AI Illustrator Photoshop
14 hours, 17 minutes ago

Materials & Technical Compliance Engineer

rePurpose Global 51-250 Professional Services

rePurpose Global is seeking a Materials & Technical Compliance Engineer to analyze product and packaging materials, determine regulatory classifications, and support defensible compliance filings for packaging sustainability and EPR obligations.

ERP Python SQL
14 hours, 17 minutes ago

AI Trainer - Electrical Engineers - CAD/Python Expertise - (Remote Advisory - Norway)

Prolific 51-250 Professional Services

Prolific is recruiting Electrical Engineers for a remote advisory expert network project that helps train AI models using real-world CAD design and validation workflows.

Linux Python
1 day, 13 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers