Freelance Agent Evaluation Engineer

11 hours, 40 minutes ago
Freelance
Senior
Artificial Intelligence and Machine Learning
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Build realistic simulated developer environments containing codebases, infrastructure, tickets, documentation, and conversation history.
  • Design challenging tasks from intermediate environment states, including prompts and solution criteria.
  • Write functional and integration tests that accept valid agent solutions and reject incorrect ones.
  • Review agent-generated solutions and analyze failures.
  • Iterate on tasks and tests based on QA feedback to improve fairness and robustness.
  • Define scenarios that reveal weaknesses in advanced AI coding models.

Requirements

  • 5+ years of software development experience.
  • Proficiency with Python and FastAPI.
  • Experience with JavaScript or TypeScript and React.
  • Experience with Docker, PostgreSQL, Kafka, and Redis.
  • Experience writing functional and integration tests.
  • English proficiency at B2 level or higher.
  • Master’s degree in Computer Science, Software Engineering, Data Science, AI/ML, NLP, Information Systems, or a related field.
  • A bachelor’s degree is accepted with 5 years of relevant experience.
  • Minimum 3 years of professional experience in related domains, particularly QA automation/testing or cybersecurity roles.
  • CV submitted in English with English proficiency indicated.

Benefits

  • Remote, part-time freelance work that can fit around professional or academic commitments.
  • Payment per accepted task, with rates up to the equivalent of $40 per hour.
  • Opportunity to work on advanced AI projects and strengthen your portfolio.
  • Opportunity to influence how future AI models understand and communicate in your area of expertise.
  • Project-based participation with a qualification and paid-task workflow.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

[Job-31733] Squad Leader / AI Orchestrator

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Scrum Master/AI Orchestrator to govern the end-to-end software development pipeline, coordinating people and AI agents while optimizing delivery flow, quality, cost, compliance, and business value.

Agile Scrum
10 hours, 55 minutes ago

Call Center Quality Analyst - Remote

Colibri Group 1K-5K Diversified Consumer Services

The Customer Service Quality Professional at Colibri Group evaluates customer interactions across voice, chat, and email to improve service quality, guide coaching and training, and inform operational decisions.

10 hours, 55 minutes ago

QA Engineer, Blockchain

Binance 5K-10K Capital Markets

Binance is hiring a QA Engineer to ensure the quality, reliability, and scalability of backend systems, APIs, databases, distributed services, and big-data products within its global blockchain ecosystem.

Agile AWS Azure Blockchain CI/CD Docker Java JavaScript JIRA JUnit Kafka Kubernetes Microservices Python Selenium TestNG
10 hours, 55 minutes ago

QA Developer

Terra Professional Services

Terra, an international digital marketing and creative agency, is seeking a QA Developer to test, debug, and increasingly develop AI-powered features, internal tools, and client web applications.

Agile CSS Git GraphQL HTML JavaScript Node.js PHP React REST API Vue.js
10 hours, 55 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers