QA/Test Engineer

1 week, 6 days ago
Part-time
Junior
Quality Assurance and Testing
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Design comprehensive test cases for evaluation tasks, including edge cases and unexpected scenarios.
  • Review benchmark tasks and reference solutions to identify ambiguity, inconsistencies, missing requirements, and grading gaps.
  • Debug task environments and Python-based evaluation scripts to ensure reliable execution and accurate results.
  • Develop repeatable quality assurance processes, validation checklists, and testing frameworks for benchmark creation.
  • Identify shortcuts, exploits, or weaknesses that could compromise evaluation accuracy or benchmark integrity.
  • Collaborate with AI researchers, engineers, and task authors to improve task quality, reproducibility, and technical rigor.

Requirements

  • Master's degree, PhD, or equivalent practical experience in a STEM discipline involving software engineering, research, or advanced technical problem solving.
  • Minimum 1 year of professional experience in Quality Assurance, Test Engineering, Software Engineering, Research Engineering, or a related technical field.
  • Proven experience designing test cases, validating complex software systems, and debugging end-to-end workflows.
  • Strong proficiency in Python and Git, with the ability to troubleshoot unfamiliar codebases and technical environments.
  • Excellent analytical thinking, problem-solving skills, and exceptional attention to detail.
  • Experience documenting bugs, test strategies, and technical findings with clear written communication.
  • Experience evaluating AI systems, machine learning models, or AI-generated outputs is preferred.
  • Ability to work independently while managing multiple complex tasks with minimal supervision.
  • Ability to commit approximately 35 hours per week on a consistent basis.
  • At this time, H1-B and STEM OPT candidates are not supported.

Benefits

  • Compensation of $60-$90 per hour.
  • Fully remote engagement with flexible working hours.
  • Independent contractor engagement.
  • Weekly payments based on approved work completed.
  • Opportunity to contribute to cutting-edge AI research and benchmark development.
  • Reasonable accommodations available throughout the application and engagement process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

(PDF reader) Middle Test Engineer, JR641, JR651, JR652

ELEKS 1K-5K Construction & Engineering

ELEKS Quality Assurance Office is hiring a Middle Test Engineer in Ukraine to support testing for a PDF reader product with document-signing functionality for an Ireland-based client.

5 days, 6 hours ago

Software Test Engineer III

Makpar 51-250 Internet Software & Services

Makpar is hiring a Software Test Engineer III to lead QA for ICAM applications across the software lifecycle, ensuring changes are tested and release-ready in non-production environments for federal customers.

Angular CI/CD Cybersecurity DevSecOps Java Jenkins JIRA MySQL Selenium SonarQube Spring
5 days, 6 hours ago

Senior Test Engineer

European Dynamics 251-1K IT Services

European Dynamics is hiring a remote Senior Test Engineer to support a major European institution’s development team on product and system integration testing within an EU-based, multilingual environment.

Agile Postman SQL
6 days, 6 hours ago

Senior Software V&V Engineer

Natera 1K-5K Pharmaceuticals

Foresight Diagnostics, now part of Natera, is hiring a Senior Software V&V Engineer to own verification and validation for regulated bioinformatics and clinical software supporting MRD cancer detection.

AWS GCP
1 week, 4 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers