RemoteLeaf Logo
Log in Sign up

QA/Test Engineer

1 month, 3 weeks ago
United States
Part-time
Junior
Test Engineer
Quality Assurance and Testing
Git LLM Machine Learning Python
Apply Now
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020
View All Jobs 171

Description

  • Design comprehensive test cases for evaluation tasks, including edge cases and unexpected scenarios.
  • Review benchmark tasks and reference solutions to identify ambiguity, inconsistencies, missing requirements, and grading gaps.
  • Debug task environments and Python-based evaluation scripts to ensure reliable execution and accurate results.
  • Develop repeatable quality assurance processes, validation checklists, and testing frameworks for benchmark creation.
  • Identify shortcuts, exploits, or weaknesses that could compromise evaluation accuracy or benchmark integrity.
  • Collaborate with AI researchers, engineers, and task authors to improve task quality, reproducibility, and technical rigor.

Requirements

  • Master's degree, PhD, or equivalent practical experience in a STEM discipline involving software engineering, research, or advanced technical problem solving.
  • Minimum 1 year of professional experience in Quality Assurance, Test Engineering, Software Engineering, Research Engineering, or a related technical field.
  • Proven experience designing test cases, validating complex software systems, and debugging end-to-end workflows.
  • Strong proficiency in Python and Git, with the ability to troubleshoot unfamiliar codebases and technical environments.
  • Excellent analytical thinking, problem-solving skills, and exceptional attention to detail.
  • Experience documenting bugs, test strategies, and technical findings with clear written communication.
  • Experience evaluating AI systems, machine learning models, or AI-generated outputs is preferred.
  • Ability to work independently while managing multiple complex tasks with minimal supervision.
  • Ability to commit approximately 35 hours per week on a consistent basis.
  • At this time, H1-B and STEM OPT candidates are not supported.

Benefits

  • Compensation of $60-$90 per hour.
  • Fully remote engagement with flexible working hours.
  • Independent contractor engagement.
  • Weekly payments based on approved work completed.
  • Opportunity to contribute to cutting-edge AI research and benchmark development.
  • Reasonable accommodations available throughout the application and engagement process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cala kIQ

Software Test Engineer

Cala kIQ 51-250 Pharmaceuticals

Cala Health is hiring a Software Test Engineer to validate mobile apps, web platforms, and APIs for regulated healthcare products through manual testing, automation, and risk-focused quality practices.

United States Full-time Junior Test Engineer
$120k-$135k
Android Android Studio Appium CI/CD Git iOS Java JavaScript Playwright Postman Python REST API Xcode
3 days, 2 hours ago
K

Senior Post-Silicon Validation Engineer

K2 Space Corporation 51-200 Defense and Space Manufacturing

K2 Space is seeking a hands-on Senior Post-Silicon Validation Engineer to lead bring-up, characterization, and system-level validation of mixed-signal SoCs for integration into high-power satellite platforms.

United States Full-time Senior Test Engineer
$170k-$250k
C++ Python
6 days, 1 hour ago
Glydways

Localization Systems Engineer

Glydways 11-50 Transportation

Glydways is seeking a localization test and systems engineer to validate the software, algorithms, and safety functions powering its autonomous Glydcars in diverse and GPS-denied environments.

Anywhere Mid Level Test Engineer
C++ Computer Vision Python
1 week ago
Torc

Senior System Test Engineer - Simulation

Torc 251-1K Road & Rail

As a Simulation Test Engineer at Torc, you will lead system-level virtual verification and validation of autonomous driving software to improve its robustness and safety.

United States Full-time Senior Test Engineer
$153k-$184k
Linux Python YAML
1 week ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers