QA/Test Engineer

2 days, 4 hours ago
Full-time
Junior
Quality Assurance and Testing
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Design comprehensive test cases covering normal scenarios, edge cases, failure conditions, and unexpected inputs.
  • Review task descriptions, requirements, expected outcomes, and reference solutions for ambiguity and inconsistencies.
  • Debug task environments, validation logic, and automated checks using Python and other development tools.
  • Create repeatable QA procedures, quality checklists, and review frameworks for benchmark tasks.
  • Analyze grading logic and AI-agent execution results to identify loopholes, shortcuts, and inconsistent scoring.
  • Collaborate with researchers and task authors to communicate issues, recommend improvements, and validate fixes.
  • Establish and maintain quality standards across complex technical evaluation datasets.

Requirements

  • MSc or PhD in a STEM discipline, or equivalent practical experience in a research-intensive or engineering-focused environment.
  • At least 1 year of experience in QA, test engineering, software engineering, research engineering, or a comparable quality-focused role.
  • Proven ability to design test cases, develop QA processes, and investigate complex technical systems end to end.
  • Working proficiency in Python and Git, including the ability to understand unfamiliar codebases and technical workflows.
  • Strong debugging, analytical, and systematic problem-solving skills.
  • Exceptional attention to detail and ability to maintain clear, structured technical documentation.
  • Ability to identify subtle failures, inconsistencies, edge cases, and unintended behaviors.
  • Experience with AI evaluation, AI training, model testing, benchmark development, or reviewing AI-generated outputs is highly desirable.
  • Ability to work independently on ambiguous technical problems and provide actionable written feedback.
  • Availability to commit approximately 35 hours per week.

Benefits

  • Compensation of $60–$90 per hour.
  • Fully remote work within the United States.
  • Full-time engagement with an approximately 35-hour workweek.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Test Engineer

Sparksoft 51-250 Internet Software & Services

Sparksoft is seeking a software test professional to support government Pega applications by planning and executing comprehensive functional, integration, performance, accessibility, and end-to-end testing.

Azure Confluence Insomnia JIRA JMeter Playwright Postman Selenium SQL
2 days, 3 hours ago

Senior Test Engineer

Dark Wolf Solutions 51-250 Internet Software & Services

Dark Wolf is seeking a Senior Test Engineer to lead end-to-end testing and security validation for embedded systems, edge devices, and network products in a remote role supporting customer and field sites.

Agile Bash CI/CD Cybersecurity Docker Git GitHub Actions GitLab CI Jenkins Kubernetes Linux Python Rancher
2 days, 3 hours ago

Software Test Engineer

Cala kIQ 51-250 Pharmaceuticals

Cala Health is hiring a Software Test Engineer to validate mobile apps, web platforms, and APIs for regulated healthcare products through manual testing, automation, and risk-focused quality practices.

Android Android Studio Appium CI/CD Git iOS Java JavaScript Playwright Postman Python REST API Xcode
2 weeks ago

Senior Post-Silicon Validation Engineer

K2 Space Corporation 51-200 Defense and Space Manufacturing

K2 Space is seeking a hands-on Senior Post-Silicon Validation Engineer to lead bring-up, characterization, and system-level validation of mixed-signal SoCs for integration into high-power satellite platforms.

C++ Python
2 weeks, 3 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers