DEFCON AI

DEFCON AI

DEFCON AI specializes in providing advanced modeling, simulation, and analysis solutions that enhance logistics and mobility decision-making, particularly in response to disruptions caused by natural disasters, unexpected events, and adversarial actions.

Internet Software & Services
11-50
Founded 2022

Description

  • Own the system test plan for functional, integration, performance, and load testing.
  • Translate product acceptance criteria into executable tests and flag ambiguous or unverifiable requirements.
  • Review acceptance criteria with product before development begins.
  • Hold engineering, platform, and partner teams accountable to release evidence and completion criteria.
  • Plan and coordinate user acceptance testing with customers and track issues to resolution.
  • Build and maintain automated test suites and integrate them into CI/CD as release gates.
  • Establish and report on automated coverage standards and regression coverage across releases.
  • Build performance and load tests that validate the system under expected user load.
  • Create labeled evaluation sets, run sampled audits, and measure decision accuracy and user overrides.
  • Maintain release documentation, version inventory, rollback criteria, and environment validation evidence.

Requirements

  • 5+ years of experience in software quality engineering, test automation, or software engineering with substantial dedicated test ownership.
  • A clear point of view on how testing should be done and the judgment to set the standard.
  • Strong coding ability in a test automation language and framework, such as Python with pytest or JavaScript/TypeScript with Playwright, Cypress, or Selenium.
  • Ability to read and reason about the application code under test; Python is the primary language in the stack.
  • Routine use of AI-assisted development with sound judgment about when output needs verification.
  • Demonstrated experience building automated test suites and integrating them into CI/CD as release gates.
  • Experience owning a test plan through review and acceptance.
  • Experience testing against requirements rather than implementation, ideally with product owners or end users.
  • Experience with performance and load testing, including understanding what results do and do not prove.
  • Working statistical literacy, including sampling design and measurement confidence.
  • Experience measuring what a system misses, not only what it gets right.
  • Ability and willingness to gate work owned by people who do not report to you.
  • Clear, audit-ready written documentation.
  • Willingness to hold a release and explain the reason.
  • US citizenship required.
  • Active US Secret clearance required; favorable investigation and CAC eligibility from the start.
  • Willingness to travel up to 25% to customer sites, DEFCON AI HQ, and vendor facilities.
  • Preferred: active Top Secret clearance.
  • Preferred: experience in government DevSecOps, RMF, or ATO environments and producing formal test evidence.
  • Preferred: contract and API testing, test data management, and building extensible test infrastructure.
  • Preferred: AI-assisted testing with language models to generate and maintain test coverage.
  • Preferred: performance tools such as JMeter, k6, or Locust.
  • Preferred: validating ML/model outputs, groundedness, citation checking, and user disagreement analysis.
  • Preferred: model cards, NIST AI RMF, or comparable responsible AI practices.
  • Preferred: Section 508 and WCAG verification.

Benefits

  • Fully remote, results-based work environment.
  • Competitive salary, bonus, and equity package.
  • 100% employer-paid medical, dental, and vision coverage for you and your family.
  • Unlimited PTO with manager approval.
  • Flexible work environment where you manage your workday.
  • 14 weeks of fully paid parental leave.
  • Salary range of $135,000 to $170,000.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Quality Assurance Engineer [Zeal]

Livefront 11-50 Internet Software & Services

Zeal, now part of Livefront, is hiring a Quality Assurance Engineer in Peru to help clients deliver reliable software across web, mobile, API, and integrated systems.

Appium Azure C# CI/CD Cypress Git GitHub Actions Java JavaScript Jenkins Playwright Postman Python REST API Selenium SQL TypeScript
37 minutes ago

Senior QA Engineer – API Testing

Medium 51-250 Internet Software & Services

Nuvolar is hiring a Senior QA Engineer for a remote healthcare project in Spain to shape quality strategy for a digital health platform handling sensitive data, integrations, and critical workflows.

Agile AWS CI/CD Docker DynamoDB GitHub GitHub Actions Java Maven OpenAPI Playwright PostgreSQL Postman REST API Scrum Spring Boot SQL
1 hour, 7 minutes ago

QA Engineer - Clearance Required

Red Cell Partners, 11-50 Biotechnology

DEFCON AI is hiring a QA Engineer to own quality for an AI-enabled decision-support system within Red Cell Partners’ product organization, ensuring releases match product specifications and customer acceptance criteria.

CI/CD Cypress DevSecOps JavaScript JMeter K6 Locust Machine Learning Playwright Pytest Python Selenium TypeScript
1 hour, 7 minutes ago

Senior QA Engineer (AI-Assisted Development)

kake 1-10 Internet Software & Services

Senior QA Engineer role focused on testing modern software products, including web applications, APIs, backend systems, and AI-assisted features, to ensure quality, reliability, and performance across the development lifecycle.

C# CI/CD Cypress Java JavaScript Playwright Python Selenium TypeScript
1 hour, 22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers