DEFCON AI

DEFCON AI

DEFCON AI specializes in providing advanced modeling, simulation, and analysis solutions that enhance logistics and mobility decision-making, particularly in response to disruptions caused by natural disasters, unexpected events, and adversarial actions.

Internet Software & Services
11-50
Founded 2022

Description

  • Own the system test plan for functional, integration, performance, and load testing.
  • Translate product acceptance criteria into executable tests and flag ambiguous or unverifiable requirements.
  • Review acceptance criteria with product before development begins.
  • Hold engineering, platform, and partner teams accountable to release evidence and completion criteria.
  • Plan and coordinate user acceptance testing with customers and track issues to resolution.
  • Build and maintain automated test suites and integrate them into CI/CD as release gates.
  • Establish and report on automated coverage standards and regression coverage across releases.
  • Build performance and load tests that validate the system under expected user load.
  • Create labeled evaluation sets, run sampled audits, and measure decision accuracy and user overrides.
  • Maintain release documentation, version inventory, rollback criteria, and environment validation evidence.

Requirements

  • 5+ years of experience in software quality engineering, test automation, or software engineering with substantial dedicated test ownership.
  • A clear point of view on how testing should be done and the judgment to set the standard.
  • Strong coding ability in a test automation language and framework, such as Python with pytest or JavaScript/TypeScript with Playwright, Cypress, or Selenium.
  • Ability to read and reason about the application code under test; Python is the primary language in the stack.
  • Routine use of AI-assisted development with sound judgment about when output needs verification.
  • Demonstrated experience building automated test suites and integrating them into CI/CD as release gates.
  • Experience owning a test plan through review and acceptance.
  • Experience testing against requirements rather than implementation, ideally with product owners or end users.
  • Experience with performance and load testing, including understanding what results do and do not prove.
  • Working statistical literacy, including sampling design and measurement confidence.
  • Experience measuring what a system misses, not only what it gets right.
  • Ability and willingness to gate work owned by people who do not report to you.
  • Clear, audit-ready written documentation.
  • Willingness to hold a release and explain the reason.
  • US citizenship required.
  • Active US Secret clearance required; favorable investigation and CAC eligibility from the start.
  • Willingness to travel up to 25% to customer sites, DEFCON AI HQ, and vendor facilities.
  • Preferred: active Top Secret clearance.
  • Preferred: experience in government DevSecOps, RMF, or ATO environments and producing formal test evidence.
  • Preferred: contract and API testing, test data management, and building extensible test infrastructure.
  • Preferred: AI-assisted testing with language models to generate and maintain test coverage.
  • Preferred: performance tools such as JMeter, k6, or Locust.
  • Preferred: validating ML/model outputs, groundedness, citation checking, and user disagreement analysis.
  • Preferred: model cards, NIST AI RMF, or comparable responsible AI practices.
  • Preferred: Section 508 and WCAG verification.

Benefits

  • Fully remote, results-based work environment.
  • Competitive salary, bonus, and equity package.
  • 100% employer-paid medical, dental, and vision coverage for you and your family.
  • Unlimited PTO with manager approval.
  • Flexible work environment where you manage your workday.
  • 14 weeks of fully paid parental leave.
  • Salary range of $135,000 to $170,000.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Call Center Quality Analyst - Remote

Colibri Group 1K-5K Diversified Consumer Services

The Customer Service Quality Professional at Colibri Group evaluates customer interactions across voice, chat, and email to improve service quality, guide coaching and training, and inform operational decisions.

1 day, 16 hours ago

QA Engineer, Blockchain

Binance 5K-10K Capital Markets

Binance is hiring a QA Engineer to ensure the quality, reliability, and scalability of backend systems, APIs, databases, distributed services, and big-data products within its global blockchain ecosystem.

Agile AWS Azure Blockchain CI/CD Docker Java JavaScript JIRA JUnit Kafka Kubernetes Microservices Python Selenium TestNG
1 day, 16 hours ago

QA Developer

Terra Professional Services

Terra, an international digital marketing and creative agency, is seeking a QA Developer to test, debug, and increasingly develop AI-powered features, internal tools, and client web applications.

Agile CSS Git GraphQL HTML JavaScript Node.js PHP React REST API Vue.js
1 day, 16 hours ago

GIS Test and Deployment Specialist

Qualysoft 251-1K Internet Software & Services

Qualysoft Group is seeking a Test and Deployment Specialist to support a GIS migration project by ensuring reliable testing, deployment, and implementation across customer environments.

Azure CI/CD Python SQL Terraform
1 day, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers