RemoteLeaf Logo
Log in Sign up

QA Engineer: AI-Assisted Testing

10 hours, 38 minutes ago
United States
Full-time
Mid Level
QA Engineer
Artificial Intelligence and Machine Learning
Docker Git Grafana HTTP JIRA JSON Kubernetes OAuth Playwright PostgreSQL Postman REST API Selenium SQL Vue.js
Apply Now
ECFX

ECFX

ECFX offers Intelligent Automation for Court Notices, streamlining ECF notice processing to save firms time and enhance client-focused work.

Professional Services
11-50
View All Jobs 2

Description

  • Use AI tools to analyze tickets, merge requests, code changes, risks, and edge cases, then create test charters and checklists.
  • Conduct risk-based exploratory, functional, and regression testing across Vue dashboards, admin tools, notifications, and integrations.
  • Validate document retrieval, parsing, categorization, storage, and delivery across court portals, 2FA/OTP workflows, and legal systems.
  • Test backend and platform behavior using APIs, SQL queries, logs, Grafana/Loki, and Sentry.
  • Generate realistic test data, court-notice emails, and edge-case documents for simulators and test environments.
  • Evaluate AI categorization and LLM-facing tools for accuracy, consistency, unusual inputs, and regressions.
  • Test authentication, SSO, OAuth, roles, permissions, tenant isolation, and security fixes.
  • Investigate production and customer-reported issues, reproduce defects, and write actionable bug reports.
  • Create targeted Playwright or API automation for high-risk flows where automation provides value.
  • Collaborate with engineers and product managers on acceptance criteria, sprint activities, and quality risks.

Requirements

  • 3–7 years of software QA experience with web or SaaS applications and complex, data-heavy systems.
  • Deep experience with exploratory and manual testing.
  • Daily practical use of AI assistants for test design, test data, queries, investigation, and reporting.
  • Experience testing AI or LLM features, including classification accuracy, hallucinations, and prompt injection.
  • Experience writing or maintaining automated tests using tools such as Playwright, Selenium, or API scripts.
  • SQL skills, preferably for PostgreSQL, plus experience with APIs, HTTP, REST, and JSON using Postman, curl, or Bruno.
  • Experience with web security testing, including authentication, sessions, OAuth2/SAML, CSRF, XSS, roles, and permissions.
  • Experience testing third-party integrations, email workflows, or browser automation against external sites.
  • Comfort with command-line tools, Git, logs, Jira, and preferably Docker or Kubernetes.
  • Experience with AI browser tools, accessibility testing against WCAG 2.2 AA, legal technology, ISTQB certification, or Lean Startup is preferred.

Benefits

  • Fully remote work open to employees in every US time zone, including Hawaii.
  • Flexible working hours and a supportive work environment.
  • Health, dental, vision, and life insurance options.
  • Discretionary time off in addition to scheduled vacations and holidays.
  • Employee stock option plan.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Welo Global

Senior QA Analyst (Frontend) – (India)

Welo Global Professional Services

Welo Data is seeking a remote Senior QA Analyst in India to own frontend-to-middleware quality for a multi-step web onboarding workflow and produce a validated state-model evidence package.

India Freelance Mid Level QA Engineer
$12k-$12k
1 day, 9 hours ago
SWORD Health

Senior QA Analyst

SWORD Health 251-1K Health Care Providers & Services

Sword Health is hiring an AI healthcare quality and testing specialist to validate adaptive AI care systems, ensure clinical accuracy and safety, and support regulatory compliance across global healthcare environments.

Portugal Full-time Mid Level QA Engineer
$27k-$43k
HIPAA
1 day, 10 hours ago
Bitly

Engineering Technician 4, Quality Assurance (R5977)

Bitly 51-250 Internet Software & Services

Shield AI is seeking an Engineering Technician to support XBAT prototype ground and flight testing by inspecting hardware, documenting issues, and verifying test articles meet engineering requirements.

Anywhere Full-time Lead QA Engineer
$73k-$110k
3 days, 9 hours ago
CourtAvenue

QA Engineer (Contract)

CourtAvenue 51-250 Media

CourtAvenue is hiring a junior-to-mid-level contract QA Engineer to support its MarTech practice by validating DAM migrations, content platforms, and integrations before client release.

United States Contract Junior QA Engineer
$114k-$156k
Agile JIRA Scrum
3 days, 9 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers