RemoteLeaf Logo
Log in Sign up

AI Test Automation Engineer

10 hours, 19 minutes ago
Anywhere
Full-time
Senior
SDET (Software Development Engineer in Test)
Artificial Intelligence and Machine Learning
Git Groovy JavaScript Microservices Playwright Spock TypeScript
Apply Now
Gravie

Gravie

Gravie is reinventing health benefits with transparent, affordable solutions like Comfort® plan, ensuring easy access to care for employers and individuals.

Insurance
251-1K
Founded 2013
$177M raised
View All Jobs 5

Description

  • Design and build AI-driven test automation workflows where AI agents generate, execute, and iterate on Playwright tests with minimal human intervention.
  • Architect a Playwright test framework from scratch, including patterns, page-object models, fixtures, and conventions optimized for AI-assisted test generation.
  • Build feedback loops between local test execution, CI pipeline results, and merge request creation so AI agents can run tests, interpret failures, fix issues, and resubmit.
  • Audit existing Geb/Spock/Groovy test suites across Member, Employer/Broker, and Admin portals and classify tests for conversion, API/unit coverage, or deletion.
  • Lead the migration from Geb/Spock to Playwright and use AI agents to accelerate conversion while maintaining coverage continuity.
  • Integrate Playwright test execution into GitLab CI/CD pipelines with automated quality gates on merge requests and deployments.
  • Optimize test execution for fast feedback using parallelization, caching strategies, and CI tuning.
  • Instrument tests and pipelines with reporting on pass/fail trends, flakiness rates, and coverage gaps, and use that data to prioritize AI-driven test generation.
  • Identify scenarios where end-to-end UI tests are inappropriate and implement API-layer automation or contract tests for microservice boundaries.
  • Continuously improve AI automation workflows by refining prompts, context structures, and validation patterns to increase first-pass correctness of AI-generated tests.

Requirements

  • 5+ years of experience in test automation engineering, SDET, or software engineering with strong testing practices.
  • Demonstrated experience using AI coding tools (e.g., Claude Code, Cursor, GitHub Copilot) to generate and maintain code and established AI-assisted development workflows.
  • Hands-on experience with Playwright or a comparable modern end-to-end testing framework.
  • Experience building a test framework from scratch (strongly preferred).
  • Proficiency in TypeScript or JavaScript with the ability to write production-quality code.
  • Experience with CI/CD pipelines, preferably GitLab, including writing pipeline configuration, test stages, and merge request workflows.
  • Solid understanding of REST API testing and when to use API-level tests versus UI-level tests.
  • Experience planning and executing migration of legacy test automation to a modern framework while maintaining coverage.
  • Strong communication skills and ability to explain technical trade-offs to non-technical stakeholders and produce clear documentation.
  • Comfort working in ambiguity with a systems-thinking, builder mindset.
  • Nice-to-have: experience with Groovy, Spock, or Geb; contract testing (Pact or equivalent); background in health insurance or regulated industries; experience building internal developer tooling.

Benefits

  • Salary range $124,271 - $207,118 annually and an above-average total rewards package.
  • Comprehensive health and wellness benefits, including alternative medicine coverage.
  • Generous PTO and paid holidays.
  • Up to 16 weeks paid parental leave.
  • 401(k) program.
  • Transportation perks.
  • Education reimbursement.
  • Paid paw-ternity leave.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

TWO95 International

Sr Ariba QA Testing Engineer - Remote

TWO95 International 51-250 Internet Software & Services

Senior Ariba QA / Testing Engineer (100% remote, 1+ year contract) to lead QA and test automation for Ariba Buyer applications, ensuring reliable, high-quality releases.

United States Contract Senior SDET (Software Development Engineer in Test)
Agile BDD Java Splunk
9 hours, 19 minutes ago
3Pillar Global

Senior SDET (Java/Angular - Playwright)

3Pillar Global 1K-5K Internet Software & Services

Senior SDET at 3Pillar Global on the Mexico Product Development team working remotely to build and maintain automated testing frameworks and ensure product quality across client projects.

Mexico Full-time Senior SDET (Software Development Engineer in Test)
Agile Angular AWS Cypress Docker Figma Git GitHub Java JIRA JMeter Playwright Scrum SQL TypeScript UX Design
9 hours, 34 minutes ago
3Pillar Global

(SDET)Software Development Test Engineer with Java & Angular Exp. (Immediate Joiners Preferred)

3Pillar Global 1K-5K Internet Software & Services

SDET (Software Development Test Engineer) at 3Pillar Global India, working remotely on product-focused teams to design and implement scalable automation that ensures high-quality, customer-facing software delivery.

India Full-time Senior SDET (Software Development Engineer in Test)
Angular AWS CI/CD Cypress Docker Figma GitHub Java JavaScript JIRA Playwright SQL TypeScript UX Design
11 hours, 4 minutes ago
CI&T

[Job-28661] Senior QA/Tester Automation, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior QA/Tester Automation in Brazil to ensure quality for a Digital Finance project by designing and executing automated and manual tests across web and API platforms.

Brazil Full-time Senior SDET (Software Development Engineer in Test)
Agile CI/CD Cypress Git Insomnia JavaScript Playwright Postman REST API TypeScript
1 day, 9 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers