RemoteLeaf Logo
Log in Sign up

Senior Software Development Engineer in Test

2 days, 5 hours ago
United States
Full-time
Senior
SDET (Software Development Engineer in Test)
Quality Assurance and Testing
Argo CD AWS CI/CD Cypress Datadog Gatling GCP GitHub Actions JavaScript Jenkins Jest JMeter K6 Kubernetes Locust Microservices MongoDB Node.js OpenTelemetry Playwright Postman REST API Spinnaker System Design TypeScript
Apply Now
Qualia

Qualia

Qualia is the top digital real estate closing platform, offering a comprehensive solution for efficient and seamless closings with automated task management and real-time reporting.

Internet Software & Services
501-1000
Founded 2015
$160M raised
View All Jobs

Description

  • Build and maintain production-grade test infrastructure, AI/ML evaluation systems, agentic validation harnesses, release tooling, observability, and performance-testing platforms.
  • Design agentic test harnesses that enable AI agents to interact with applications, browsers, APIs, databases, logs, telemetry, and CI/CD systems.
  • Create evaluation frameworks for non-deterministic AI systems using deterministic assertions, semantic and model-based evaluation, regression datasets, and human review.
  • Instrument automation and agentic infrastructure with structured logs, metrics, distributed traces, and execution timelines.
  • Develop systems to distinguish product, test, infrastructure, and AI/model reasoning failures and accelerate root-cause analysis.
  • Design and build test automation frameworks, including migrating from Cypress to Playwright.
  • Own test-environment provisioning, test parallelization, and CI/CD integration at scale.
  • Apply AI to test generation, flaky-test triage, failure clustering, and release-risk analysis while ensuring conclusions are supported by evidence.
  • Partner with engineering, quality, SRE, and platform teams to create reusable quality platforms and mentor engineers.

Requirements

  • 5+ years of experience as an SDET or software engineer building test infrastructure, developer tooling, platform engineering, observability, or release-engineering systems.
  • Strong JavaScript/TypeScript and Node.js programming skills, including building backend services, libraries, frameworks, and production infrastructure.
  • Strong software engineering fundamentals in system design, distributed systems, APIs, asynchronous systems, and production operations.
  • Experience building or scaling CI/CD systems, release orchestration, test infrastructure, or developer platforms.
  • Experience designing observability and telemetry using structured logging, metrics, and distributed tracing.
  • Hands-on experience with LLMs, AI-assisted engineering, or agentic systems, including tool/function calling and multi-step agent workflows.
  • Experience or familiarity with LLM and agent evaluation, including evaluation datasets and deterministic and model-based evaluators.
  • Strong understanding of the testing pyramid and validation approaches across unit, integration, API, UI, performance, and agentic layers.
  • Experience with tools such as Playwright, Jest, Datadog, OpenTelemetry, Kubernetes, AWS or Google Cloud, and CI/CD platforms.
  • Ability to mentor engineers and raise technical quality standards across teams.

Benefits

  • Remote-first work environment, with remote candidates welcome.
  • Comprehensive health plans.
  • 401(k) program.
  • Commuter benefits.
  • Professional development support.
  • Parental leave.
  • Flexible time-off policy.
  • Online onboarding, biweekly company meetings, and internal virtual events.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job - 32255] Senior SDET, Brazil

CI&T 5001+ Internet Software & Services

CI&T is seeking a Senior SDET in Brazil to embed quality throughout the product lifecycle for an innovative client project by developing and executing effective automated and manual testing strategies.

Brazil Full-time Senior SDET (Software Development Engineer in Test)
Agile C# CI/CD Cypress Java JavaScript JMeter JUnit Postman Scrum Selenium TestNG
1 day, 4 hours ago
Creatio

QA Automation Engineer

Creatio 501-1000 Internet Software & Services

Creatio is seeking a QA Automation Engineer in Ukraine or Poland to ensure the quality of its AI CRM and workflow platform across Core and Sales Scrum teams.

Poland Ukraine Mid Level SDET (Software Development Engineer in Test)
Chai Docker Git JavaScript Jenkins JIRA JMeter Mocha Playwright Postman Redis REST API Scrum SQL SVN TeamCity TypeScript
3 days, 4 hours ago
Creatio

QA Automation Engineer

Creatio 501-1000 Internet Software & Services

Creatio is seeking a QA Automation Engineer in Ukraine or Poland to ensure quality across AI and no-code product workflows through end-to-end automation, manual testing, and QA process improvement.

Poland Ukraine Full-time Mid Level SDET (Software Development Engineer in Test)
Chai Docker Git JavaScript Jenkins JIRA JMeter Mocha Playwright Postman Redis REST API Scrum SQL SVN TeamCity TypeScript
3 days, 4 hours ago
SentinelOne

Automation Engineer, Provisioning & Onboarding

SentinelOne 1001-5000 Internet Software & Services

SentinelOne is seeking an Automation Engineer, Provisioning & Onboarding to automate customer product-access workflows and integrations supporting its AI-native cybersecurity platform.

Slovakia Czech Republic Full-time Senior SDET (Software Development Engineer in Test)
Cybersecurity Python Salesforce
3 days, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers