RemoteLeaf Logo
Log in Sign up

Senior QA Engineer

6 days, 4 hours ago
India
Full-time
Senior
QA Engineer
Quality Assurance and Testing
Datadog GCP GitHub Actions gRPC JavaScript Node.js OpenTelemetry Playwright REST API TypeScript WebSockets
Apply Now
Steer Health

Steer Health

Steer Health is a Conversational Growth Platform transforming healthcare with integrated solutions for exceptional patient experiences and organizational success.

Professional Services
11-50
Founded 2021
View All Jobs 4

Description

  • Design, build, and maintain automated test suites for web and API surfaces, including AI-generated content flows.
  • Lead QA strategy for voice automation pipelines built on ElevenLabs, including synthesis quality, latency, and failure mode testing.
  • Validate Claude (Anthropic) integrations for prompt-response accuracy, edge case handling, safety behaviors, and output consistency.
  • Build and maintain Node.js-based test tooling, harnesses, and custom reporters for CI/CD pipelines.
  • Deploy, monitor, and triage test infrastructure on Google Cloud Platform using Cloud Run, GCS, and Pub/Sub.
  • Define and track quality metrics such as test coverage, flakiness rates, mean-time-to-detect, and regression velocity.
  • Collaborate with engineers during design reviews to identify testability gaps and promote observable, fault-tolerant system design.
  • Mentor junior QA engineers and establish team-wide standards for test authoring, review, and maintenance.

Requirements

  • 5+ years of QA engineering experience, including at least 2 years on systems with LLMs, AI APIs, or speech/audio pipelines.
  • Expert-level Playwright experience, including resilient selectors, parallel workers, and debugging flaky tests at scale.
  • Proficiency with Node.js and TypeScript/JavaScript for custom test runners, CLI tooling, and service mocks.
  • Hands-on Google Cloud Platform experience, including Cloud Run or GKE, Cloud Logging, and GCS.
  • Familiarity with ElevenLabs or comparable TTS/voice APIs, including synthesis parameters, webhook flows, and audio quality evaluation.
  • Practical experience testing Claude or other LLMs, including prompt regression testing and determinism-aware evaluation strategies.
  • Strong understanding of REST, WebSocket, and gRPC protocols for API-level testing.
  • Experience integrating test suites into CI/CD pipelines such as GitHub Actions or Cloud Build.
  • Experience writing custom LLM evals or using frameworks such as PromptFoo or Braintrust is preferred.
  • Background in audio signal quality assessment, speech intelligibility testing, observability tooling, or accessibility testing standards is preferred.

Benefits

  • Competitive base salary commensurate with experience.
  • High-autonomy environment with direct access to executive leadership.
  • Structured operating cadence with clear goals, metrics, and career growth targets.
  • Opportunity to work on a mission that affects 19M+ patients.
  • Flexible PTO policy.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Finite State

Senior QA Engineer - AI/ML

Finite State 51-250 Internet Software & Services

Finite State is hiring a Singapore-based QA Engineer / Senior QA Engineer to validate an AI-powered SaaS platform for product security teams, with a focus on improving the quality, reliability, security, and release confidence of complex full-stack workflows.

Singapore Full-time Senior QA Engineer
CI/CD Cybersecurity Cypress Docker Git JavaScript Machine Learning Playwright Postman Pytest Python REST API Selenium TypeScript
3 hours, 34 minutes ago
Ibility

Performance Analyst

Ibility 1-10 Professional Services

Ibility is seeking a remote Performance Analyst to support federal healthcare technology testing by translating user performance needs into testable system requirements and documenting testing outcomes for stakeholders.

United States Full-time Senior QA Engineer
Agile Azure CI/CD JIRA
3 hours, 49 minutes ago
Emerging Travel Group

Quality Assurance Engineer (Manual)

Emerging Travel Group 251-1K Consumer Services

QA Engineer role on the Extranet team at a company building direct hotel connectivity services and a partner management panel, focused on maintaining quality for identity verification, virtual credit card payments, and two-factor authentication features.

Serbia Argentina Full-time Mid Level QA Engineer
Microservices Postman Python Selenium SQL Unix
3 hours, 49 minutes ago
BHG Financial

Quality Assurance Monitoring and Testing Analyst

BHG Financial 1K-5K Diversified Financial Services

CCMR3 is hiring a remote Quality Assurance Monitoring and Testing Analyst to evaluate operational controls, support compliance oversight, and drive process improvement within its debt recovery operations.

Anywhere Full-time Junior QA Engineer
3 hours, 49 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers