RemoteLeaf Logo
Log in Sign up

Lead QA Engineer (AI Voice)

1 day, 10 hours ago
Poland
Full-time
Lead
QA Engineer
Quality Assurance and Testing
AWS Azure CI/CD GCP JavaScript JIRA LLM Postman Python Twilio TypeScript
Apply Now
Lingaro

Lingaro

Lingaro Group is a leading end-to-end data services partner specializing in Business Intelligence and Data Warehouse solutions. With a focus on digital transformation, Lingaro provides technology-enabled solutions to Fortune 500 enterprises and global ...

IT Services
5001+
Founded 2008
View All Jobs 6

Description

  • Design the end-to-end voice AI test strategy, covering speech input, ASR, LLMs, tools, integrations, and speech output.
  • Define and scale the automation approach for coverage across approximately 100 languages.
  • Test deterministic flows such as intents, routing, and integrations, as well as non-deterministic AI behavior.
  • Evaluate prompts and LLM responses using test datasets and scoring criteria.
  • Lead UAT planning, scenario and test-data creation, business tester coordination, and sign-off recommendations.
  • Translate business acceptance criteria into measurable quality targets.
  • Own defect and risk management and provide release go/no-go recommendations.
  • Replan testing and communicate options when development timelines change.
  • Challenge stakeholder readiness and quality standards, and mentor a Regular engineer.

Requirements

  • 6+ years of software QA experience.
  • 2+ years of testing voice agents or conversational AI in live delivery.
  • Experience leading end-to-end testing and UAT, including working independently as a lone or lead QA.
  • Experience testing speech recognition and output, including latency, interruptions, accents, and background noise.
  • Knowledge of voice quality metrics, including word error rate, intent accuracy, and task completion.
  • Practical understanding of LLM behavior and failure modes.
  • Test automation experience with Python or JavaScript/TypeScript, CI/CD, and API testing tools such as Postman.
  • Experience using cloud speech services such as Azure, Google Cloud, or AWS to generate test calls.
  • Experience with Jira or Azure DevOps, test management tools, and troubleshooting through logs, transcripts, and call recordings.
  • English proficiency at B2 level or higher; experience with distributed teams and structured communication with technical and business stakeholders.
  • Experience with voice testing platforms, LLM evaluation tools, telephony, ISTQB certification, Responsible AI testing, or multi-market customer journeys is preferred.

Benefits

  • Remote or office-based work through an “office as an option” model.
  • Workation opportunities and flexible working hours and contract arrangements.
  • Comprehensive online onboarding with a Buddy from day one.
  • Unlimited Udemy access, certificate training, and 110+ annual learning opportunities.
  • Capability development programs, Competency Centers, knowledge-sharing sessions, and community webinars.
  • Employee referral bonuses.
  • Well-being and health support activities.
  • Modern office equipment provided or available to borrow, depending on location.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

StarCompliance

Quality Engineer (SDET)

StarCompliance 201-500 Capital Markets

StarCompliance is seeking a Platform Quality Engineer to strengthen quality, reliability, resilience, and performance across its distributed enterprise SaaS compliance platform.

United Kingdom Full-time Senior QA Engineer
AWS Azure C# CI/CD Gatling K6 Kafka Python TypeScript
9 hours, 37 minutes ago
TerraPower

Quality Assurance Engineer

TerraPower 51-200 Electric Utilities

TerraPower is seeking a Quality Assurance Engineer to support advanced nuclear reactor programs by ensuring regulatory, supplier, and quality-system compliance in a remote or Everett, WA-based role.

United States Full-time Lead QA Engineer
$124k-$161k
AWS
10 hours, 7 minutes ago
SWORD Health

QA Analyst, Mind

SWORD Health 501-1000 Health Care Providers & Services

Join Sword’s Mind team as a QA Analyst to help deliver safe, reliable, AI-powered mental healthcare experiences throughout the product development lifecycle.

Portugal Full-time Junior QA Engineer
$27k-$43k
Android Studio Git HTTP JIRA Postman
10 hours, 7 minutes ago
SkyGrid

Senior Quality Assurance Engineer

SkyGrid 11-50 Aerospace & Defense

SkyGrid, a Wisk Company, is seeking a Senior Quality Assurance Engineer to lead system, software, hardware, and corporate quality assurance for autonomous aviation products and airspace services.

United States Full-time Lead QA Engineer
10 hours, 22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers