RemoteLeaf Logo
Log in Sign up

Senior QA Automation Engineer

8 hours, 3 minutes ago
Mexico, Bolivia, Chile, Guatemala, Panama, Paraguay, Peru, Colombia, Costa Rica, Uruguay, Ecuador
Contract
Senior
SDET (Software Development Engineer in Test)
Quality Assurance and Testing
CI/CD Cybersecurity GitHub Actions Grafana JavaScript Jenkins JIRA Playwright Pytest Python Scrum WebRTC
Apply Now
IDT

IDT

IDT Corporation provides innovative communications and payment services, connecting families, friends, and businesses globally with pioneering technologies and solutions.

Diversified Telecommunication Services
1K-5K
Founded 1990
View All Jobs 11

Description

  • Own the end-to-end test strategy across LLM, speech, and telephony layers.
  • Design scenarios for multi-turn conversations, interruptions, ambiguous input, escalation, and failure recovery.
  • Build evaluation frameworks using golden datasets, semantic assertions, and automated regression detection.
  • Adversarially test hallucinations, prompt injections, guardrail bypasses, grounding errors, and data disclosure risks.
  • Provision SIP devices and endpoints and automate end-to-end call origination.
  • Diagnose issues across LLM, ASR, TTS, media, codec, and call-routing layers.
  • Expand automated coverage and integrate tests into CI/CD release gates.
  • Define and track quality metrics including task completion, containment, intent and transcription accuracy, latency, and escalation correctness.
  • Maintain traceable test coverage in the TMS and communicate data-backed quality risks.
  • Participate fully in Scrum ceremonies and maintain related artifacts.

Requirements

  • 5+ years of QA experience, including ownership of a complex integrated product.
  • Practical SIP/VoIP testing experience with call flows, signaling, media handling, softphones, or SIP trunking.
  • Ability to troubleshoot SIP traces or packet captures.
  • Strong creativity and scenario-design ability for complex conversational systems.
  • Proficiency in Python for building and maintaining automation frameworks.
  • Experience testing non-deterministic or probabilistic systems and designing assertions for variable outputs.
  • Strong analytical skills and experience defining quality metrics for release decisions.
  • Hands-on experience with formal TMS tools and Jira.
  • Professional fluency in spoken and written English, with reliable overlap with US Eastern business hours.
  • LATAM-based candidate; English CV and advanced spoken English required.
  • Preferred: LLM/conversational AI, speech technology, RAG, WebRTC/media-layer, IVR/contact-center, multilingual, or prompt-engineering experience.
  • Relevant tools include pytest, Playwright, JsSIP/WebRTC, Allure TestOps, Jenkins, GitHub Actions, and Grafana.

Benefits

  • Remote work opportunity.
  • B2B employment with competitive salary and annual performance review.
  • Stable role with long-term growth prospects.
  • Company-provided hardware.
  • Continuous learning and career growth opportunities.
  • Compensation for professional training, seminars, and conferences.
  • Company-supported English classes and employee referral rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Capco

QA Engineer - COM INGLÊS - Remoto

Capco 5K-10K Internet Software & Services

A Capco busca um(a) QA Engineer para integrar um time de engenharia e garantir a qualidade de uma plataforma corporativa voltada a serviços financeiros, atuando em todo o ciclo de testes e desenvolvimento.

Brazil Full-time Mid Level SDET (Software Development Engineer in Test)
AWS CI/CD Cypress Git GitHub JWT Playwright PostgreSQL Postman React REST API Selenium SQL
1 day, 7 hours ago
Swapcard

QA Engineer - SDET

Swapcard 251-1K Professional Services

Swapcard is hiring a Software Development Engineer in Test to build scalable automation for its AI-powered event platform while validating product quality and triaging high-priority customer defects.

Latvia Lithuania Malta Poland Romania Austria Croatia Czech Republic Estonia Hungary Full-time Junior SDET (Software Development Engineer in Test)
Git Jenkins Postman Pytest Python REST API Selenium
1 day, 7 hours ago
Dijital Team

Automation Engineer - Rewst

Dijital Team 11-50 Internet Software & Services

The Automation Engineer – Rewst will help a technology services organisation improve MSP operational efficiency by owning Rewst, developing scalable automation solutions, and supporting customer implementations.

Sri Lanka Full-time Senior SDET (Software Development Engineer in Test)
Azure C# Git JSON .NET OpenAPI PowerShell Python REST API
3 days, 7 hours ago
CI&T

[Job - 31652] Sr. QA Automation, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior QA professional to ensure the quality and integrity of manual and automated testing for enterprise technology transformation projects.

Brazil Full-time Senior SDET (Software Development Engineer in Test)
Agile Appium Azure CI/CD Cypress JavaScript OpenAPI Postman Selenium
4 days, 7 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers