RemoteLeaf Logo
Log in Sign up

Senior QA Automation Engineer

3 weeks ago
Mexico, Bolivia, Chile, Guatemala, Panama, Paraguay, Peru, Colombia, Costa Rica, Uruguay, Ecuador
Contract
Senior
SDET (Software Development Engineer in Test)
Quality Assurance and Testing
CI/CD Cybersecurity GitHub Actions Grafana JavaScript Jenkins JIRA Playwright Pytest Python Scrum WebRTC
Apply Now
IDT

IDT

IDT Corporation provides innovative communications and payment services, connecting families, friends, and businesses globally with pioneering technologies and solutions.

Diversified Telecommunication Services
1K-5K
Founded 1990
View All Jobs 12

Description

  • Own the end-to-end test strategy across LLM, speech, and telephony layers.
  • Design scenarios for multi-turn conversations, interruptions, ambiguous input, escalation, and failure recovery.
  • Build evaluation frameworks using golden datasets, semantic assertions, and automated regression detection.
  • Adversarially test hallucinations, prompt injections, guardrail bypasses, grounding errors, and data disclosure risks.
  • Provision SIP devices and endpoints and automate end-to-end call origination.
  • Diagnose issues across LLM, ASR, TTS, media, codec, and call-routing layers.
  • Expand automated coverage and integrate tests into CI/CD release gates.
  • Define and track quality metrics including task completion, containment, intent and transcription accuracy, latency, and escalation correctness.
  • Maintain traceable test coverage in the TMS and communicate data-backed quality risks.
  • Participate fully in Scrum ceremonies and maintain related artifacts.

Requirements

  • 5+ years of QA experience, including ownership of a complex integrated product.
  • Practical SIP/VoIP testing experience with call flows, signaling, media handling, softphones, or SIP trunking.
  • Ability to troubleshoot SIP traces or packet captures.
  • Strong creativity and scenario-design ability for complex conversational systems.
  • Proficiency in Python for building and maintaining automation frameworks.
  • Experience testing non-deterministic or probabilistic systems and designing assertions for variable outputs.
  • Strong analytical skills and experience defining quality metrics for release decisions.
  • Hands-on experience with formal TMS tools and Jira.
  • Professional fluency in spoken and written English, with reliable overlap with US Eastern business hours.
  • LATAM-based candidate; English CV and advanced spoken English required.
  • Preferred: LLM/conversational AI, speech technology, RAG, WebRTC/media-layer, IVR/contact-center, multilingual, or prompt-engineering experience.
  • Relevant tools include pytest, Playwright, JsSIP/WebRTC, Allure TestOps, Jenkins, GitHub Actions, and Grafana.

Benefits

  • Remote work opportunity.
  • B2B employment with competitive salary and annual performance review.
  • Stable role with long-term growth prospects.
  • Company-provided hardware.
  • Continuous learning and career growth opportunities.
  • Compensation for professional training, seminars, and conferences.
  • Company-supported English classes and employee referral rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Flosum

Senior QA Automation Engineer - AWS & Salesforce (Belarus)

Flosum 51-250 Internet Software & Services

Flosum is seeking a Senior QA Automation Engineer to build and maintain end-to-end test automation connecting its AWS cloud applications with its Salesforce-native DevOps, release management, and data backup platform.

Belarus Mid Level SDET (Software Development Engineer in Test)
AWS CI/CD Cypress Git GitHub Actions GitLab Playwright Salesforce Salesforce Lightning Selenium
4 hours, 18 minutes ago
AssureSoft

Sr. QA Automation Engineer

AssureSoft 51-250 Internet Software & Services

AssureSoft is seeking a QA Automation Engineer to develop and maintain Playwright and TypeScript test automation for software projects delivered in collaboration with development, QA, and product teams.

Latin America Full-time Senior SDET (Software Development Engineer in Test)
CI/CD GitHub Actions JavaScript Jenkins Playwright TypeScript
1 day, 3 hours ago
CI&T

[Job- 30880] QA Automation Engineer Mid-Level, Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca um QA Automation Engineer Mid-Level para planejar e executar testes e iniciativas de qualidade em um grande cliente do setor bancário.

Brazil Full-time Mid Level SDET (Software Development Engineer in Test)
Agile
2 days, 3 hours ago
Nortal

(1601) Senior Data Platform and Automation Engineer

Nortal 251-1K Internet Software & Services

Nortal is seeking a Senior Data Platform and Automation Engineer for its remote LATAM team to build secure, scalable data platform capabilities and automate governance controls for enterprise and AI-enabled applications.

Latin America Full-time Senior SDET (Software Development Engineer in Test)
Apache Spark CI/CD Databricks Python Secrets Management SQL
3 days, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers