RemoteLeaf Logo
Log in Sign up

QA Engineer

2 hours ago
Egypt, Jordan
Full-time
Junior
QA Engineer
Quality Assurance and Testing
Agile AWS CI/CD Cypress GitHub Actions GraphQL Jest LLM Playwright PostgreSQL Postman Pytest REST API Selenium
Apply Now
Use Serva

Use Serva

Empowering mobility with an ecosystem that simplifies journeys and drives growth.

Internet Software & Services
View All Jobs

Description

  • Design, write, and maintain manual test plans and test cases across the full product.
  • Build and scale automation frameworks for regression, integration, and end-to-end testing.
  • Test AI-powered features, including LLM outputs, agent behavior, and model responses for accuracy, safety, and consistency.
  • Collaborate closely with developers and product managers to shift QA left in the development lifecycle.
  • Define and track quality metrics, identify risk areas, and surface issues before production.
  • Develop evaluation strategies for non-deterministic systems, including prompt variation testing and output validation pipelines.
  • Participate in sprint planning and retrospectives as the team’s quality voice.

Requirements

  • 2+ years of professional experience in software quality assurance covering both manual and automation testing.
  • Hands-on experience testing AI agents, LLM-powered features, or ML models and understanding non-deterministic behavior.
  • Proficiency in at least one modern automation framework such as Playwright, Cypress, Selenium, or equivalent.
  • Strong API testing skills using tools like Postman, REST Assured, or similar.
  • Experience working in agile environments with CI/CD pipelines and integrated test gates.
  • A methodical, curious mindset with strong attention to edge cases and clear documentation practices.
  • Strong communication skills for writing bug reports, test documentation, and quality summaries.
  • Preferred experience evaluating agentic workflows, multi-step reasoning chains, or RAG pipelines.
  • Preferred experience with LLM evaluation frameworks such as RAGAS, LangSmith, or Promptfoo.
  • Preferred experience using AI coding tools like Cursor or Claude in a QA workflow or building custom eval harnesses and synthetic test data generators.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

JustMarkets

QA Engineer (Payment)

JustMarkets 1-10 Capital Markets

QA Engineer at a fintech product team responsible for validating payment flows, transaction logic, and financial operations across web, mobile, and backend services.

Anywhere Full-time Junior QA Engineer
Agile Git Grafana GraphQL JIRA MySQL Playwright PostgreSQL Postman Scrum TypeScript
2 hours ago
Welo Global

Apus: Audio Annotation Verifier Polish (Poland)

Welo Global Professional Services

Welo Data is hiring a remote freelance Audio Annotation Verifier to review short Polish transcriptions for accuracy and compliance on a high-profile AI training data project.

South Africa Freelance Junior Data Annotator QA Engineer
$0k-$0k
LLM
2 hours, 28 minutes ago
Pavago

QA & Training Supervisor

Pavago IT Services

A remote QA & Training Supervisor will oversee quality, coaching, and training for a Patient Concierge team, with the goal of improving agent performance and maintaining consistent service standards.

Mexico Colombia Brazil Full-time Senior QA Engineer Training Manager
CRM
2 hours, 45 minutes ago
Keywords Studios

Join Keywords Talent Community - Freelance Subtitle Translator/QC, SDH/CC

Keywords Studios 10K-50K Internet Software & Services

Keywords Studios is seeking freelance subtitle translation and localization specialists for future remote opportunities supporting film, TV, streaming, and game content across its global entertainment services network.

Anywhere Freelance Mid Level QA Engineer Translator
2 hours, 45 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers