Use Serva

Use Serva

Empowering mobility with an ecosystem that simplifies journeys and drives growth.

Internet Software & Services

Description

  • Design, write, and maintain manual test plans and test cases across the full product.
  • Build and scale automation frameworks for regression, integration, and end-to-end testing.
  • Test AI-powered features, including LLM outputs, agent behavior, and model responses for accuracy, safety, and consistency.
  • Collaborate closely with developers and product managers to shift QA left in the development lifecycle.
  • Define and track quality metrics, identify risk areas, and surface issues before production.
  • Develop evaluation strategies for non-deterministic systems, including prompt variation testing and output validation pipelines.
  • Participate in sprint planning and retrospectives as the team’s quality voice.

Requirements

  • 2+ years of professional experience in software quality assurance covering both manual and automation testing.
  • Hands-on experience testing AI agents, LLM-powered features, or ML models and understanding non-deterministic behavior.
  • Proficiency in at least one modern automation framework such as Playwright, Cypress, Selenium, or equivalent.
  • Strong API testing skills using tools like Postman, REST Assured, or similar.
  • Experience working in agile environments with CI/CD pipelines and integrated test gates.
  • A methodical, curious mindset with strong attention to edge cases and clear documentation practices.
  • Strong communication skills for writing bug reports, test documentation, and quality summaries.
  • Preferred experience evaluating agentic workflows, multi-step reasoning chains, or RAG pipelines.
  • Preferred experience with LLM evaluation frameworks such as RAGAS, LangSmith, or Promptfoo.
  • Preferred experience using AI coding tools like Cursor or Claude in a QA workflow or building custom eval harnesses and synthetic test data generators.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

QA Engineer (Payment)

JustMarkets 1-10 Capital Markets

QA Engineer at a fintech product team responsible for validating payment flows, transaction logic, and financial operations across web, mobile, and backend services.

Agile Git Grafana GraphQL JIRA MySQL Playwright PostgreSQL Postman Scrum TypeScript
2 hours ago

Apus: Audio Annotation Verifier Polish (Poland)

Welo Global Professional Services

Welo Data is hiring a remote freelance Audio Annotation Verifier to review short Polish transcriptions for accuracy and compliance on a high-profile AI training data project.

LLM
2 hours, 28 minutes ago

QA & Training Supervisor

Pavago IT Services

A remote QA & Training Supervisor will oversee quality, coaching, and training for a Patient Concierge team, with the goal of improving agent performance and maintaining consistent service standards.

CRM
2 hours, 45 minutes ago

Join Keywords Talent Community - Freelance Subtitle Translator/QC, SDH/CC

Keywords Studios 10K-50K Internet Software & Services

Keywords Studios is seeking freelance subtitle translation and localization specialists for future remote opportunities supporting film, TV, streaming, and game content across its global entertainment services network.

2 hours, 45 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers