QA Engineer

21 hours, 47 minutes ago
Full-time
Mid Level
Quality Assurance and Testing
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Define and implement test plans for GenAI, LLM, Agentic AI, and RAG systems.
  • Design and maintain automated test suites using Python and pytest.
  • Develop and execute API tests for model endpoints, data pipelines, and microservices.
  • Perform functional, regression, and performance testing of AI services.
  • Integrate automated testing into CI/CD pipelines using tools such as Jenkins, GitHub Actions, or GitLab CI.
  • Analyze model-output quality, bias, fairness, and performance metrics; detect anomalies and document findings.
  • Partner with ML, data science, and product teams to build test harnesses and validate new model releases.
  • Create and maintain test datasets, fixtures, mock services, documentation, and stakeholder dashboards.
  • Report defects, track their resolution, and validate fixes against quality standards.
  • Mentor junior testers and promote scalable AI QA practices.

Requirements

  • 4+ years of QA engineering experience in AI or data science environments.
  • Strong proficiency in Python, pytest, and API testing frameworks such as Requests or RestAssured.
  • Hands-on experience testing GenAI, LLM, Agentic AI, and RAG systems.
  • Experience with functional, regression, performance, and automated testing.
  • Familiarity with CI/CD pipelines and automation tools, including Jenkins and GitHub Actions.
  • Understanding of AI ethics, bias mitigation, fairness, and model explainability.
  • Ability to translate complex AI concepts into clear, testable requirements.
  • Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
  • Track record of delivering high-quality releases on time.
  • Interest in emerging AI technologies and testing trends.

Benefits

  • Remote work within India.
  • Salary range of INR 10–25 LPA.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Quality Assurance Engineering (QAE) - Intern

Drivetrain 11-50 Capital Markets

Drivetrain is seeking a Quality Assurance Engineer Intern to help engineering teams ensure the quality and reliability of its financial planning and decision-making platform.

18 hours, 47 minutes ago

Senior QA Engineer - (6 months) - Remote - Immediate Hiring

Robusta Technology Group 51-200 Professional Services

Octopus, part of Robusta Technology Group, is seeking a Senior QA Engineer to ensure product quality and reliability across the software development lifecycle for global engineering hub solutions.

Agile
21 hours, 47 minutes ago

QA Engineer

Aster 1-10 Technology, Information and Internet

Join the company as a QA/Dev-in-Test engineer to own AI-driven software testing and release processes while improving defect detection and release quality.

Go Java LLM Python Rust
21 hours, 47 minutes ago

测试负责人

Gate.com 51-200 IT Services

Lead quality engineering for a global digital asset platform, building a scalable testing system that reduces release risk and strengthens delivery reliability across its crypto products.

Blockchain CI/CD
21 hours, 47 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers