RemoteLeaf Logo
Log in Sign up

Module Lead, QA (AI/ML & Automation)

1 month, 4 weeks ago
India
Full-time
Lead
QA Engineer
Artificial Intelligence and Machine Learning
Agile Cypress Generative AI LLM Machine Learning NLP Playwright Python REST API Scrum Selenium SEM SEO SOAP SQL UX Design XML
Apply Now
BOLD

BOLD

BOLD is a tech company dedicated to transforming work lives by providing online products, tools, guidance, and support for job seekers, employers, and businesses. Founded by passionate entrepreneurs, BOLD empowers individuals to reach their professiona...

Internet Software & Services
251-1K
Founded 2004
View All Jobs 17

Description

  • Develop and own the QA strategy for AI-driven features, with emphasis on model accuracy, data drift, and performance metrics such as precision, recall, and F1-score.
  • Implement AI tools and custom LLM agents to automate test case generation, code analysis, and synthetic data creation.
  • Oversee testing of generative AI outputs using LLM-as-a-judge frameworks to evaluate hallucinations, toxicity, and prompt adherence.
  • Develop and own the quality framework from product development through production.
  • Drive business and QA initiatives in the area and coordinate across teams to meet delivery goals on time.
  • Participate in requirement analysis, sprint planning, and bug triage meetings.
  • Liaise with product, development, and infrastructure teams to deliver high-quality, high-performance, and highly available applications.
  • Develop quality scripts with sufficient coverage to support defect-free releases.
  • Manage, mentor, motivate, and guide QA team members to improve output, efficiency, and team satisfaction.
  • Evaluate and recommend new tools and technologies to improve testing and quality processes.

Requirements

  • 5+ years of experience as a Module Lead in QA for AI/ML and automation.
  • Solid understanding of the machine learning lifecycle, including EDA, training, evaluation, and deployment.
  • Experience using LLMs such as GPT, Claude, or Llama, and AI coding assistants.
  • Hands-on experience with UI/API automation tools such as Selenium, Playwright, or Cypress.
  • Experience with web service technologies such as XML, REST, and SOAP.
  • Knowledge of query languages such as SQL or JQL.
  • Experience testing complex web and mobile applications.
  • Strong application architecture and technical knowledge.
  • Strong understanding of web concepts, including web performance infrastructure.
  • Ability to play the role of scrum master with strong coordination skills.
  • Knowledge of basic UX standards, SEO/SEM concepts, and key tracking metrics.
  • Strong communication skills.
  • Experience in a high-volume, high-throughput web or ecommerce environment (preferred).
  • Experience with AI-driven healing capabilities in automation (preferred).

Benefits

  • An opportunity to work on AI-driven products and data science workflows at a global company.
  • Exposure to collaborative work with engineering, product, BI, legal, and other cross-functional teams.
  • The chance to help build products used by millions of people in 180 countries.
  • A diverse and inclusive workplace with equal opportunity hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Goods & Services

Staff SDET Mobile (AI-Enabled)

Goods & Services 51-250 Media

Goods & Services is seeking a Staff SDET to design and maintain automated testing for native mobile and responsive web applications in a global, design-led engineering environment.

Mexico Colombia Uruguay Senior SDET (Software Development Engineer in Test)
Android Appium C# CI/CD Espresso Git iOS Java JavaScript Kotlin Playwright Postman Python Selenium TypeScript
17 hours, 5 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Agent Evaluation Engineer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a project-based software specialist to help build and evaluate datasets for AI coding agents in realistic simulated development environments.

Portugal Contract Senior AI (Artificial Intelligence) SDET (Software Development Engineer in Test)
$83k-$83k
Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript
17 hours, 5 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Agent Evaluation Engineer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking an experienced software development specialist for project-based work evaluating AI coding agents by designing realistic development tasks, defining success criteria, and validating solutions in simulated environments.

Canada Contract Senior AI (Artificial Intelligence) QA Engineer
Up to $104k
Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript
17 hours, 20 minutes ago
Dev.Pro

Intermediate Test Automation Engineer (Performance Testing) - OP02185

Dev.Pro 251-1K Internet Software & Services

Dev.Pro is seeking a Test Automation Engineer to support cloud-based digital menu board solutions by building and maintaining performance tests that improve scalability, reliability, and system performance.

Bulgaria Poland Portugal Contract Mid Level SDET (Software Development Engineer in Test)
Agile AWS CI/CD Docker Gatling Jenkins Python Scala
17 hours, 20 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers