RemoteLeaf Logo
Log in Sign up

Module Lead, QA (AI/ML & Automation)

1 month, 1 week ago
India
Full-time
Lead
QA Engineer
Artificial Intelligence and Machine Learning
Agile Cypress Generative AI LLM Machine Learning NLP Playwright Python REST API Scrum Selenium SEM SEO SOAP SQL UX Design XML
Apply Now
BOLD

BOLD

BOLD is a tech company dedicated to transforming work lives by providing online products, tools, guidance, and support for job seekers, employers, and businesses. Founded by passionate entrepreneurs, BOLD empowers individuals to reach their professiona...

Internet Software & Services
251-1K
Founded 2004
View All Jobs 19

Description

  • Develop and own the QA strategy for AI-driven features, with emphasis on model accuracy, data drift, and performance metrics such as precision, recall, and F1-score.
  • Implement AI tools and custom LLM agents to automate test case generation, code analysis, and synthetic data creation.
  • Oversee testing of generative AI outputs using LLM-as-a-judge frameworks to evaluate hallucinations, toxicity, and prompt adherence.
  • Develop and own the quality framework from product development through production.
  • Drive business and QA initiatives in the area and coordinate across teams to meet delivery goals on time.
  • Participate in requirement analysis, sprint planning, and bug triage meetings.
  • Liaise with product, development, and infrastructure teams to deliver high-quality, high-performance, and highly available applications.
  • Develop quality scripts with sufficient coverage to support defect-free releases.
  • Manage, mentor, motivate, and guide QA team members to improve output, efficiency, and team satisfaction.
  • Evaluate and recommend new tools and technologies to improve testing and quality processes.

Requirements

  • 5+ years of experience as a Module Lead in QA for AI/ML and automation.
  • Solid understanding of the machine learning lifecycle, including EDA, training, evaluation, and deployment.
  • Experience using LLMs such as GPT, Claude, or Llama, and AI coding assistants.
  • Hands-on experience with UI/API automation tools such as Selenium, Playwright, or Cypress.
  • Experience with web service technologies such as XML, REST, and SOAP.
  • Knowledge of query languages such as SQL or JQL.
  • Experience testing complex web and mobile applications.
  • Strong application architecture and technical knowledge.
  • Strong understanding of web concepts, including web performance infrastructure.
  • Ability to play the role of scrum master with strong coordination skills.
  • Knowledge of basic UX standards, SEO/SEM concepts, and key tracking metrics.
  • Strong communication skills.
  • Experience in a high-volume, high-throughput web or ecommerce environment (preferred).
  • Experience with AI-driven healing capabilities in automation (preferred).

Benefits

  • An opportunity to work on AI-driven products and data science workflows at a global company.
  • Exposure to collaborative work with engineering, product, BI, legal, and other cross-functional teams.
  • The chance to help build products used by millions of people in 180 countries.
  • A diverse and inclusive workplace with equal opportunity hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Coderio

QA Automation (Latam)

Coderio 51-250 Internet Software & Services

Coderio is hiring a Senior QA Automation professional to join a remote, agile engineering team focused on building automated test coverage for complex digital solutions, including functional, regression, integration, payment, and asynchronous workflows.

Chile Colombia Peru Contract Mid Level SDET (Software Development Engineer in Test)
Agile Android Appium CI/CD Cypress iOS Kafka REST API Selenium
2 hours, 13 minutes ago
Bellese Technologies

Engineer II, FHIR

Bellese Technologies 51-250 Internet Software & Services

Bellese is hiring an Engineer II, FHIR to support CMS’s Hospital Quality Reporting program by modernizing healthcare reporting systems and building FHIR-based solutions for public health outcomes.

United States Full-time Mid Level QA Engineer Software Engineer
$109k-$125k
Agile Angular AWS CI/CD Databricks Go HTML Java Jenkins PostgreSQL Python REST API SQL Terraform TypeScript
2 hours, 43 minutes ago
Sports Academy

AI Quality Analyst

Sports Academy Education Services

A private school network is hiring a quality-focused operator to manage testing and knowledge base maintenance for its AI-powered SMS bot and AI-graded call training system.

United States Canada United Kingdom Part-time Junior AI (Artificial Intelligence) QA Engineer
Git JSON VS Code
3 hours, 52 minutes ago
Black Duck Inn

Senior SDET Engineer

Black Duck Inn 1K-5K Internet Software & Services

Black Duck Software is hiring a Senior SDET Engineer to advance automated testing for desktop IDE plugins across multiple platforms as part of its application security and DevSecOps product development.

India Senior SDET (Software Development Engineer in Test)
DevSecOps Eclipse Java Linux LLM macOS Python Visual Studio VS Code
4 hours, 49 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers