RemoteLeaf Logo
Log in Sign up

Module Lead, QA (AI/ML & Automation)

2 months, 2 weeks ago
India
Full-time
Lead
QA Engineer
Artificial Intelligence and Machine Learning
Agile Cypress Generative AI LLM Machine Learning NLP Playwright Python REST API Scrum Selenium SEM SEO SOAP SQL UX Design XML
Apply Now
BOLD

BOLD

BOLD is a tech company dedicated to transforming work lives by providing online products, tools, guidance, and support for job seekers, employers, and businesses. Founded by passionate entrepreneurs, BOLD empowers individuals to reach their professiona...

Internet Software & Services
251-1K
Founded 2004
View All Jobs 16

Description

  • Develop and own the QA strategy for AI-driven features, with emphasis on model accuracy, data drift, and performance metrics such as precision, recall, and F1-score.
  • Implement AI tools and custom LLM agents to automate test case generation, code analysis, and synthetic data creation.
  • Oversee testing of generative AI outputs using LLM-as-a-judge frameworks to evaluate hallucinations, toxicity, and prompt adherence.
  • Develop and own the quality framework from product development through production.
  • Drive business and QA initiatives in the area and coordinate across teams to meet delivery goals on time.
  • Participate in requirement analysis, sprint planning, and bug triage meetings.
  • Liaise with product, development, and infrastructure teams to deliver high-quality, high-performance, and highly available applications.
  • Develop quality scripts with sufficient coverage to support defect-free releases.
  • Manage, mentor, motivate, and guide QA team members to improve output, efficiency, and team satisfaction.
  • Evaluate and recommend new tools and technologies to improve testing and quality processes.

Requirements

  • 5+ years of experience as a Module Lead in QA for AI/ML and automation.
  • Solid understanding of the machine learning lifecycle, including EDA, training, evaluation, and deployment.
  • Experience using LLMs such as GPT, Claude, or Llama, and AI coding assistants.
  • Hands-on experience with UI/API automation tools such as Selenium, Playwright, or Cypress.
  • Experience with web service technologies such as XML, REST, and SOAP.
  • Knowledge of query languages such as SQL or JQL.
  • Experience testing complex web and mobile applications.
  • Strong application architecture and technical knowledge.
  • Strong understanding of web concepts, including web performance infrastructure.
  • Ability to play the role of scrum master with strong coordination skills.
  • Knowledge of basic UX standards, SEO/SEM concepts, and key tracking metrics.
  • Strong communication skills.
  • Experience in a high-volume, high-throughput web or ecommerce environment (preferred).
  • Experience with AI-driven healing capabilities in automation (preferred).

Benefits

  • An opportunity to work on AI-driven products and data science workflows at a global company.
  • Exposure to collaborative work with engineering, product, BI, legal, and other cross-functional teams.
  • The chance to help build products used by millions of people in 180 countries.
  • A diverse and inclusive workplace with equal opportunity hiring practices.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

On.Energy

Quality Assurance Engineer - Automation

On.Energy 51-250 Electric Utilities

ON.energy is seeking a QA Engineer to support automated and manual testing for its power infrastructure products, ensuring high-quality releases as the company scales in the AI and clean energy space.

Mexico Full-time Mid Level SDET (Software Development Engineer in Test)
Agile Azure BDD CI/CD Docker Git GitHub Actions GitLab CI Jenkins JIRA Playwright Postman Pytest Python Scrum Selenium SQL Unittest
5 hours, 39 minutes ago
Welo Global

Expert Rater Project - German (Spain)

Welo Global Professional Services

Welo Data is hiring an Expert Rater in Spain to coach raters, support quality evaluation workflows, and help improve the accuracy of AI-powered advertising systems.

Spain Freelance Junior QA Engineer Training Specialist
$41k-$41k
5 hours, 39 minutes ago
3Pillar Global

Senior Quality Assurance Engineer -Java/Automation

3Pillar Global 1K-5K Internet Software & Services

3Pillar Global is seeking a Senior Test Engineer to support modernization of a network traffic redirection platform by validating a legacy C++ migration to a cloud-native Java 21 system.

India Full-time Senior SDET (Software Development Engineer in Test)
Ansible C++ CI/CD ClickHouse Git Grafana Java Jenkins JIRA Kafka Kubernetes Microservices Notion OpenTelemetry Prometheus Redis
5 hours, 39 minutes ago
D

AI Native Technical Operations Lead - US Based

Di Rezze Family Office 11-50 Investment Management

HealthTech SaaS company is hiring its first technical operations hire to own the operational backbone of an AI-native development platform and support the engineering team’s workflow from the ground up.

United States Contract Senior DevOps Engineer SDET (Software Development Engineer in Test)
CI/CD Docker
5 hours, 54 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers