Lead Software Development Engineer in Test - AI

1 month ago
Full-time
Lead
Artificial Intelligence and Machine Learning
HighLevel

HighLevel

HighLevel provides an all-in-one sales and marketing platform that agencies can white label and resell, offering tools and resources designed to help businesses consolidate their marketing efforts and achieve their growth objectives.

Internet Software & Services
251-1K
Founded 2018
$60M raised

Description

  • Define and own the overall QA strategy and end-to-end quality charter for the AI vertical.
  • Architect large-scale, reusable, cross-platform automation frameworks for AI product testing.
  • Design scalable test approaches for AI-specific risks including RAG, hallucination, drift, and bias.
  • Drive organisation-wide quality initiatives to reduce risk and improve scalability and reliability.
  • Make and own decisions on test strategy, tools, frameworks, and AI testing methodologies.
  • Coach and upskill the QA/SDET team, set best practices, and build a talent pipeline.
  • Influence cross-functional teams and participate in architecture discussions to align testing with business strategy.
  • Shape the AI quality roadmap and prioritize testing efforts across products/verticals.

Requirements

  • 6+ years of overall experience in QA/SDET roles.
  • Deep expertise in AI tools and model testing, including designing approaches for RAG, hallucination, drift, and bias.
  • Proven experience architecting large-scale, reusable, cross-platform automation frameworks.
  • Strong leadership skills with experience coaching teams, establishing best practices, and building talent pipelines.
  • Ability to influence cross-functional teams and participate in technical and architecture discussions.
  • Strong problem-solving skills and ability to own decisions on test strategy, tools, frameworks, and AI testing methodologies.
  • Bonus: Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure).
  • Bonus: Familiarity with MLOps pipelines and monitoring AI systems.
  • Bonus: Exposure to performance and scalability testing of AI workloads.

Benefits

  • Remote-first role (India / fully remote) with #LI-Remote designation.
  • Work in a large, global organization with 1,500+ team members across 15+ countries.
  • Opportunity to work on high-scale systems that process billions of API hits and message events, and to shape the AI quality roadmap.
  • Company is an Equal Opportunity Employer (inclusive hiring practices).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Software Development Engineer in Test (SDET), Kasten 

Veeam Software 1K-5K Internet Software & Services

Software Development Engineer in Test at Veeam Kasten working on the infrastructure and test frameworks for the Kubernetes-focused Veeam Kasten data management platform to ensure high-quality, secure backup and recovery capabilities.

AWS Bash CI/CD Docker Git Go Helm Kubernetes OpenShift Python Rancher Shell Scripting
1 month ago

Automation QA Engineer

Sporty Group 51-250 Media

QA Engineer at Sporty responsible for owning quality for Web and mobile releases by driving testing, validation, and launch decisions throughout the development lifecycle.

Android Android Studio Appium AWS CI/CD Docker iOS Java Jenkins JIRA Kubernetes MongoDB MySQL Postman Python REST API Selenium Xcode
1 month ago

Senior Business QA Engineer

Binance 5K-10K Capital Markets

Senior Business QA Engineer at Binance on the Asia team, responsible for ensuring the reliability and correctness of backend and API systems through comprehensive testing and automation.

Blockchain Java JUnit Microservices SQL TestNG
1 month ago

QA Automation Engineer

Fulfillment IQ 11-50 Professional Services

QA Automation SDET at Fulfillment IQ responsible for designing, developing, and maintaining Playwright/Python-based test automation frameworks to validate front-end, back-end, and data integrity while partnering with distributed development and product teams to ensure high-quality software delivery.

Agile Azure Azure Pipelines BDD CI/CD FastAPI JavaScript Linux Next.js Playwright PostgreSQL Pytest Python React REST API Selenium Shell Scripting SQL Tailwind CSS TDD TypeScript
1 month ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers