RemoteLeaf Logo
Log in Sign up

Gen AI Tester

2 months ago
India
Contract
Senior
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
AWS Azure Databricks GCP Generative AI GPT HIPAA LLM Machine Learning Neural Networks Python Snowflake
Apply Now
Xenon7

Xenon7

Xenon7 provides advanced AI solutions and consultancy services, leveraging a team of highly qualified experts and a strong emphasis on research and innovation to address complex industry challenges and enhance operational efficiency.

Internet Software & Services
Founded 2014
View All Jobs 27

Description

  • Collaborate with product, data science, and engineering teams to define AI test strategies and use cases.
  • Design and execute test cases for LLM-based features including summarization, classification, conversational flows, and content generation.
  • Validate model outputs for factual accuracy, tone, relevance, and compliance with domain-specific standards.
  • Develop automated test scripts and frameworks for prompt-response validation and regression testing.
  • Evaluate ML model performance using metrics such as precision, recall, F1-score, and domain-specific thresholds.
  • Conduct integration testing across cloud platforms such as AWS, Azure, and GCP, as well as data environments like Snowflake and Databricks.
  • Document test results, anomalies, and improvement recommendations in a structured format.
  • Ensure ethical AI practices and compliance with data governance policies.

Requirements

  • 5+ years of experience in software testing, QA, or data validation roles.
  • 2–3 years of hands-on experience testing Generative AI models such as GPT, LLaMA, or Claude.
  • Strong proficiency in Python and experience with ML testing tools or frameworks.
  • Familiarity with cloud platforms including AWS, Azure, and GCP.
  • Experience with data engineering environments such as Snowflake and Databricks.
  • Understanding of ML workflows including time series, regression, classification, and neural networks.
  • Excellent communication skills and ability to drive cross-functional discussions with ownership.
  • Exposure to domain-specific AI applications such as pharma, healthcare, or finance is preferred.
  • Experience with prompt engineering and LLM evaluation frameworks is preferred.
  • Knowledge of ethical AI principles and regulatory compliance such as HIPAA and GDPR is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

HiddenLayer

AI Solutions Architect- Federal

HiddenLayer 11-50 IT Services

HiddenLayer is hiring a remote AI Solutions Architect for federal pursuits to lead technical pre-sales, design and deploy AI security platform implementations, and help mission owners secure AI systems across government environments.

United States Full-time Senior AI (Artificial Intelligence) Solutions Engineer
AWS Azure CI/CD Docker GitHub Helm Hugging Face Kubernetes Machine Learning MLOps OpenShift Python PyTorch
7 hours, 46 minutes ago
instacart.careers

AI Engagement Manager

instacart.careers 1K-5K Internet Software & Services

Instacart is hiring an AI Engagement Manager for its Enterprise AI Pod to coordinate complex B2B retail and CPG AI engagements from discovery through adoption and help translate field delivery into scalable execution.

United States Full-time Lead AI (Artificial Intelligence) Program Manager
$178k-$226k
Asana Confluence E-commerce JIRA Looker Power BI Salesforce Tableau
7 hours, 46 minutes ago
Superside

AI Creative (Illustrator)

Superside 251-1K Media

Superside is hiring a remote Illustrator to create brand, campaign, editorial, social, and digital visuals for leading brands, with the main goal of combining strong illustration craft and generative AI to deliver polished, on-brand creative at scale.

Latin America Contract Senior AI (Artificial Intelligence)
Generative AI Photoshop
8 hours, 16 minutes ago
Ejam

AI Video Content Creator

Ejam 11-50 Media

eJam is hiring an entry-level AI Video Content Creator to support its consumer brand marketing work by turning ideas and images into video assets for fast-moving creative production.

Philippines Full-time Entry Level AI (Artificial Intelligence) Graphic Designer
$0k-$0k
8 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers