Keyloop

Keyloop

Keyloop is the largest global automotive technology solutions provider, offering future motive technology to enhance the car buying and owning experience. Their comprehensive solutions cover the entire consumer lifecycle, empowering growth through dist...

Automotive
1K-5K

Description

  • Design and own the quality strategy for the AI agent platform, including testing approaches for non-deterministic, LLM-powered systems.
  • Build and maintain automated test suites across unit, integration, API, and end-to-end scenarios.
  • Develop evaluation frameworks for agent behaviour, including reasoning quality, tool use, memory, and multi-step interaction flows.
  • Test and validate the omnichannel communication platform across web, messaging, voice, and other channels.
  • Collaborate closely with engineers and product teams to define acceptance criteria and catch issues early in the development cycle.
  • Champion a culture of quality by reviewing test coverage in pull requests and advocating for testability in system design.
  • Raise quality standards by helping define what “done” means across the team.
  • Use and help shape AI-assisted testing tooling to accelerate coverage and surface issues faster.

Requirements

  • Proven experience as a Senior QA Engineer on complex, production software products.
  • Strong hands-on experience with test frameworks such as Playwright, Cypress, or Jest.
  • Experience testing APIs, backend services, and databases such as PostgreSQL or similar.
  • Clear understanding of how to test non-deterministic systems.
  • Experience designing and implementing QA strategy.
  • Strong communication skills with the ability to explain quality risks to engineers and non-technical stakeholders.
  • Experience evaluating LLM or agentic systems, prompt behaviour, output quality, hallucination risks, or agent evaluation frameworks is preferred.
  • Familiarity with performance, load, or chaos testing for real-time or event-driven systems is preferred.
  • Background in automotive, dealership tech, or B2B SaaS is preferred.
  • Exposure to AI-assisted development and testing tools such as GitHub Copilot, Cursor, or Claude Code is preferred.
  • Academic qualifications are not required; selection is based on experience and potential.

Benefits

  • Remote working is offered.
  • Training and support are provided to help employees try new things, adapt to change, and explore different career paths.
  • Opportunities to collaborate and learn from industry experts around the world.
  • A strong inclusive culture that respects diversity and different lifestyles.
  • Pay and benefits designed to reflect performance and attract top talent.
  • Investment in employee development and career growth.
  • An equal opportunity employer committed to building a diverse and inclusive workforce.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Construction Quality / Field Engineer

Highbridge Human Capital 1-10 Professional Services

Construction Quality / Field Engineer for a company serving civil, forestry, road construction, and mine-related projects, focused on managing quality documentation and verifying field work against project requirements.

53 minutes ago

Engineering Operations Specialist

Varicent 251-1K Professional Services

Varicent is hiring a fully remote Engineering Operations Specialist to support its R&D organization by coordinating cross-functional operations, vendor and procurement activity, reporting, and compliance work.

Agile Asana AWS Azure Git JIRA Monday.com Scrum SQL
1 hour, 51 minutes ago

Language Data Quality Reviewer for Ukrainian (Freelance/Task-based)

Volga Partners 51-250 Internet Software & Services

Volga Partners is hiring a Ukrainian-English Language Data and Quality Reviewer for an ongoing, remote freelance task-based project that supports data analysis, labeling, and quality review work on an intermittent basis.

Machine Learning
2 hours, 4 minutes ago

Electrical Validation Engineer

ALTEN Technology 251-1K Construction & Engineering

ALTEN Technology USA is hiring an automotive validation engineer to support vehicle electrical feature testing, architecture validation, and issue resolution across production programs.

2 hours, 21 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers