Hive Financial Systems

Hive Financial Systems operates in financial services, with a focus on the sub-prime consumer lending vertical. It says its core advantages come from extensive industry experience and cutting-edge technology for marketing, underwriting, scoring, and loan management, and it positions itself as building alternative credit and consumer lending systems using data-driven underwriting and automation.

Financial Services
11-50
Founded 2017

Description

  • Establish the QA function from the ground up, including test strategy, standards, and coverage requirements.
  • Build unit, integration, end-to-end, and AI-specific evaluation pipelines using Playwright and Vitest.
  • Audit the platform and identify high-risk areas before client deployments.
  • Design evaluation frameworks for non-deterministic LLM outputs, including regression testing, drift detection, and output scoring.
  • Build automated tests for agent orchestration, governance audit trails, and human-override behavior.
  • Validate the Company Brain knowledge graph for data accuracy, retrieval quality, and real-world failure modes.
  • Test the Company X-Ray analysis pipeline to ensure client-facing insights are reliable and trustworthy.
  • Own end-to-end testing for data ingestion pipelines, multi-model routing, and file ingestion workflows.
  • Recruit, hire, mentor, and onboard QA engineers as the team grows.
  • Partner with the Lead Engineer and participate in product planning to ensure quality is designed into the platform.

Requirements

  • 7+ years of QA engineering experience, including at least 3 years in a senior or lead role.
  • Experience testing AI/LLM-powered applications and building evaluation pipelines for model updates.
  • Strong Python test automation skills and experience maintaining CI/CD-integrated test suites.
  • Hands-on experience with Playwright and Vitest in a production environment.
  • Experience building automation frameworks from scratch in an early-stage environment.
  • Ability to test complex API chains, async/streaming responses, and multi-service workflows.
  • Comfort working with data pipelines and knowledge graph outputs.
  • Experience with LLM evaluation frameworks such as LangSmith or PromptFlow is preferred.
  • Experience testing agent frameworks or orchestration layers in production is preferred.
  • Background in regulated industries such as insurance, finance, or healthcare is preferred.

Benefits

  • Compensation of $140,000–$180,000 depending on experience.
  • Full-time employment.
  • Fully remote role for US-based candidates.
  • Atlanta, GA candidates are welcome.
  • Opportunity to join an early engineering team and shape the QA function from the start.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Mechanical Integration & Test Engineer, User Products (Starshield)

SpaceX 10K-50K Aerospace & Defense

SpaceX is hiring a Mechanical Integration & Test Engineer for Starshield user products to support the integration, manufacturing, and test flow for terminals, ground stations, gateways, and related hardware.

MATLAB Python
26 minutes ago

*Scout Junior Quality Coordinator - Spanish (Mexico)

Welo Global Professional Services

Welocalize is hiring a freelance remote Junior Quality Coordinator for a Search Quality Rater project supporting client data validation work in Mexico.

32 minutes ago

AI Training - Machine Learning Specialist (PST)

Prolific 51-250 Professional Services

Prolific is hiring AI Trainer – Machine Learning Specialists to apply professional machine learning expertise in training and evaluating AI models through paid participant tasks.

Computer Vision Deep Learning Machine Learning NLP Statistics
39 minutes ago

Sr. QA Engineer

Media.Monks 5K-10K Media

Monks is hiring a Quality Assurance team member to ensure the reliability, performance, and security of its software products through comprehensive testing and quality validation.

Agile Appium AWS Azure Bitbucket CI/CD Cypress Docker GCP Git Java JavaScript JIRA JMeter Kubernetes Locust Penetration Testing Playwright Postman Python REST API Selenium SQL
41 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers