RemoteLeaf Logo
Log in Sign up

QA Analyst - LOIS for Word

20 hours, 48 minutes ago
United States
Full-time
Mid Level
QA Engineer
Quality Assurance and Testing
CI/CD LLM UX Design
Apply Now
Filevine

Filevine

Filevine is a top legal tech company revolutionizing legal work with AI-powered case management software, empowering law firms to streamline operations and enhance client services.

Specialized Consumer Services
501-1000
Founded 2015
$226M raised
View All Jobs 17

Description

  • Define and own the product test strategy, QA processes, and playbook.
  • Partner with product and engineering early to prepare test plans before features ship.
  • Evaluate AI output for accuracy, citation reliability, and appropriately scoped reasoning.
  • Design and maintain evaluation sets for non-deterministic AI outputs and regression detection.
  • Test AI-generated document edits for accuracy and formatting fidelity across document structures.
  • Build automated CI/CD guardrails for critical product flows.
  • Write structured, reproducible bug reports backed by evidence.
  • Collaborate with legal domain experts to translate customer workflows into test coverage.
  • Identify workflow and design improvements alongside functional quality issues.
  • Compare behavior across product surfaces and document discrepancies.

Requirements

  • 2+ years of QA experience, including ownership of test strategy for a product or major feature area.
  • Experience building QA processes and automation from scratch in a fast-moving environment.
  • Ability to operate effectively in ambiguity and test rapidly shipping features.
  • Strong analytical and problem-solving skills focused on functional correctness and AI output quality.
  • Ability to define quality standards for non-deterministic systems without a single correct answer.
  • Excellent written communication and ability to create clear, actionable bug reports.
  • Experience with bug-tracking tools and test-management workflows.
  • Experience testing AI or LLM-based products, including output accuracy and evaluation design (preferred).
  • Experience setting up CI/CD pipelines and automated-test release gates (preferred).
  • Legal technology experience or comfort reading legal contracts; programming experience beyond test automation; and design or UX sensibility (preferred).

Benefits

  • Salary range of $105,000–$150,000, with final compensation based on location, qualifications, experience, skills, and performance.
  • Medical, dental, and vision insurance for full-time employees.
  • Maternity and paternity leave for full-time employees.
  • Short- and long-term disability coverage.
  • Learning opportunities with a dedicated leadership team.
  • Company swag.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Airalo

Quality Assurance Engineer

Airalo 51-200 Airlines

Join Airalo as a remote telecom QA and roaming validation specialist, ensuring reliable Data, Voice, and SMS connectivity for travelers using its global eSIM platform.

Spain United Kingdom Full-time Senior QA Engineer
$84k-$121k
CI/CD DNS Python Wireshark
21 hours, 18 minutes ago
Veeva Systems

Senior Quality Engineer

Veeva Systems 5001+ Internet Software & Services

Veeva Systems is hiring a Senior Quality Engineer to ensure reliable, high-quality releases of mission-critical life sciences software across mobile, desktop, web, and hybrid platforms.

Canada Full-time Senior QA Engineer
$53k-$106k
Agile Android Appium CI/CD Confluence Espresso Generative AI iOS JIRA Linux Playwright Postman Selenium SQL TestNG Unix
21 hours, 18 minutes ago
Veeva Systems

QA Engineer - Ostro

Veeva Systems 5001+ Internet Software & Services

Join Veeva Ostro as a QA Engineer to ensure the quality, reliability, and scalability of SaaS solutions that connect life sciences innovations with the people who need them.

Canada Full-time Mid Level QA Engineer
$46k-$82k
AWS CI/CD Cypress GCP Java JavaScript Jenkins LLM Playwright Postman Python Selenium
21 hours, 18 minutes ago
Veeva Systems

QA Engineer - Ostro

Veeva Systems 5001+ Internet Software & Services

Veeva Ostro is seeking a QA Engineer to ensure the quality, reliability, and scalability of its SaaS platform serving the life sciences industry through manual and automated testing.

United States Full-time Mid Level QA Engineer
$70k-$120k
AWS CI/CD Cypress GCP Java JavaScript Jenkins Playwright Postman Python Selenium
21 hours, 18 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers