RemoteLeaf Logo
Log in Sign up

Automation Test Engineer

9 hours, 15 minutes ago
Anywhere
Full-time
Senior
SDET (Software Development Engineer in Test)
Artificial Intelligence and Machine Learning
Agile CI/CD Cypress DevSecOps Generative AI GitHub Actions Jenkins MLflow Playwright Python Selenium
Apply Now
Skyward

Skyward

Skyward is a people-centered IT solutions company offering software development, cloud infrastructure, and digital transformation services with a focus on civic tech and government tech.

Internet Software & Services
51-250
Founded 2013
View All Jobs 6

Description

  • Design and maintain scalable automated test frameworks for web applications, APIs, and AI-driven features.
  • Develop pipelines for model validation, bias detection, and drift monitoring.
  • Create and execute functional, regression, performance, and AI-specific test plans.
  • Partner with AI/ML engineers to develop test datasets and simulate real-world behavior and edge cases.
  • Implement CI/CD-integrated quality gates for reliability and fairness metrics.
  • Mentor junior engineers and establish intelligent automation and AI testing practices.
  • Advocate for ethical AI standards and participate in responsible AI discussions.

Requirements

  • 5+ years of software QA or automation engineering experience, including at least 1 year testing AI/ML products.
  • Proficiency with an automation framework such as Selenium, Cypress, or Playwright.
  • Proficiency in a scripting language; Python preferred.
  • Experience testing AI models, including validation metrics, dataset versioning, and model explainability.
  • Familiarity with MLflow, TensorBoard, or similar AI observability tools.
  • Understanding of model bias, fairness audits, and compliance in government or regulated environments.
  • Experience in Agile DevSecOps environments and CI/CD tools such as Jenkins, GitHub Actions, or GitLab.
  • Strong communication and collaboration skills across engineering, data science, and product teams.
  • Previous support for the Centers for Medicare and Medicaid Services (CMS) preferred.
  • Ability to obtain and maintain a Public Trust security clearance; employment is contingent on a satisfactory background investigation.

Benefits

  • Medical, dental, vision, life, and disability insurance.
  • 15 days of paid leave, 7 sick days, 2 bereavement days, and 11 paid federal holidays.
  • Up to 40 hours of paid jury duty and up to 4 weeks of paid parental leave.
  • 401(k) with a 4% employer contribution and no vesting period.
  • Flexible working hours and remote work opportunities.
  • $5,000 annual professional development allowance and $600 for technical supplies and equipment.
  • Company-provided laptop and $2,000 referral bonus.
  • HSA, FSA, LegalShield, and IDShield voluntary benefits.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job-31497] QA Automation , Mid Level | Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa QA Automation Mid Level para atuar em uma squad de um grande cliente bancário, desenvolvendo e evoluindo soluções de automação que ampliem a qualidade, confiabilidade e velocidade das entregas Web, Mobile e API.

Brazil Full-time Mid Level SDET (Software Development Engineer in Test)
Appium Azure C# CI/CD Cypress Docker Git GitHub Actions GitLab CI Java JavaScript Jenkins JMeter K6 Playwright Python REST API Selenium Supertest TypeScript
1 day, 9 hours ago
CloudLinux

Senior Automation Engineer (remote work)

CloudLinux 51-250 IT Services

CloudLinux is seeking a Senior Automation Engineer to build and operate reliable automation systems for cloud costs, infrastructure inventory, network policies, and capacity workflows across its Infrastructure team.

Montenegro Portugal Serbia Bulgaria Spain Full-time Senior SDET (Software Development Engineer in Test)
Ansible AWS CI/CD Git Go Grafana Kubernetes Linux Python SQL Terraform
2 days, 10 hours ago
Smart Working

QA Engineer - Automation (Remote, Full-Time) [AS326]

Smart Working Internet Software & Services

Smart Working is seeking a Quality Engineer Analyst to deliver automation-led and manual testing for client Connected TV and Set Top Box projects through its Testing as a Service offering.

India Full-time Mid Level SDET (Software Development Engineer in Test)
Agile CI/CD Git GitLab JIRA TypeScript
3 days, 9 hours ago
Dev.Pro

QA Engineer Career Opportunities at Dev.Pro

Dev.Pro 251-1K Internet Software & Services

Dev.Pro is building a pipeline of test automation professionals through an evaluation process that provides career feedback and consideration for future opportunities on software projects for global clients.

Philippines Mid Level SDET (Software Development Engineer in Test)
Azure C# CI/CD Cypress Docker JMeter K6 Kubernetes Oracle Playwright Postman REST API
3 days, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers