Senior Test Engineer Automation (Python) - OP02153

1 hour, 13 minutes ago
Full-time
Senior
Artificial Intelligence and Machine Learning
Dev.Pro

Dev.Pro

Dev.Pro is a globally distributed software development partner, specializing in custom outsourced software development for innovative technology companies to scale their businesses efficiently.

Internet Software & Services
251-1K
Founded 2011

Description

  • Own the end-to-end QA automation strategy for complex data and AI/NLP workflows.
  • Build and scale robust automation frameworks using Python and pytest or similar tools.
  • Integrate automated tests into Azure DevOps CI/CD pipelines.
  • Embed shift-left testing and collaborate early with developers to improve quality.
  • Create clear, well-structured test plans, test cases, and documentation.
  • Track test coverage, automation metrics, and overall QA effectiveness.
  • Identify and troubleshoot complex issues across data-heavy systems.
  • Own testing of AI/NLP components and leverage AI-assisted QA tools.
  • Lead QA standards and processes for a logistics platform enhanced with AI/NLP features.

Requirements

  • 5+ years of QA automation experience in data-intensive environments.
  • Strong Python skills for building and scaling automation frameworks.
  • Experience designing and owning end-to-end automation strategies from scratch.
  • Hands-on experience with Azure services and Azure DevOps pipelines.
  • Strong background in API testing and CI/CD integration.
  • Knowledge of containerized test environments such as Docker.
  • Ability to create clear, well-structured test documentation and metrics.
  • Manual testing expertise.
  • Excellent client-facing communication and collaboration skills.
  • Upper-Intermediate English level.
  • AI/NLP testing experience is desirable.
  • Deepeval experience is desirable.

Benefits

  • 99.9% remote work from anywhere in the world.
  • 30 paid days off per year.
  • 5 paid sick days, up to 60 days of medical leave, and up to 6 paid days off for major family events.
  • Partially covered health insurance after probation.
  • Wellness bonus for gym memberships, sports nutrition, and similar needs after 6 months.
  • Salary paid in U.S. dollars.
  • Approved overtime is covered.
  • English lessons, Dev.Pro University programs, online activities, and team-building events.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff Software Development Engineer in Test (Staff SDET)

Kaseya 1K-5K IT Services

Kaseya is hiring a Staff Software Development Engineer in Test to lead platform-wide test automation, quality strategy, and AI-enabled testing across its global IT management and cybersecurity software organization.

Agile AWS Azure C# CI/CD Datadog Docker Gatling GCP Grafana JavaScript JMeter K6 Kubernetes OpenID Connect OpenTelemetry Playwright Pulumi Rust SAML Selenium System Design Terraform
1 hour, 13 minutes ago

Mid Senior Test Automation Engineer - Typescript + Playwright

Jalasoft 1K-5K Internet Software & Services

Jalasoft is hiring a Mid Senior Test Automation Engineer to develop and run automated testing for web applications within its quality assurance team.

Agile Playwright TypeScript
1 hour, 13 minutes ago

Junior AQA Engineer (Web)

United Tech 51-250 Internet Software & Services

United Tech is hiring a Junior AQA Engineer to support the quality and stability of its international web platform and new feature releases.

Agile CI/CD Confluence Git Java JIRA JUnit MySQL Postman REST API TestNG
2 hours, 18 minutes ago

Senior Manager, Firefox Mobile Test Engineering

Mozilla 251-1K Internet Software & Services

Mozilla is hiring a senior Test Engineering leader to set and own Firefox Mobile’s quality strategy and manage the team responsible for test automation, observability, and exploratory testing across Android and iOS.

Android Espresso iOS
3 hours, 22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers