Senior Test Engineer Automation (Python) - OP02153-00

1 hour, 13 minutes ago
Full-time
Senior
Artificial Intelligence and Machine Learning
Dev.Pro

Dev.Pro

Dev.Pro is a globally distributed software development partner, specializing in custom outsourced software development for innovative technology companies to scale their businesses efficiently.

Internet Software & Services
251-1K
Founded 2011

Description

  • Own the end-to-end QA automation strategy for complex data and AI/NLP workflows.
  • Design, build, and maintain scalable automation frameworks using Python and pytest.
  • Integrate automated tests into Azure DevOps CI/CD pipelines.
  • Embed shift-left testing by collaborating early with developers to improve quality.
  • Create clear test plans, test cases, documentation, and QA metrics.
  • Track test coverage, automation effectiveness, and overall QA performance.
  • Identify, troubleshoot, and resolve complex issues across data-heavy systems.
  • Lead testing of AI/NLP components and use AI-assisted QA tools.
  • Set and maintain QA standards and processes for the platform.

Requirements

  • 5+ years of QA automation experience in data-intensive environments.
  • Strong Python skills for building and scaling automation frameworks.
  • Experience with pytest or a similar test automation framework.
  • Proven ability to design and own end-to-end automation strategies from scratch.
  • Hands-on experience with Azure services and Azure DevOps pipelines.
  • Strong background in API testing and CI/CD integration.
  • Knowledge of containerized test environments, including Docker.
  • Ability to create clear, well-structured test documentation and metrics.
  • Manual testing expertise.
  • Excellent client-facing communication and collaboration skills.
  • Upper-Intermediate English level.
  • AI/NLP testing experience is desirable.
  • Deepeval experience is desirable.

Benefits

  • 30 paid days off per year for vacation, holidays, or personal time.
  • 5 paid sick days per year, up to 60 days of medical leave, and 6 paid days off for major family events.
  • Partially covered health insurance after probation.
  • Wellness bonus for gym memberships, sports nutrition, and similar needs after 6 months.
  • English lessons, online training, and conferences.
  • Opportunity to explore new career paths.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff Software Development Engineer in Test (Staff SDET)

Kaseya 1K-5K IT Services

Kaseya is hiring a Staff Software Development Engineer in Test to lead platform-wide test automation, quality strategy, and AI-enabled testing across its global IT management and cybersecurity software organization.

Agile AWS Azure C# CI/CD Datadog Docker Gatling GCP Grafana JavaScript JMeter K6 Kubernetes OpenID Connect OpenTelemetry Playwright Pulumi Rust SAML Selenium System Design Terraform
1 hour, 13 minutes ago

Mid Senior Test Automation Engineer - Typescript + Playwright

Jalasoft 1K-5K Internet Software & Services

Jalasoft is hiring a Mid Senior Test Automation Engineer to develop and run automated testing for web applications within its quality assurance team.

Agile Playwright TypeScript
1 hour, 13 minutes ago

Junior AQA Engineer (Web)

United Tech 51-250 Internet Software & Services

United Tech is hiring a Junior AQA Engineer to support the quality and stability of its international web platform and new feature releases.

Agile CI/CD Confluence Git Java JIRA JUnit MySQL Postman REST API TestNG
2 hours, 19 minutes ago

Senior Manager, Firefox Mobile Test Engineering

Mozilla 251-1K Internet Software & Services

Mozilla is hiring a senior Test Engineering leader to set and own Firefox Mobile’s quality strategy and manage the team responsible for test automation, observability, and exploratory testing across Android and iOS.

Android Espresso iOS
3 hours, 22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers