Job Description

QA Triage & Execution Analyst (Pipeline Operator)


Role Summary

Owns the stability, accuracy, and signal quality of automated test execution by systematically analyzing, debugging, and resolving failing scripts across pipelines.

Key Responsibilities

  • Execute and monitor pipelines in:

Azure DevOps

  • Categorize failures:

Test defect vs environment vs data vs code

  • Script-Level Debugging & Root Cause Analysis

Debug automation scripts written in:

Playwright / Selenium

Identify root causes such as:

Flaky selectors (dynamic DOM changes)

Synchronization/timing issues (wait conditions)

Assertion mismatches

Data dependency failures

Validate API failures using:

Postman or GraphQL tools

Inspect logs and telemetry (App Insights, pipeline logs)

  • Track trends and provide t...

Ready to Apply?

Take the next step in your AI career. Submit your application to Evolving Systems today.

Submit Application