Reports

Read the execution summary, requirement status, defect aging and flaky cases reports of a QA project.

Quality ▸ Reports has four reports. Each has its own filters and an Updated time with a refresh button. Every chart has a View as table button for the values. Date ranges are 7 days, 30 days (the default), 90 days or Custom (at most 366 days). Execution summary# What was run in the period: the number of results and executions, the pass rate and the median duration, with Results per day, Results by test set, Results by environment and Results by source. Filter by Date range, Release, Test set and Environment. The pass rate counts passed results against passed, failed, blocked and error results. Requirement status# Whether each requirement is verified, based on the newest result of each of its test cases in the period. Filter by Date range and Release. Verdict Meaning Verified Its test cases were executed and none failed. Failed At least one of its test cases failed, was blocked or ended in error. Not run It has test cases, but none was executed in the period. Not covered No test case verifies it. Defect aging# How old the open defects (Open and In progress) are: Open defects by age (0–7, 8–30, 31–90 and 90+ days), Open defects by severity, Defects by status and the Oldest open defects. Filter by Release. This report needs permission to view defects. Flaky cases# Test cases whose outcome keeps changing between passed and failed. For each test case QA Hub looks at its last runs, counts the Flips between consecutive outcomes and shows the Flakiness (flips divided by runs minus one). Blocked, skipped, error and cancelled results are left out; an overridden result counts with its final status. Last runs: how many recent results to look at (default 10). Min. runs: test cases with fewer runs are not listed (default 3). Release: limit to one release. Export the data# Each list in QA Hub (requirements, test cases, test sets, executions, an execution's results, defects and the coverage matrix) has Export CSV. The export uses the list's filters and stops at 10,000 rows. Next steps# QA Hub overview Jobs

Execution summary

Requirement status

Defect aging

Flaky cases

Export the data

Next steps