Test Plan Run Results in Testsigma

View and download reports from the Run Results page. The page presents results at the test case, test suite, and test machine level, and shows the count of passed and failed tests along with the reason for each failure. Drill into a single step to read its details and errors, check its logs, and compare it against an earlier run.

Prerequisites

Before you begin, ensure that:

1. You have referred to the documentation on creating test plans.
2. A test plan has completed at least one run.

Steps to View Test Suite Results

1. From the left navigation bar, go to Run Results and click the test plan for which you want to check the results.
2. Results open at the test suite level by default.
3. Expand a test suite to check the test case results inside it.
4. The parallel indicators on each row show how many test suites run in parallel, and how many test cases run in parallel within each suite.

Steps to View Test Case Results

1. On the Run Results page, select Test Cases from the dropdown menu.
2. The page displays all test cases from all test suites.
3. Hover over a failed test case to view a brief description of the reason for failure.
4. Click a test case to view its detailed results.

5. On the Test Case Results page, the step list appears on the left, headed by the step count. Select a step to open its details on the right.

   Each step in the list shows its status icon. A healed step also shows the auto-heal icon at the end of its row.

   NOTE:

   When a run contains healed steps, a banner above the step list shows how many steps were auto-healed. Use the thumbs up and thumbs down icons on the banner to rate the heal.

6. Review the step details on the right.

   The header above the step list shows the total run duration, the browser version, and the operating system version. The step header shows the step status, start time, duration, step number, and step action.

   The THIS RUN section shows the screenshot captured for the step. Click the expand icon to view it full size, or the download icon to save it. Below the screenshot, the step details show:

   Field	What it shows
   Element	The element the step targets. Steps without an element read "This step targets no element".
   Locator	The locator type and value used for the element
   Run Type	The type of run that produced this result
   Test data type and Test data	The data type and the value passed to the step
   Start time and Duration	When the step started and how long it ran
   Step level timeout and Plan level timeout	The wait limits applied to the step
   Error code and Error message	The error raised during execution, if any

   NOTE:

   For a failed step, the ERROR and ANALYZER VERDICT sections appear above THIS RUN. For details, refer to the documentation on debugging test case failures.

7. Click Affected tests to see what else depends on the element this step uses. The Affected Instances panel opens with tabs for Test Cases, Step Groups, Test Suites, and Test Plans, each with its count.
8. Click More details to open Test Case Overview, which shows the step breakdown across Passed, Failed, Not Executed, and Stopped, the run message, and Machine Details.

Steps to View Test Machine Results

1. On the Run Results page, select Test Machines from the dropdown menu.
2. The page displays all test machines included in the test plan.
3. Click a test machine to expand and view the test suites it contains.

Step Details Panels

The icons in the step header open side panels with more information about the selected step.

Click the close icon to return to the step details.

Test Runs in Run Results

1. From the Test Runs panel, select a run to view its test run results.
2. Click Rerun in the top-right corner.

3. Select a rerun option:

   • All Test Cases: Reruns all the test cases in the selected run.
   • All Failed Test Cases: Reruns only the test cases that failed in the selected run.
   • Select Cases for Re-Run: Reruns only the test cases you select.
4. Click Start execution.

Compare Runs

Compare two runs of the same test case side by side.

1. On the Test Case Results page, click Compare Runs.

2. Select a run from the list at the top of either panel.

   Each panel shows the run's duration, date, step count, and failed count, followed by every step with its own duration.

Compare a Single Step

Compare one step against the same step in another run.

1. In the THIS RUN section of the step, click Compare Steps. The step comparison overlay opens, with the step under comparison in the breadcrumb.

   The left panel defaults to Authoring Time, and the right panel shows the current run with its date and time and its status, such as Passed or Healed. To change the comparison, select a different run from the list at the top of either panel.

2. From the View list, select a comparison mode.

   

   Mode	What it shows
   Compare with Baseline	The baseline run and the current run side by side
   Overlay Wipe	Both screenshots in one frame, with a divider to wipe between them
   Current Step Only	The current run's screenshot on its own
   Element Source	A diff of the captured page source across the two runs, alongside the locator value for each

   In Overlay Wipe, the capture recorded at authoring time and the capture taken during execution load into a single frame separated by a vertical divider. Drag the handle on the divider to wipe between them.

   

3. Click Screens to compare screenshots only, or Screens + Details to show the step details beneath each screenshot.

   Screens + Details lists the run type, start time, duration, step level timeout, plan level timeout, error code, error message, element name, and locator for each run. Where a value was not captured, the field shows a dash.

   NOTE:

   Screens + Details is disabled in Overlay Wipe, because that mode renders a single combined frame rather than two panels.

4. To compare a different step, select a step from the Change Step list.

   

   Each entry shows the step number, the step name, its duration, and its status, including Not Executed for steps the run never reached.

5. Click the download icon on a panel to save that screenshot, or the download icon at the top right to save the full comparison.

Overview of Tests in Run Results

1. The Run Overview section of the Run Results page is dynamic and provides a summary of tests at all levels for the selected run.
2. This section displays the Last Run, Test Plan Settings, and Accessibility Test Overview.
3. Click View Runs to view all runs, More Settings to access additional settings, and View Report to check the Accessibility Testing Report.

Exporting the Test Reports

1. Click the Export icon and select the download format from the dropdown menu.

2. For PDF format, the Export PDF dialog appears. Select the appropriate options and click Export.

   

3. For JUnit format, the report is downloaded instantly as an XML file.
4. For XLSX format, a download link to the report is sent to your email.

Available Shortcuts in Run Results

For Mac:

• Option + C: View results at the test case level
• Option + S: View results at the test suite level
• Option + M: View results at the test machine level
• Option + H: Open/close run history
• Option + F: Open filters
• Option + O: Open/close run overview

For Windows:

• Alt + C: View results at the test case level
• Alt + S: View results at the test suite level
• Alt + M: View results at the test machine level
• Alt + H: Open/close run history
• Alt + F: Open filters
• Alt + O: Open/close run overview

How Run Results Handle Renamed and Deleted Items

The Run Results page shows the values as they were when the run executed. Renaming or deleting a test plan, test suite, test case, environment, test machine, or test data profile doesn't change what an earlier run displays.