Test Plan Run Results in Testsigma


In Testsigma, you can view and download reports from the Run Results page. This page provides results at the test cases, test suites, and test machine level and also helps you check test runs, view the run overview, and see the count of passed/failed tests along with the reasons for failure. This article provides an overview of the Run Results page in Testsigma.


Prerequisites

Before you begin, make sure you have created and executed a test plan.


Steps to View Test Suite Results

  1. From the left navigation bar, go to Run Results and click on the test plan for which you want to check the results. Test Suites
  2. By default, you’ll see the results at test suite level. Results at Test Suite Level
  3. You can expand the test suite to check test case results inside the suite. Expand Test Suite
  4. The symbols shown with the arrow in the image below indicate the number of test suites running in parallel and the number of test cases running in parallel within each test suite. Parallel Settings Indicators

Steps to View Test Case Results

  1. On the Run Results page, select Test Cases from the dropdown menu. Test Cases
  2. The page displays all test cases from all test suites. Test Cases in all Suites
  3. You can hover over a failed test case to view a brief description of the reason for failure. Failure Dialog Box
  4. Click a test case to view its detailed results.
  5. On the Test Case Results page, you can view all the test steps along with the Element Information, Test Data, Settings, Metadata, and Step Details. Detailed Result of a Test Case
  6. Click More details to access additional information. More Details

Steps to View Test Machine Results

  1. On the Run Results page, select Test Machines from the dropdown menu. Test Machine Run Results
  2. The page displays all test machines included in the test plan. All Test Machines

    NOTE:

    To view the test cases part of the test machine, navigate to the Test Suites view and apply a Test Machine filter. This provides a view of all test cases in the selected test suite and test machine.

  3. Click a test machine to expand and view the test suites it contains. Expand Machine

Test Runs in Run Results

  1. From the Test Runs panel, select a different run to view its corresponding test run results. Test Runs
  2. Click Rerun in the top-right corner to rerun the test plan by selecting the appropriate rerun options. Rerun
NOTE:
  1. Each run ID has a maximum rerun limit of 10. We recommend using reruns wisely. Rerun Limit
  2. Once you click Rerun, you'll see the following options.

    • All Test Cases: This will rerun all the test cases in the selected run.
    • All Failed Test Cases: This will rerun all the failed test cases in the selected run.
    • Select Cases for Re-Run: This will allow you to select the test cases you want to rerun.
  3. Click Start execution to rerun the test plan.
  1. To compare the current rerun result with the previous result, click Compare Run. Compare Test Runs
  2. This opens the Rerun overlay, where you can view a detailed comparison at all levels. Rerun Overlay

Overview of Tests in Run Results

  1. The Run Overview section of the Run Results page is dynamic and provides a summary of tests at all levels for the selected run. Run Overview
  2. This section displays the Last Run, Test Plan Settings, and Accessibility Test Overview. Run Overview Section
  3. Click View Runs to view all runs, More Settings to access additional settings, and View Report to check the Accessibility Testing Report. View Overlay Components

Exporting the Test Reports

  1. Click the Export icon and select the desired download format from the dropdown menu. Export Run Results
  2. For PDF format, the Export PDF dialog appears. Select the appropriate options and click Export. Export PDF
  3. For JUnit format, the report is downloaded instantly as an XML file.
  4. For XLSX format, a downloadable link of the report is sent to your email.

Available Shortcuts in Run Results

For Mac:

  • Option + C: View results at the test case level
  • Option + S: View results at the test suite level
  • Option + M: View results at the test machine level
  • Option + H: Open/close run history
  • Option + F: Open filters
  • Option + O: Open/close run overview

For Windows:

  • Alt + C: View results at the test case level
  • Alt + S: View results at the test suite level
  • Alt + M: View results at the test machine level
  • Alt + H: Open/close run history
  • Alt + F: Open filters
  • Alt + O: Open/close run overview