Analyzer Agent in Testsigma


The Analyzer Agent in Testsigma analyzes failed test steps and provides actionable insights. It identifies the error type, determines the root cause, provides visual evidence captured during execution, and suggests possible fixes. This article discusses how to analyze step failures and take action using the Analyzer Agent.


Prerequisites

Before you begin, ensure that:

  1. At least one test plan has been executed.
  2. The test plan contains failed test cases.

Steps to Analyze Step Failures

  1. From the left navigation bar, click Run Results. Run Results
  2. Select the test plan that contains failed test steps.
  3. Open the test case with failures and select the failed test step.
  4. In the Step Details panel, click Analyze with Agent. This will open the Analyzer Agent overlay. Analyze with Agent
  5. Wait for the Analyzer Agent to complete the analysis.
  6. Review the analysis in Analyzer Agent overlay, which displays: Analysis

    • Error Type: Displays the category of failure identified during test execution.
    • Root Cause: Describes the underlying reason for the failure based on execution analysis.
    • Visual Evidence: Displays screenshots captured during recording and execution to support failure analysis.
    • Suggested Fixes: Displays recommended actions to resolve the failed test step.

Apply Fix Using Analyzer Agent

  1. From the Analyzer Agent overlay, select the fix you want to apply. Select Fix
  2. Click Apply Fix. Apply Fix
  3. Wait for the Analyzer Agent to generate the required fix.
  4. Click Add Step, Update Step, or Update Step Settings, as suggested by the Analyzer Agent. Update as per suggestion
  5. Verify that the changes are applied to the test step. Verify the changes
  6. Rerun the test plan to validate the fix.

Report a Bug Using Analyzer Agent

  1. From the Analyzer Agent overlay, click Report Bug. Report Bug
  2. Select the bug tracking application from QA Agent overlay. Select Bug Tracking App
  3. Review the prefilled bug details, such as Team, Project, and Title. Review Details

    The fields displayed vary based on the selected bug tracking tool.

  4. Click Report Bug. Report
NOTE:

To link the failure to an existing issue, click Link to Issue, search for the issue in the selected bug tracking application, and then click Link to Ticket.