Analyzer Agent in Testsigma

The Analyzer Agent analyzes a failed test step and returns the error type, the root cause, the visual evidence captured during execution, and a set of suggestions. Apply a suggestion to update the step, or report the failure to your bug tracking tool, without leaving the results page.

Prerequisites

Before you begin, ensure that:

1. At least one test plan or dry run has been executed.
2. The run contains a failed test step.

Steps to Analyze Step Failures

1. From the left navigation bar, click Run Results.
2. Select the run that contains failed test steps.
3. Click the test case with failures.

4. On the Test Case Results page, select the failed step.

   The ANALYZER VERDICT section on the step already shows a short analysis of the failure. Use the Analyzer Agent for suggested fixes you can apply, follow-up questions, and bug reports. For details on the verdict, refer to the documentation on debugging test case failures.

5. Click Analyze with Agent in the action bar at the bottom of the page.

   The Analyzer with Atto panel opens and reads "Analyzing step failure..." while it runs.

6. Review the analysis.

   Section	What it shows
   Error Type	The failure type identified during execution
   Root Cause	Why the step failed
   Visual Evidence	Screenshots At the time of Recording and At the time of Execution. Only the execution screenshot appears when no recording screenshot exists.
   Suggestions	Numbered fixes you can apply to the step

Apply Fix Using Analyzer Agent

1. In the Suggestions list, select one suggestion. Apply Fix stays disabled until you select one.
2. Click Apply Fix. Atto returns an Add/Update Step card.
3. Click Add/Update Step. In the step list, the updated step appears as an extra row below the original steps, marked with the Analyzer icon. The current result still shows the original step as failed, because the change applies from the next run.

4. Re-run the test to confirm the fix.

   • For a test plan run, click the run number in the breadcrumb to return to Run Results, then click Rerun.
   • For a dry run, click Re-Run in the page header.

   The next run uses the updated step.

Report a Bug Using Analyzer Agent

1. In the Analyzer with Atto panel, click Report Bug. The QA Agent panel opens.
2. Select your bug tracking tool from the dropdown at the top right.

3. Do one of the following:

   • To raise a new issue, open the Create New tab, review the prefilled details, and click Report Bug.
   • To attach the failure to an issue that already exists, open the Link To Issue tab, search for the issue, and click Link To Ticket.

Additional Information

If the tool returns no projects, check that the credentials configured for it have access to the projects you expect. For Jira, the panel reads "For given JIRA Credentials, the projects list is empty. Please make sure it has the right access to required projects on JIRA".