- collaboration
- Invite Team Members
- Assign Projects
- Users & Role Management
- Review Management [Test Cases]
- Review Management [Elements]
- Execution Controls
- test cases
- Test Cases
- Test Case List Actions
- Import and Export Test Cases
- Import Test Project Test Cases
- Importing Postman Collections and Environments
- Test cases for Desktop Windows
- Update Test Case result in a Test Plan
- Test cases for Mobile Web Application
- Test Step Types
- Type: Natural Language
- Type: REST API
- Type: Step Group
- Type: For Loop
- Type: While Loop
- Type: Block
- Type: If Condition
- Nested Step Groups
- Create Test Steps
- Create Test Steps Using Simple English
- Test Step Settings
- Test Step Options
- Reuse Elements
- Test Step Reordering
- Bulk Actions
- Add Steps Before & After
- Web Applications
- Test Step Actions
- Test Step Settings
- Test Data in Steps
- Add Steps Manually
- Reuse Elements
- Update Elements
- Create an Element
- Reorder Test Steps
- Bulk Actions
- Add Steps Before & After
- Record steps anywhere in a Test Case
- Image Injection
- Cross-application testing
- Test Data Types
- Raw
- Parameter
- Runtime
- Random
- Data Generator
- Phone Number
- Mail Box
- Environment
- Concat Test Data
- Create Test Data [Parameter]
- Update Test Data Profile
- Updating Value in TDP
- Import TDP
- Bulk Deletion of a Test Data Profile
- Create Test Data [Environment]
- Elements (Objects)
- Web Applications
- Record Multiple Elements
- Record Single Element
- Create Elements
- Supported Locator Types
- Formulating Elements
- Shadow DOM Elements
- Verifying elements in Chrome DevTools
- Handling iframe Elements?
- Dynamic Locators using Parameter
- Dynamic Locators using Runtime
- Using Environment Test Data for Dynamic locators
- Import/Export Elements
- AI Enabled Auto-Healing
- test step recorder
- Install Chrome Extension
- Install Firefox Extension
- Install Edge Extension
- Exclude Attributes/Classes
- test plans
- Add, Edit, Delete Test Machines
- Add, Edit, Delete Test Suites
- Schedule Test Plans
- Run Test Suites In Parallel
- Cross Browser Testing
- Distributed Testing
- Headless Testing
- Test Lab Types
- Disabling Test Cases in Test Plans
- AfterTest Case
- Post Plan Hook
- AfterTest Suite
- Email Configuration in Test Plan
- Execute Partial Test Plans via API
- Ad-hoc Run
- Test Plan Executions
- Dry Runs on Local Devices
- Run Tests on Vendor Platforms
- Run Test Plans on Local Devices
- Test Locally Hosted Applications
- Debug Test Case Failures
- Parallel and Allowed queues
- debugging
- Debug results on local devices (Web applications)
- Debug Results on Local Devices
- Launch Debugger in the Same Window
- Testsigma Agent
- Pre-requisites
- Setup: Windows, Mac, Linux
- Setup: Android Local Devices
- Setting up iOS Local Devices
- Update Agent Manually
- Update Drivers Manually
- Delete Corrupted Agent
- Triggering Tests on Local Devices
- troubleshooting
- Agent - Startup and Registration Errors
- Fetching Agent logs
- Upgrade Testsigma Agent Automatically
- Testsigma Agent - FAQs
- continuous integration
- Test Plan Details
- REST API(Generic)
- Jenkins
- Azure DevOps
- AWS DevOps
- AWS Lambda
- Circle CI
- Bamboo CI
- Travis CI
- CodeShip CI
- Shell Script(Generic)
- Bitrise CI
- GitHub CICD
- Bitbucket CICD
- GitLab CI/CD
- desired capabilities
- Most Common Desired Capabilities
- Browser Console Debug Logs
- Geolocation Emulation
- Bypass Unsafe Download Prompt
- Geolocation for Chrome & Firefox
- Custom User Profile in Chrome
- Emulate Mobile Devices (Chrome)
- Add Chrome Extension
- Network Throttling
- Network Logs
- Biometric Authentication
- Enable App Resigning in iOS
- Enable Capturing Screenshots (Android & iOS)
- Configure Android WebViews
- Incognito/Private mode
- Set Google Play Store Credentials
- addons
- What is an Addon?
- Addons Community Marketplace
- Install Community Addon
- Prerequisites(Create/Update Addon)
- Create an Addon
- Update Addon
- Addon Types
- Create a Post Plan Hook add-on in Testsigma
- Create OCR Text Extraction Addon
- configuration
- API Keys
- Security(SSO)
- Setting Up Google Single Sign-On(SSO) Login in Testsigma
- Setting Up Okta Single Sign-On Integration with SAML Login in Testsigma
- Setting up SAML-based SSO login for Testsigma in Azure
- iOS Settings
- Creating WDA File for iOS App Testing
- uploads
- Upload Files
- Upload Android and iOS Apps
- How to generate mobile builds for Android/iOS applications?
- Testsigma REST APIs
- Environments
- Elements
- Test Plans
- Upload Files
- Get Project wide information
- Upload and update test data profile
- Trigger Multiple Test Plans
- Trigger Test Plan remotely and wait until Completion
- Run the same Test Plan multiple times in Parallel
- Schedule, Update and Delete a test plan using API
- Update Test Case results using API
- Create and update values of Test Data Profile using REST API
- Rerun Test Cases from Run Results using API
- open source dev environment setup
- macOS and IntelliJ Community Edition
- macOS and IntelliJ Ultimate Edition
- Windows and IntelliJ Ultimate Edition
- Setup Dev Environment [Addons]
- NLPs
- Unable to retrieve value stored in text element
- Unable to capture dropdown element
- Unable to Select Radiobutton
- Unable to Click Checkbox
- setup
- Server Docker Deployment Errors
- Secured Business Application Support
- Troubleshooting Restricted Access to Testsigma
- Why mobile device not displayed in Testsigma Mobile Test Recorder?
- Unable to create new test session due to unexpected error
- web apps
- URL not accessible
- Test Queued for a Long Time
- Issues with UI Identifiers
- Missing Elements in the Recorder
- mobile apps
- Failed to Start Mobile Test Recorder
- Troubleshooting “Failed to perform action Mobile Test Recorder” error
- Test Execution State is Queued for a Long Time
- Mobile app keeps stopping after successful launch
- More pre-requisite settings
- Unable to start WDA Process on iPhone
- Most Common causes for Click/Tap NLP failure
- on premise setup
- On-Premise Setup Prerequisites
- On-Premise Setup with Docker-compose File
- Post-Installation Checklist for On-Premise Setup
- Install Docker on an Unix OS in Azure Infrastructure
- SMTP Configuration in Testsigma
- Configure Custom Domains
Test Suites
Organise your test cases into test suites based on common functionalities or scenarios to manage and execute them effectively. Test suites will help you in executing and reporting the test plan status. You can add a test case to multiple test suites. This document will provide an overview and guidelines to create, edit, delete, and list test suites in Testsigma.
Prerequisites
Ensure that you create Test Cases in the Same Project before you can manage test suites in Testsigma.
Listing Test Suites
On the Test Suites List page, you will have the below options:
- Navigate to Test Suites in the left-side navbar.
- You can easily manage test suites on the Test Suites list page by sorting, filtering, or searching. The page displays test suites with titles, types, creation dates, creators, and statuses.
- Click Create Test Suite in the top right corner of the screen.
Creating a Test Suite
- Navigate to Test Suites in the left-side navbar. Click the Create Test Suite button in the top right corner of the Test Suites List page. Provide below details to Create Test Suite:
- Name(Required): Enter the title of the Test Suite in the Name field on the Create Test Suite page.
- Description: You can enable the toggle switch for the Description and provide a brief description explaining the test suite's purpose and scope. This will help your team members understand the objectives of the test suite.
- Pre-Requisite: Specify any Pre-Requisite for executing the test suite, such as specific test data, system configurations, or test environment setup.
- Label: You can assign a Label to the test suite. This will allow easier management of multiple test suites, as labels can be used for categorisation and filtering.
- Add/Remove Test Cases: Click the Add/Remove Test Cases button to add or remove test cases from the Test Suite. An Add/Remove Test Case overlay will appear, allowing you to select test cases from the Available Test Case list by checking the box next to them or clicking the + icon to select individual test cases.
- Add to Suite: Click the >> icon to move the desired test cases from Available Test Case to Selected for Test Suite. You can drag and drop the test cases to change their order in the Test Suite. Finally, add the selected test cases to the Test Suite by clicking the Add to Suite button. To remove test cases from the Test Suite, select them from Selected Test Cases and click the << icon.
-
After Test Suite: Enable the AfterTest Suite feature toggle switch, which enables you to define actions or test cases to execute after completing all test cases within the suite. You can use this feature to perform clean-up or post-test activities.
- When to execute After Test Suite - Once After All Test Cases: Select this option to execute the actions or test cases within the After Test Suite section only once after all the test cases have completed execution.
- When to execute After Test Suite - For Every Test Case: Select this option to execute the actions or test cases within the After Test Suite section for every individual test case within the suite after each test case is executed.
- If After Test Suite fails - Fail the test suite: Choose this option to mark the test suite as failed during execution if any of the actions or test cases within the After Test Suite section fails.
- If After Test Suite fails - Show the test suite result: Select this option to display the test suite result even if any of the actions or test cases within the After Test Suite section fail during execution.
- Add After Suite Test Cases: You can add specific test cases within the After Test Suite section that will execute after completing all the other test cases in the suite.
Carefully consider the order and dependencies between test cases when defining the After Test Suite section to ensure effectiveness and that it does not impact the subsequent test cases or cause environmental conflicts.
Editing a Test Suite
- Navigate to Test Suites in the left-side navbar.
-
You can edit the test case using any of the following methods:
- Click on the ellipsis icon for the Test Suite you want to edit from the Test Suite List page, and select Edit from the drop-down menu.
- Click the Test Suite you want to edit and open the Test Suite Details Page.
- You can view Test Cases and Test Plans linked to your Test Suite on the Test Suites Details page.
- Click the Add/Remove Test Cases button in the top right corner of the Test Suite details page. An Add/Remove Test Case overlay will appear, allowing you to select test cases from the Available Test Case list by checking the box next to them or clicking the + icon to select individual test cases.
- Click Test Suite Settings in the right-side navbar, and follow steps 4 & 8 in the Creating a Test Suite section to add Pre-Requisite, After Test Suite for the Test Suite.
- Click Test Suite Info in the right-side navbar. You can update the Test Suite Name, Type and Description from there and view information about the Test Suite's creation and last update.
- Click Activity in the right-side navbar and view the History and Comments of test suite.
Deleting a Test Suite
- Navigate to Test Suites in the left-side navbar.
-
You can delete the test suite using any of the following methods:
- Click on the ellipsis icon for the Test Suite you want to delete from the Test Suite List page, and select Delete from the drop-down menu to remove the test suite.
-
Click the Test Suite you want to delete and open the Test Suite Details Page. Then, click the Delete Button in the screen's top right corner.
NOTE:Note: If you attempt to delete a Test Suite linked to a Test Plan, the application will display a warning and prevent the deletion. You must remove the Test Suite from the associated Test Plans before trying to delete it again.
- A Delete Confirmation pop-up will appear. To delete the Test Suite, you need to confirm the deletion by entering DELETE and then clicking on I understand, delete this Test Suite.
If you delete the Test Suite, you will lose all Run reports and Run configuration associated with it.