DevOps Testing: Concepts, Best Practices & Tools

What are the Software Quality Attributes?

Mainframe Testing How to Do, Challenges & Best Practices

Mainframe Testing | How to Do, Challenges & Best Practices


<p class="wp-block-paragraph">We&#8217;re excited to bring you some amazing new features in this month&#8217;s release. From desktop application recording to on-demand partial test runs and seamless integrations with popular CI/CD tools, we are introducing new features and capabilities to enhance your test automation and streamline your QA processes.&nbsp;</p>



<p class="wp-block-paragraph">Let&#8217;s dive in:</p>



<p class="wp-block-paragraph">1. <strong>Rapidly automate Windows desktop app testing with our Desktop Recorder:</strong> Our new desktop recorder allows you to record and generate test cases for Windows apps and effortlessly add new UI elements to your Windows projects. </p>



<p class="wp-block-paragraph">2. <strong>Test hotfixes quickly with partial test plan execution: </strong>No need to re-run entire test plans after hotfixes. With Testsigma, you can now execute partial runs of test plans or test plan subsets for when you need quick results for that bug fix on release days.</p>



<p class="wp-block-paragraph">3. <strong>Build automation made easy with Jenkins Integration</strong>: Integrate Testsigma into your CI/CD pipeline for smooth build automation and continuous testing. Our Jenkins integration allows you to run tests and get results at every merge without leaving your pipeline.&nbsp;</p>



<p class="wp-block-paragraph">4. <strong>Unify your test reporting with Azure DevOps Integration</strong>: Report and maintain your tests in a single place with Azure DevOps integration. Access all your test reports and results from your Azure DevOps dashboard. Push bugs, epics, tasks, or stories directly from Testsigma while testing, streamlining your workflow.</p>



<p class="wp-block-paragraph">Stay tuned for more updates from our Product Team. And if you haven&#8217;t yet, <a href="https://testsigma.com/signup">try Testsigma for free</a> and see the difference it makes to your SDLC and release quality.</p>



<div class="cta-banner-v2">
<div class="title-with-description ">
<p class="title"></p>
<p class="description">Automate your tests for Web, Mobile, Desktop and APIs on Cloud with Testsigma. No setup required.</p>
</div>
<a href="https://testsigma.com/signup" target="_blank" class="cta-btn-v1" rel="noopener">Try for free</a>
</div>


July ’23 Product Digest: The latest on Testsigma

What Are the Ultimate Goals of Software Testing

Objectives of Software Testing: Key Goals & Best Practices

Yashaswi Singh

What is CI CD testing? How Does It Work?

How to Find Bugs in Application/ Website?

Dynamic Testing What it is ,Types ,& Step by Step Process

What is Dynamic testing? Tools, Techniques & Examples


<p class="wp-block-paragraph">Every tester spends excessive time understanding the application and its specifications to test it. But imagine the wastage of time and cost for testers when the software build, which developers pass for testing, keeps failing every test. All of this is possible to avoid by using Build Verification Testing or BVT.</p>



<p class="wp-block-paragraph">The process consists of individually checking the software builds to ensure they are going for testing only after the build is stable and ready.</p>



<p class="wp-block-paragraph">Let’s learn about BVT and its process.</p>



<div id="toc_container" class="no_bullets"><p class="toc_title">Table Of Contents</p><ul class="toc_list"><li><a href="#What_Is_Build_Verification_Testing"><span class="toc_number toc_depth_1">1</span> What Is Build Verification Testing?</a></li><li><a href="#Why_Build_Verification_Testing"><span class="toc_number toc_depth_1">2</span> Why Build Verification Testing?</a></li><li><a href="#Principles_of_BVT"><span class="toc_number toc_depth_1">3</span> Principles of BVT</a></li><li><a href="#The_Process_of_BVT_Testing"><span class="toc_number toc_depth_1">4</span> The Process of BVT Testing</a></li><li><a href="#Why_Automation_Is_Essential_For_Build_Verification_Testing"><span class="toc_number toc_depth_1">5</span> Why Automation Is Essential For Build Verification Testing?</a></li><li><a href="#Some_Benefits_Of_BVT_Testing"><span class="toc_number toc_depth_1">6</span> Some Benefits Of BVT Testing</a></li><li><a href="#Tips_For_Selecting_Build_Verification_Tests"><span class="toc_number toc_depth_1">7</span> Tips For Selecting Build Verification Tests</a></li><li><a href="#Build_Verification_Testing_Checklist"><span class="toc_number toc_depth_1">8</span> Build Verification Testing Checklist</a></li><li><a href="#Conclusion"><span class="toc_number toc_depth_1">9</span> Conclusion</a></li><li><a href="#Frequently_Asked_Questions"><span class="toc_number toc_depth_1">10</span> Frequently Asked Questions</a><ul><li><a href="#Who_performs_BVT"><span class="toc_number toc_depth_2">10.1</span> Who performs BVT?</a></li><li><a href="#What_is_the_difference_between_build_verification_testing_and_build_acceptance_testing"><span class="toc_number toc_depth_2">10.2</span> What is the difference between build verification testing and build acceptance testing?</a></li><li><a href="#What_is_an_example_of_BVT_testing"><span class="toc_number toc_depth_2">10.3</span> What is an example of BVT testing?</a></li></ul></li></ul></div>
<h2 class="wp-block-heading" id="h-what-is-build-verification-testing"><span id="What_Is_Build_Verification_Testing">What Is Build Verification Testing?</span></h2>



<p class="wp-block-paragraph">Build verification testing, or BVT, is a set of tests run on every new build to check if the build is stable and ready for further testing. It consists of test cases that validate the core features of the software build. Any build that fails BVT is rejected and goes back to the developers for resolution. Later, it comes back after a fix, and<a href="https://testsigma.com/regression-testing" target="_blank" rel="noreferrer noopener"> regression testing</a> happens on it with the same set of test cases.</p>



<p class="wp-block-paragraph">The idea is to save time and resources by eliminating the back-and-forth between the build and testing phases. And this testing proves highly useful when there are multiple inter-dependent builds. It is also called<a href="https://testsigma.com/blog/smoke-testing/"> Smoke testing</a> and mainly checks for build verification and acceptance.</p>



<p class="wp-block-paragraph">An example of BVT is verifying the basic functions of a registration form, such as page rendering and successful registration upon providing the correct credentials. Any build that functions according to its expected behavior passes the BVT testing and moves ahead for further testing.</p>



<h2 class="wp-block-heading" id="h-why-build-verification-testing"><span id="Why_Build_Verification_Testing">Why Build Verification Testing?</span></h2>



<p class="wp-block-paragraph">BVT aims to ensure that the system or the build exhibits the expected behavior as defined in specifications documents. Some of the reasons why you should perform build verification testing are as follows:</p>



<ul class="wp-block-list"><li><strong>Early detection of issues:</strong> BVT is conducted in the early stages of development or after making significant changes to a system. By verifying the expected behavior, you identify bugs and resolve them early on, reducing the likelihood of more severe problems later in the development cycle.</li><li><strong>Risk mitigation:</strong> BVT helps mitigate risks associated with the system&#8217;s behavior. It identifies potential risks such as security vulnerabilities, data loss, or incorrect functionality by validating and addressing the expected behavior before the system gets deployed to production.</li><li><strong>Verification of requirements:</strong> BVT ensures that the system meets the specified requirements or specifications. It helps validate that the system performs the intended functions and behaves correctly.</li><li><strong>Confidence in system functionality:</strong> Performing BVT assures that the system is functioning properly and helps build confidence among stakeholders, including developers, testers, project managers, and end-users, about its quality.</li><li><strong>Efficiency and time savings:</strong> By conducting BVT, any deviations from the expected behavior can be identified promptly. This allows developers to make the necessary corrections early on, reducing the overall time and effort required for testing and debugging.</li><li><strong>Customer satisfaction:</strong> BVT ensures that the system meets the expected behavior, which in turn increases the likelihood of customer satisfaction as they receive a reliable and functional product.</li></ul>



<h2 class="wp-block-heading" id="h-principles-of-bvt"><span id="Principles_of_BVT">Principles of BVT</span></h2>



<p class="wp-block-paragraph">Primarily, the principles of BVT are developing a stable build, verifying the build&#8217;s health, and moving toward automation. These three points basically cover multiple aspects of BVT, such as:</p>



<ul class="wp-block-list"><li><strong>Early Testing:</strong> BVT should be performed as early as possible in the development cycle to catch issues and bugs at an early stage. It helps identify and rectify problems before they become complex and costly to fix.</li><li><strong>Focus on Critical Functionality:</strong> BVT prioritizes testing the critical functionalities of the system or software component that significantly impact the overall build performance or user experience.</li><li><strong>Test End-to-End Scenarios:</strong> BVT should include test scenarios that cover the end-to-end functionality of the system. Such an approach is useful in verifying the interaction between different components of the system.</li><li><strong>Clear and Measurable Criteria:</strong> The testing should have clear and measurable criteria for determining each test case&#8217;s expected behavior and success measure.</li><li><strong>Reproducibility:</strong> BVT should be reproducible, with the tests being the ability to execute multiple times with the same inputs and produce the same results. Reproducibility is important for debugging and investigating issues that arise during testing.</li><li><strong>Documentation:</strong> You must be able to well-document the BVT process, including <a href="https://en.wikipedia.org/wiki/Test_plan" target="_blank" rel="noreferrer noopener">test plans</a>, test cases, and test results. This helps in maintaining a record of the testing process, facilitates collaboration among team members, and provides a reference for future testing and maintenance activities.</li><li><strong>Automation:</strong> Whenever feasible, leverage automation tools and frameworks to streamline the testing process. Automation helps increase efficiency, reduce human errors, and enable repeated execution of tests, allowing for faster feedback on the system&#8217;s behavior.</li></ul>



<h2 class="wp-block-heading" id="h-the-process-of-bvt-testing"><span id="The_Process_of_BVT_Testing">The Process of BVT Testing</span></h2>



<p class="wp-block-paragraph">You know that BVT consists of certain core functionality tests to check if the software build is ready for testing. Now, let’s see how the BVT process happens and what steps are involved in it.</p>



<p class="wp-block-paragraph">Performing BVT is quite straightforward: run pre-defined, repetitive tests to see if the build is functioning as it is supposed to. And because the tests are redundant, automating your BVT process using automation tools is logical. Follow these steps to run BVT:</p>



<ul class="wp-block-list"><li>Select the right BVT tests from the already defined test cases.</li><li>Execute the test cases as part of your CI/CD pipeline.</li><li>Analyze and report the test results upon every run.</li><li>In case a BVT test fails, send it back to the developer, log the results, and reject the build.</li><li>Now, developers will work on the issue resolution based on your report and feedback.</li><li>They will send back a new build after fixing the problem, which will again go through BVT with the same set of tests.</li><li>If the build passes BVT, move it forward for testing; otherwise, reject it and send it back for further resolution.</li></ul>



<p class="wp-block-paragraph">These steps are general guidelines, and the actual implementation of BVT may vary based on the project&#8217;s specific needs, complexity, and context.</p>



<h2 class="wp-block-heading" id="h-why-automation-is-essential-for-build-verification-testing"><span id="Why_Automation_Is_Essential_For_Build_Verification_Testing">Why Automation Is Essential For Build Verification Testing?</span></h2>



<p class="wp-block-paragraph">BVT tests must be automated because automation makes testing extremely accessible and easy. And since these tests are run repeatedly to ensure the build is ready for the testing phase, automation also saves time and cost. The best way to approach BVT automation is to automate everything from start to end, including the build release process and the BVT results.</p>



<p class="wp-block-paragraph">Automation tools assist in running the tests. And because BVT focuses only on core functionalities, you can go for tools that offer simple yet effective ways to write and execute tests. Testsigma is one such automation tool that provides testers the ability to save and re-run test cases, which is an important part of the BVT process. Another advantage of using Testsigma for BVT is the tool’s feature allowing testers to create test cases in plain English and save them whenever. It further helps that the tool supports web, mobile, desktop and API testing broadening your testing horizons.</p>



<p class="wp-block-paragraph"><br><p><button class="btn bg-primary cta-btn" style="margin: auto"><a href="https://testsigma.com/signup" target="_blank" rel="noopener noreferrer" style="color:#fff">Automate your BVT tests, for web, mobile, desktop, and APIs, from the same place, with Testsigma</a></button></p><br></p>



<h2 class="wp-block-heading" id="h-some-benefits-of-bvt-testing"><span id="Some_Benefits_Of_BVT_Testing">Some Benefits Of BVT Testing</span></h2>



<p class="wp-block-paragraph">Behavioral Verification Testing (BVT) offers several benefits in the software development process. Some of the key benefits of BVT include:</p>



<ul class="wp-block-list"><li>Checks all major core functionalities before executing in-detail tests, thereby saving time and money</li><li>Detects potential bugs even before the testing phase starts</li><li>Helps mitigate risks associated with the behavior of the system</li><li>Ensures that the system adheres to the specified requirements or specifications</li><li>Instills confidence in the development team, testers, project managers, and stakeholders by thoroughly verifying the behavior of the system</li></ul>



<h2 class="wp-block-heading" id="h-tips-for-selecting-build-verification-tests"><span id="Tips_For_Selecting_Build_Verification_Tests">Tips For Selecting Build Verification Tests</span></h2>



<p class="wp-block-paragraph">Some tips you should keep in mind while selecting build verification tests are:</p>



<ul class="wp-block-list"><li>Choose all the test cases that cover the core and major functionalities of the software.</li><li>Select test cases that cover end-to-end scenarios of user interactions or system processes.</li><li>Include test cases that cover various input combinations, boundary values, error conditions, and exceptional scenarios.</li><li>Ensure to mention the right version details about the build in the tests.</li><li>Go for test cases that can be automated and executed within 30 minutes.</li><li>Add BVT tests as a part of your CI process.</li><li>Allocate more test cases to high-risk areas to verify and mitigate potential risks thoroughly.</li><li>Select the scalable tests that can be re-used with new additions and modifications of build functionalities.</li></ul>



<h2 class="wp-block-heading" id="h-build-verification-testing-checklist"><span id="Build_Verification_Testing_Checklist">Build Verification Testing Checklist</span></h2>



<p class="wp-block-paragraph">By now, you have a clear idea about BVT and its scope. And while you can start performing the tests, it is good to have a checklist ready to make sure no critical step goes missing. Follow the below list for running your BVT process.</p>



<ul class="wp-block-list"><li>Develop a BVT test plan outlining the objectives, scope, and test coverage.</li><li>Verify that all the test cases within BVT cover the major functionalities of the build.</li><li>Check if all the tests included in the final testing process are sufficient for build verification.</li><li>Define the entry and exit criteria and follow them strictly.</li><li>Identify and prioritize the test cases.</li><li>If feasible, try to automate all tests.</li><li>Provide detailed reporting of the bugs and rejected builds.</li><li>Follow a standard guideline when the build fails BVT and goes back to developers for a fix.</li><li>Ensure to properly follow the build pass criteria, i.e., do not even overlook any minute issue when it comes to qualifying the build as pass or fail.</li><li>Maintain the automation script with the right input values to re-run them for testing rejected builds after resolution.</li></ul>



<h2 class="wp-block-heading" id="h-conclusion"><span id="Conclusion">Conclusion</span></h2>



<p class="wp-block-paragraph">BVT is a test that is conducted before the detailed testing phase on every new software build. The goal of BVT is to check the core features of the build to see if it is stable and ready for testing. BVT prevents the failing of test cases when the testing on the build actually starts. Build owners work on incoming builds to identify the issues and reject or pass them based on the outcome. With BVT, we only aim to validate the basic functionality of the software rather than verifying all the possible edge cases.</p>



<p class="wp-block-paragraph">Most of the BVT test cases are automated as they need to be re-run to test new or existing builds that keep coming for testing. You can automate BVT test cases using tools that support writing and executing small, basic tests in record time with lesser resources. Testsigma is equipped with AI to assist testers in creating tests that can be saved, re-run, and written in plain English to perform the BVT process easily. The tool is popular for its accessible testing methods, including NLP-based scripting, data-driven testing, and reusable test groups, which are all required for BVT.</p>



<p class="wp-block-paragraph">We encourage you to explore Testsigma for all your testing requirements. Register for a<a href="https://testsigma.com/request-demo" target="_blank" rel="noreferrer noopener"> free demo</a> to learn more about the tool and how it will help you to create end-to-end tests 10x faster for web, mobile apps, &amp; APIs.</p>



<h2 class="wp-block-heading" id="h-frequently-asked-questions"><span id="Frequently_Asked_Questions">Frequently Asked Questions</span></h2>



<h3 class="wp-block-heading" id="h-who-performs-bvt"><span id="Who_performs_BVT">Who performs BVT?</span></h3>



<p class="wp-block-paragraph">Developers or testers can both perform BVT. Often, the person who executes and maintains BVT results is called the BVT owner and takes care of the testing process before rejecting or passing the build as per the outcome.</p>



<h3 class="wp-block-heading" id="h-what-is-the-difference-between-build-verification-testing-and-build-acceptance-testing"><span id="What_is_the_difference_between_build_verification_testing_and_build_acceptance_testing">What is the difference between build verification testing and build acceptance testing?</span></h3>



<p class="wp-block-paragraph">Build verification testing is also called build acceptance testing, which focuses on accepting the build for the detailed testing phase. Both terms are interchangeable in meaning.</p>



<h3 class="wp-block-heading" id="h-what-is-an-example-of-bvt-testing"><span id="What_is_an_example_of_BVT_testing">What is an example of BVT testing?</span></h3>



<p class="wp-block-paragraph">An example of BVT can be verifying the core functionality of an e-commerce application by signing in and adding products to a cart to buy. For a video/audio sharing app, it can be checking if the videos/audios are displaying and playing as intended. By definition, BVT does not include every edge case but only focuses on validating the primary feature of the build.</p>


Build Verification Testing (BVT Testing) - A Quick Guide