
Revolutionizing Quality Assurance for Singapore’s Largest Retail Operator with Testsigma
Reduced Change Failure Rate (CFR) by 50%, prevented 50 major incidents in 2024, and achieved up to 83% faster testing cycles with Testsigma.
Reduced Failure Rate
Faster Testing Cycles
Application Types
Android, iOS, Web,
and API
Industry
Software Testing
Headquarters
Singapore
About the Organization
As Singapore’s largest retail operator, this enterprise oversees key sectors including Food, Health, Education, and Insurance, managing a diverse digital ecosystem comprising mobile apps, websites, and internal tools. Their quality engineering team supports over 4 tribes and 11 squads, maintaining approximately 200 repositories.
The Test Automation Challenges Faced
Before Testsigma, the company’s quality engineering team faced significant challenges in managing their complex testing requirements. Supporting multiple platforms required different testing tools and frameworks, leading to fragmented processes and increased maintenance overhead. Manual testing was time-consuming and resource-intensive, while automation coverage remained limited across different testing levels.
Before adopting Testsigma, the team encountered:
- Platform Fragmentation : Managing separate tools for Android, iOS, and web testing increased complexity.
- Manual Testing Bottlenecks : Resource-intensive processes led to delayed feedback and slower releases.
- Limited Automation Coverage : Critical areas like crash testing and regression testing were underserved.
- High Change Failure Rate (CFR) : A 3%+ CFR impacted deployment confidence.
They needed a comprehensive testing platform enabling test automation across multiple applications.
Implementing Testsigma to Overcome the QA Challenges
The organization implemented Testsigma as their primary automation testing solution, leveraging its comprehensive features:
- A no-code test automation platform supporting Android, iOS, Web, and API testing
- Integration with CI/CD tools, Gchat, XRAY, JIRA, and Bitbucket
- 40 parallel device testing capability
- Visual testing and Design QA capabilities
Testsigma's implementation has been transformative for our quality assurance processes. The platform's ability to support multiple testing types while reducing execution time has significantly improved our deployment confidence.
Quality Engineering Lead
Coverage Implementation and Efficiency Improvements
By adopting Testsigma, the organization achieved extensive automation coverage across critical applications, including mobile apps, websites, and internal tools, ensuring higher quality and efficiency. Testsigma’s no-code platform enabled seamless test creation for Android, iOS, web, and APIs, while supporting 40 parallel device tests. This drastically reduced testing times, with testing cycles being up to 83% faster compared to traditional solutions. Enhanced visual testing and design QA further streamlined processes, providing the team with comprehensive insights and improved deployment confidence.
Key Outcomes
The implementation of Testsigma delivered remarkable results:
- Reduced Change Failure Rate by 50%
- Prevented 50 major incidents in the UAT environment
- Saved approximately 400 hours in 2024 through incident prevention
- Increased deployment frequency month-over-month
The reduction in testing time and prevention of major incidents has not only improved our efficiency but also significantly enhanced our team's confidence in deployments. Testsigma has become an integral part of our quality assurance strategy.
DevOps Manager
The Future Looks Promising
- Expanding test coverage across more applications and systems.
- Adapting the framework for upcoming projects and initiatives.
- Enhancing quality metrics and continuously reducing CFR.
- Supporting growth as the company scales development and adds repositories.
Conclusion
Testsigma has proven to be a transformative solution for their quality engineering team. The platform’s comprehensive features, combined with its ability to support multiple platforms and testing types, have significantly improved testing efficiency and reduced incidents. With a successful implementation that has already prevented 50 major incidents and saved hundreds of hours in testing time, the organization is well-positioned to continue scaling its quality assurance processes while maintaining high standards of software delivery.