From Flaky to Flawless : How a Global Media App Scaled Mobile Automation with Testsigma
Overview
A leading media company’s mobile division is responsible for delivering a top-notch news app experience to millions of users across iOS and Android. With a compact QA team of two testers supporting a fast-moving dev team, they needed a powerful yet flexible test automation platform that could keep up with their pace without adding engineering overhead.
The Starting Point: Scaling Challenges with a Small Team
Before adopting Testsigma, the team relied heavily on manual testing and legacy Selenium scripts. But as the product matured and user expectations rose, their old approach became unsustainable:
- Tests were flaky, often failing for UI reasons unrelated to bugs
- Test maintenance drained 1–2 hours of every QA day
- Regression cycles took hours to complete
With just two QA professionals supporting a growing mobile dev team, the pressure was on to automate efficiently and maintain quality.
Why Testsigma?
The transition to Testsigma was driven by a few core needs:
- Ease of use: A no-code platform that allowed testers to create, manage, and execute tests without deep programming knowledge
- Mobile Testing Support: Robust support for native mobile apps on both iOS and Android
- Self-healing and AI features: Tools to eliminate flakiness and reduce daily test maintenance
- Scalability: A framework that could grow with them, from small suites to full regression pipelines
The Adoption Journey
Both testers joined after Testsigma was already in use. But despite not being involved in the initial vendor evaluation, they quickly became champions of the platform.
- Learning Curve: They were up and running with Testsigma in under a week
- Test Suite Size: They now run 16 test suites each for iOS and Android
- Test Creation Speed: A simple login test now takes 5 minutes with Copilot, compared to 20 minutes manually
- Maintenance: Flaky test debugging time dropped from many hours per day to about 1 hour
Key Features That Made a Difference
Self-Healing
- Helped reduce test flakiness significantly
- Previously unreliable tests now pass consistently
- Still monitored closely to avoid false positives
Copilot for codeless Test Creation
- Speeds up test writing for both simple and complex workflows
- Especially helpful for onboarding new QA engineers
Test Suite Separation
- Run targeted test suites (e.g., login, payments, onboarding)
- Avoids bloated test plans, improving feedback cycles
Developer Collaboration
- Share failure history and visual logs with devs and designers
- Helps isolate bugs faster and improves issue resolution time
Quality as a Culture Shift
Testsigma didn’t just change the tools the QA team used, it changed the culture of quality at the company.
- Developers trust Testsigma test reports to verify fixes.
- QA is more proactive in catching issues before they reach users.
- Cross-team collaboration has improved with shared dashboards, screenshots, and historical data.
Customer Support That Stands Out
Despite being a global team, the QA engineers have always felt supported by Testsigma’s customer success team.
Final Word
Testsigma has helped this global media company transform from a reactive, flaky test setup into a streamlined, automated, and confident QA practice, without increasing team size.
We inherited Testsigma when we joined, and we’re glad we did. It’s made our testing not only faster but also more reliable.
QA Engineer, Global Media Company
