Freshworks scales sanity test automation from zero to 100% with Testsigma

Taking complexity out of mobile test automation

To achieve continuous delivery for new features in their web offerings, Freshworks had automated their smoke and regression testing for their web releases. Anand wanted to replicate the model in mobile engineering.“But there are not many frameworks or tools that have the ability to test real-time scenarios for mobile apps,” Anand says.

“Native frameworks have certain limitations. Hybrid frameworks (like Appium) have consistency issues, where the same test case would pass or fail randomly. It was also difficult to identify elements while navigating from one app to another with Appium framework,” he explains.

Freshworks trialed and adopted Testsigma for its:

• Mobile inspector

  Testsigma's hybrid mobile inspector dynamically locates elements and has a model in place where call related scenarios were feasible to implement. This reduced the time Freshworks spent automating new test scenarios for each sprint.

  
  “Complex test cases that were difficult to automate using our current native and hybrid frameworks now take 80% less time with Testsigma,” Anand said.

• Zero setup time

  Freshworks used Testsigma’s integrated mobile agent package—a feature that automatically installs and sets up the IDE, SDK libraries and drivers needed for mobile test automation. This allowed the team to start automating their complex mobile tests immediately.

• Dynamic locator and AI

  With an AI and a dynamic locator strategy, Testsigma eliminated false positives (and negatives) of flaky Appium tests, providing reliable feedback to development teams and preserving developer trust in automated tests at Freshworks.

• App context support

  Testing hybrid apps can lead to reliability issues, especially when trying to navigate outside the app context view. Testsigma supports it, making mobile testing a lot more durable and consistent for Freshworks.

Higher automation coverage leads to better focus on quality engineering

Freshworks ramped up their automated smoke testing to achieve 100% coverage within 3 months of adopting Testsigma. Developer commits trigger their smoke tests to give fast, reliable feedback to the developers.

Preethi Ganesh, Senior Quality Engineer at Freshworks, says, “We were now able to access and test an application outside the app context view. We had support for both local and cloud executions, for Android and iOS devices. We had seamless CI/CD integrations that helped us have a more cohesive continuous delivery pipeline.”

By replacing their former mobile QA toolchain with Testsigma, Freshworks freed its Developers and Test Engineers to focus on release quality and further streamlining the quality engineering processes. “FW engineers now have more time to focus on Test design and ensuring that new features are working reliably”, Anand said.