[Case Study] Driving test efficiency in healthcare

November 15, 2019

Company Overview

The company is a global healthcare company with over 80,000 employees. They are a Salesforce customer and primarily use Service Cloud. They use a combination of standard and custom Salesforce elements, including page layouts, Visualforce pages and the Salesforce Service Cloud Console.They came to Provar to improve their Service Cloud testing process.

 

The Challenge

The company found that manual Service Cloud testing after each new Salesforce release was a tedious task, consuming high cost and effort. With 135 test cases, the time taken to run the entire Service Cloud testing regression pack was approximately 108 hours: almost 3 weeks for a single tester.

It was also a challenge to catch regression defects effectively under changing requirements. A high number of defects had to be found and fixed for each patch release during regression. The demands of finding and fixing defects were drawing focus away from enhancements.

Overall, the company wanted to significantly reduce the cost and effort of their Service Cloud testing. They also wanted to improve the reliability of defect catching through regression testing.

 

The Solution

The company chose Provar in the hopes of bringing better ROI and efficiency to their Service Cloud testing.

Provar is an end-to-end test automation tool designed for Salesforce. Because Provar is tightly integrated with Salesforce, it provides a more efficient way to implement automation, intelligently locating Salesforce fields, objects and other key metadata. Minor changes to an environment become easier to accommodate, taking away the pain of maintenance and the difficulty of scaling.

Another strength of Provar is its ability to integrate easily with continuous integration systems such as Bamboo. This allowed the company to implement a true end-to-end Service Cloud testing solution bringing increased code coverage, automated deployments, autonomous build triggering and generation of a consolidated status report of test execution.

Aside from integrations, the company also adopted the simpler benefits of Provar, ranging from the easy creation of test cases through rapid automated creation of test data, test case execution, verification of test results through Provar’s inbuilt reporting capabilities, and easy maintenance for subsequent test case amendments.

Provar also gave the company total control over which test combinations should be triggered, be it one specific test, a group of tests or the entire test suite.

 

The Results

  • 6 HOURS
  • 94 FASTER
  • 2.6 FTE SAVED

 

After implementing an automated Service Cloud testing solution with Provar, the company was able to significantly decrease their Service Cloud testing time and effort.

Using Provar, the company has seen a decrease in regression testing time from 108 hours down to just 6 – an overall reduction of 94%. This allows them to verify system functionality after each Salesforce patch and major releases in a far shorter time span.

With Provar, the company can also identify all regression issues for a new release candidate on the first day of testing. This provides early visibility into important defects. It also gives the development team time to resolve the key issues at the very beginning of the iteration.

With many other test tools, the first days of testing are spent re-working the test scripts to fix the broken locators. Provar automatically suggests robust field locators which are resistant to breakage, and this dramatically reduces the need for rework.

This time saved also frees up developers to focus on company change requests, allowing continuous improvement of the Salesforce platform, higher confidence in and quality of software being provided to end users, and a significantly better return on investment overall.

 

Testimonial

During the whole period of our communication we received overwhelming support from Provar and this support was provided as fast as possible. The solutions were always optimal and covered the problem fully.

Another great thing about Provar is that their team can deliver enhancements quickly to meet various features of different projects. Provar provides us with perfect solutions which entirely cover the points we need.

Finally, if we consider the technical profit we gained from Provar, I would say that the tool helps us to avoid non-interesting and monotonous regression test work, and it also saves us time spent on regression testing and the resources needed.

 

Technical Solution

Environment management

Provar stores environment-specific details are stored centrally as Environment Variables and access them automatically when the tester chooses their environment. This means that test cases can be executed across mutliple environments in just a few clicks.

Cross-browser testing

Provar supports cross-browser testing simply and easily. Just select the browser and screen resolution in which the test has to run, and Provar will adapt the test to suit. This means that the same test case can be run in different browsers without any amendments needed to the test case.

Maintainability

Traditional test automation requires programming skills, and technical information such as field locators have to be hardcoded. With Provar, tests are built in an intuitive, point-and-click interface, and field locators are suggested automatically. Even complex Salesforce functionality such as Visualforce pages and Service Cloud console are supported through Provar’s tight metadata integration. Minor changes to these elements no longer cause unexpected breakages. This makes test cases more maintainable and less time-consuming.

Integration testing

Within the test scenarios it was important to ensure that all parameterization was tested within each PDF document generated by Salesforce. These were sent as attachments in emails and also embedded in certain Visualforce pages. Provar tested these with the Gmail connector and used regular expression APIs to check the values, making this process faster and simpler.

Coverage and reusability

The company was also pleased to note an increase in test case reusability and increased test coverage for both positive and negative scenarios.