[Case Study] Streamlined testing for telecoms

November 15, 2019

Company overview

The company is a multinational telecommunications corporation with over 200 million customers worldwide. It’s also a Salesforce Sales Cloud customer. The company’s Salesforce org combines standard and custom elements, including standard Salesforce objects and page layouts, as well as bespoke configuration and Visualforce development. Sales and marketing are the primary users of the Salesforce platform, and their processes cover lead conversion, opportunity management and forecasting. They came to Provar to improve their Sales Cloud testing process.

 

The challenge

With this company’s complex functional flows, manual Sales Cloud testing was a large overhead. Their 150 end-to-end test cases took 2 dedicated testers 2 weeks to complete each iteration.

The team wanted to reduce their manual Sales Cloud testing effort and better support their agile developments by running the whole test pack automatically on a regular basis.

The tests also needed to execute easily across multiple environments in line with their delivery lifecycle.

  • 150 TEST CASES
  • 160 HOURS
  • 4 FTE 

 

The solution

The company chose Provar to automate their Sales Cloud testing. Provar is an end-to-end test automation tool designed for Salesforce. Because Provar is tightly integrated with Salesforce, it provides a more efficient way to implement automation. Minor changes to an environment become easier to accommodate, taking away the pain of maintenance and the difficulty of scaling.

The company took on Provar’s 15 day quick start consulting package to help them design and develop their test cases. In this time, their in-house test team also completed Provar’s 3-day training course.

With Provar, the test cases they developed covered all major functionality across Accounts, Contacts, Leads, Opportunities, Campaigns, Chatter, Reports and Forecasting. They could validate their end-to-end workflow, as well as asserting calculated fields on the browser and checking validation rule error messages.

 

The results

  • 5 DAYS
  • 50 FASTER
  • 2 FTE SAVED

The company was able to deliver more than half of their regression scope with just 15 days of dedicated support through Provar’s quick start consulting package. Over 60% of this scope was completed by the company’s in-house testing team themselves, who had no previous experience of using Provar.

After this, the team was confident enough in the tool to deliver the remainder of the regression scope themselves with only light-touch support.

Ultimately the company was able to reduce their Sales Cloud testing time from 2 weeks to 5 days, a 50% reduction in regression testing time.

As the solution used many standard Salesforce page layouts, the company could easily map fields using Provar’s knowledge of Salesforce metadata. This approach helped create highly maintainable test cases.

The company was also able to use Provar’s environment management functionality to test easily across different environments. They were pleased that the same tests could be run in different environments without any changes needed to the tests.

Overall, the company was delighted with their adoption of Provar because of the significant reduction in Sales Cloud testing time and effort.

 

Technical Solution

The company noted a number of specific areas in Sales Cloud testing that Provar excelled in where their previous tool, Selenium, had struggled.

 

No code

Selenium requires testers to have development skill in Java, C#, Python or a similar language. Provar works code-free and is easy for non-developers to use, meaning that training testers and maintaining tests is much easier.

Easy control locators

Selenium requires test authors to hardcode these locators. Provar is tightly integrated to Salesforce metadata, meaning that field locators are suggested automatically and can be amended easily.

Easy testing

Selenium API tests have to be programmed, while Provar supports data creation and cloning through a simple drag-and-drop interface.

Support for field definitions

In Selenium, all picklists and labels have to be programmed manually. In Provar, picklists and labels are supported automatically through Provar’s tight metadata integration.

Testing with multiple users and profiles

Selenium has no support for these requirements, whereas Provar can offer it with the simple setup of an Excel sheet.

Automated data cleanup

In Selenium, data clean-up has to be programmed, while in Provar this can be enabled automatically.

Support for native Salesforce elements

Selenium does not have knowledge of Salesforce standard or custom elements and needs all fields to be mapped manually by the test author. Provar has inbuilt support for standard page layouts, recognising and mapping fields automatically. It also has advanced Visualforce support via its PageObjects concept, meaning that minor amendments to the Visualforce page do not break tests.

Environment management

In Selenium, data clean-up has to be programmed, while in Provar this can be enabled automatically.