About the Company

This case study covers a Fortune 300 insurance company client located in the US with over 12 billion dollars in annual revenue. They use an automated testing strategy, governed by Provar Automation, for continuous integration in the insurance industry.

This company has a sophisticated Salesforce Service Cloud implementation and is a customer of Vlocity, a Fortune Cloud 100 company that leads industry cloud app adoption on Salesforce and is driving digital transformation for the world’s leading brands. The company uses Vlocity OmniScript™ to craft dynamic customer interactions without code, guide users through service processes with fast, personalized responses, and deploy multiple channels and devices.

This company is a global Salesforce partner with a successful track record in planning and delivering complex Salesforce projects. They strongly emphasize the certification of their Salesforce consultants, bringing innovation and deep cross-industry domain expertise to their projects. They offer a culture of strong governance and project management to drive business success for each of their customers.

The Challenge

Before moving to Provar Automation, manual testing was a burden for this company. With over 2000 test scenarios needing to be covered around their case management processes and some complex Visualforce testing pages, testing was time-consuming and resource-heavy.

Most of the company’s testing challenges revolved around their console application, SRM (Service Request Management). This sophisticated application offers multiple tabs and an advanced footer component including options such as Search Agent and Create New Service Request.

The application presented some challenges to test due to the need to control navigation between multiple primary, secondary, new, and existing tabs and the custom console components, which demanded advanced iFrame management.

In addition, the company was looking for a tool that could offer reusable functionality, such as callable tests, the ability to test cases across multiple profiles, and for test data to be data-driven from Excel. The company evaluated Provar Automation to see whether an integrated test automation solution could fill the gap.

The Solution

The client decided to implement Provar Automation, which prides itself in continuous integration for the insurance industry. Provar Automation is a no-code test automation tool, and because Provar is tightly integrated with Salesforce, the solution provides a more efficient way to implement automation, intelligently locating Salesforce fields, objects, and other critical metadata.

Minor environmental changes become easier to accommodate, reducing maintenance effort and increasing scalability. Through Salesforce integration, running the same test cases against multiple profiles is possible using Provar Automation, making it easy to scale testing efforts. With Provar Automation‘s point-and-click test building, the team could build test cases quickly.

The test cases were humanly readable and easy to understand, making it faster for the business to validate scenarios. Provar also tackled the console application’s complex technical aspects, which required navigating several open tabs and supporting custom console components, including a console footer.

Switching between different frames and screens can be a stumbling block for other tools but is handled automatically by Provar Automation without input needed from the user. Using Provar Automation, the company completed 185 test cases in the first ten days, averaging 7 per user daily. (Note: Test case velocity depends on the complexity of the test cases being delivered.)

The Results

The company significantly reduced its Salesforce regression testing time and effort thanks to Provar Automation. They also realized a significantly higher test coverage with fewer functional SMEs. In addition, the company can now run the same test cases across multiple environments and user profiles, giving extraordinary transparency and range to their regression testing.

The company runs up to 400 test cases nightly through continuous integration in the insurance industry, and over a week, they cycle through 2000 different test cases. Their strategy includes coverage of the same test cases across four other user profiles, helping to ensure thorough testing for each user type. These nightly runs deliver a comprehensive report in PDF of the test cases run, with granular insights into the successes and failures of each test case and test step.

Key Statistics

  • Test Builder: Using Provar Automation‘s point-and-click Test Builder tool, the company builds its tests step by step in the browser and makes edits. It allows them to create test cases and debugging quickly and easily.
  • Drag-and-Drop API: The company uses Provar Automation to drag and drop API test steps into any test to create and assert test data. The solution offers Create, Read (including SOQL), Update, and Delete options, as well as automated test data teardown.
  • Data-Driven Testing: Provar Automation enables data-driven testing for this company from an Excel file or a database using a simple drag-and-drop interface.
  • Maintainable Locators: Provar Automation uses the information found within Salesforce’s metadata to build its tests, meaning field locators are automatically suggested and can be amended efficiently. Locators can be used across environments with minimal updates. This proved exceptionally helpful for this company.
  • No Code: Provar Automation works code-free and is easy for non-developers within the company to use, making it easier than ever to train testers and maintain tests.
  • Testing with Multiple Users and Profiles: Provar Automation allows this company to run the same tests in the profile of multiple users without the need to create various tests to do so. It helps this company increase coverage while reducing maintenance.
  • Salesforce Support: Provar Automation has built-in support for standard page layouts, automatically recognizing and mapping fields, one of this company’s favorite features. It also has advanced Visualforce support via its PageObjects concept, meaning minor amendments to the Visualforce page do not break tests.
  • On-Screen Navigation: Provar Automation‘s “On Screen“ functionality allows the company to take the user directly to the relevant object screen, removing the need for login and additional screen navigations and speeding up their automation process.
  • Embedded Frames and Tables: Provar Automation supports testing embedded frames, nested frames, and tables. The automation of testing these elements can be complex and laborious with many standard tools. Provar Automation helps the company handle these automatically in a single step, with the complexity hidden from the user.
  • Support for Related Lists: Provar Automation has inbuilt support for this company’s dynamic related lists and list screens, making searching and locating elements quick.
  • Frame Switching: Switching between frames and screens can be a stumbling block for other tools, but this is easy for this company as it is handled automatically by Provar Automation.
  • Coverage and Reusability: The company noted increased test case reusability and increased test coverage for both positive and negative scenarios.

Interested in learning more about how Provar Automation can help support your company’s testing efforts? Connect with us today!