Version 2.0.3 Spring ’20
We’re happy to announce Provar’s Spring ’20 compatibility release in Provar 2.0.3, now available in the Provar Success Community.
This release ensures compatibility with Salesforce’s Spring ’20 release.
This release also provides general availability for Provar’s new UI for Provar Desktop and Test Builder, released as beta in 2.0.2.
Key updates at a glance
- Salesforce Spring ’20 general compatibility. This release ensures compatibility with Salesforce’s new Spring ‘20 release to keep your tests running as normal. The only thing you’ll need to check: Custom Page Object locators and Custom APIs you have created in your own test projects.
- Enhanced UI. We’ve made several improvements to the UI including new icons and light and dark modes. We’ve also renamed the Test API to Test Palette and changed the grouping of test steps to be more consistent and intuitive.
- Expanded Test Builder functionality using the Test Palette. You can now add and edit many test steps directly within the Test Builder itself!
For further information about anything contained in these release notes, please contact us at [email protected].
Table of contents
Salesforce Spring ’20
- Spring ’20 general compatibility
- Customize Account and Opportunity Team related lists
- Related Account for Contacts and Opportunities in Global Search
New Provar UI
- Provar 2.0 perspective & light/dark mode
- Run Mode removed from Menubar
- Optimized navigation
- New icons
- Reorganized Test Palette
- Custom APIs labeled custom by default
- Test Palette added to Test Builder
- Custom test APIs
- Order of test steps in Test Builder
- Expanded text editor support
- Combined play/resume and pause
- Assert lists within UI assert test steps
- Test plan functionality is now generally available
- Contains options for UI Handle Alerts
- Function support for row locators
- Raise Cases via Provar Desktop
- Recent Workspaces show current version Workspaces only
- Convert Lead Screen (Lightning)
- Select Product from Price Book object
- Danish language support
- Quick action navigation based on components instead of the tabs
- Changes to new page layouts and contact roles
- Accordion support in FlexiPages
- Expanded support for add leads and contacts within the campaigns screen
- Global date and timestamps
Field Service Lightning
- Field Service Lightning Dispatcher Console Service Appointment and Service Resource pop-up screens
- Field Service Lightning Dispatcher Console within the Console applications
Salesforce Spring ’20
Spring ’20 general compatibility
This release ensures compatibility with Salesforce’s new Spring ’20 release to keep your tests running as normal. The only thing you’ll need to do is to check custom Page Objects locators and Custom APIs you have created in your own test projects.
Customize Account and Opportunity Team related lists
Provar now supports the customize account and opportunity team related lists option in Lightning Experience. This is a new option in Spring ‘20 which can be applied by a system admin. You may need to remap any existing tests that interact with these related lists that previously relied on the static definition of the columns displayed.
Above: Mapping of a related list within the Opportunity view screen (default view).
Related Account for Contacts and Opportunities in Global Search
With Salesforce Spring ‘20, when a sales team searches for a contact or opportunity, they see the related account in instant results and recent items. Provar 2.0.3 supports the standard testing of this new functionality.
Above: View of Opportunity search.
New Provar UI
Provar 2.0 perspective & light/dark mode
Provar 2.0 brings a new Provar UI and light and dark modes within Provar Desktop and Test Builder. We added these in order to make it easier to use Provar in different lighting conditions and to contrast with other desktop applications as needed.
Switch between light and dark modes using the View dropdown in the upper-right portion of your display of Provar Desktop and the Settings icon within Test Builder.
Please note that light and dark modes for Provar Desktop and the Test Builder work independently of each other, allowing you to apply one mode in Provar Desktop and another in Test Builder, or the same in each (see screenshots below). This is a deliberate decision designed to give you more flexibility and we do not plan on synchronizing the settings.
Based on user feedback we’ve added a new perspective to optimize Provar’s default panels and enable dark mode. You can choose whether to use the original Provar perspective (with light mode) or the new perspective (with dark mode).
To use the light mode or keep Provar consistent with Provar 1.9.x, click View > Switch to View Provar (1.9) perspective. To run Provar in dark mode and activate the new panel layout, click View > Switch to View Provar (2.0) perspective.
Above: Click the View button within Provar Desktop to switch perspectives. Provar (1.9) perspective refers to light mode and the 1.9 panel layout and Provar (2.0) perspective refers to dark mode with the new panel layout. As always you can still customize your perspective to add/remove panels.
To switch from light to dark mode in Test Builder, click the gear icon in the upper-right portion of Test Builder and select Light Theme or Dark Theme.
Above: View of using the gear icon within the Test Builder to switch perspectives. You can also pin/unpin the Test Builder from within this menu.
Above: View of Provar Desktop in dark mode.
Run Mode removed from Menubar
Based on user feedback, we’ve adjusted the execution modes in the Menubar to focus on debugging. The separate options for Run, Debug and Test Builder have been replaced with a single drop-down button for Test Builder (default), Run/Debug and Run under ANT. This more accurately reflects how users have been using this button to create and test individual test cases before building a Test Plan or ANT build.xml for their regular test execution.
Note that if you select Run/Debug from the Menubar, the open test will be run in debug mode with breakpoints enabled and variables captured. The standard Run mode (without Debug) can still be accessed from the right-click menu in the Navigator.
Above: View of Run Mode selection within the Navigator panel.
We re-arranged the Provar Desktop top navigation to make it easier to find the most frequently used options. This is part of an ongoing effort to prioritize the most commonly used aspects of Provar and make them easily available for you. Most notably, the Problems tab has moved across so that it can be seen alongside Test Runner results.
We’ve updated 180+ icons associated with key features (such as the Test Palette, Provar Desktop, the navigation toolbar and more) within Provar. We have also added new icons that are associated with different views within Provar. For example, when you click Tools in the top Menubar, you can then click Show Views to select various views and each view is associated with a unique icon.
We have a few more to change as part of planned enhancements in future releases around the Variable tab, Org Browser and Problems.
(Note: When you toggle between Provar (2.0) perspective and Provar (1.9) perspective, you can still experience the new iconography across both perspectives. Though, it is important to note that if you are using a workspace that was created prior to 2.0.3, you will need to click Reset Views from the top Menubar in order to view the new icons. You only need to do this once within your workspace in order to enable the new icons.)
In sum, these icons are designed to more easily communicate different aspects of Provar in a limited amount of real estate.
Above: View of Reset Views from within the View drop down menu.
Above: View of new icons within Test Case Parameters and Settings.
Above: View of new icons within the Test Palette.
Reorganized Test Palette
To make it easier to find and identify test steps, we have made several changes to test step category names and some individual test steps within the Test Palette in Provar Desktop.
Category name changes:
- Database, Messaging and Web test steps can now be found under the new name Data
- List, String APIs and Read/Write test steps can now be found under the new name Utility
- Test steps associated with Behavior-Driven Development and Design test steps can now be found under the Design category
- Force.com test steps can now be found under the Salesforce category
- UI Testing test steps can now be found under the UI category
Test step name changes:
- The Web Request (HTTP/REST) test step is now Web Request (REST)
Custom APIs labeled custom by default
To make it easier to differentiate between standard and your own custom steps, custom APIs are now stored within a group that is labeled Custom by default and visible both in Provar Desktop and Test Builder.
When creating a Custom API you can specify the section(s) it appears in by modifying the defaultApiGroups attribute. You can even put a Custom API in multiple section groups. See here for more details on Creating Custom APIs.
Above: View of Custom APIs stored within the custom folder.
Above: View of Custom APIs labeled as Custom within Java.
Test Palette added to Test Builder
By clicking the Test Palette icon at the top of the Test Builder, many of the most commonly used test steps (listed below) will appear at the bottom of Test Builder.
Above: View of Palette icon at the top of Test Builder.
To add individual test steps, double-click the test step icon.
Note that the Test Builder Test Palette defaults to display the Control test steps. To view the test steps within each category, click Control, Design, UI or Utility at the bottom of the Test Builder.)
Above: View of Test Palette options within Test Builder.
The following test steps are supported :
- Control: Assert, Break, Fail Test, Finally, For Each, Group Steps, If, Set Values, Sleep, Switch, Wait For, While.
- Design: Actual Result, And, But, Design Step, Given, Then, When.
- UI: Add a Table Mapping, Handle a Browser Alert, UI Navigate.
- Utility: List Compare, Match, Replace, Split.
- My Test APIs: See below.
To remove the Test Palette from your view, click the palette icon once again.
Note: The test steps in Test Builder do not all have the exact same options and flexibility as using Provar Desktop. Some attributes are suppressed in Test Builder for user experience reasons and based on frequency of use.
Custom test APIs
In addition to Provar Desktop, you can now access custom test APIs within the Test Builder by clicking the artist’s palette icon at the top of the Test Builder. Test palette test steps will display and default to the Control test steps. Click My Test APIs at the bottom of the Test Builder to view available custom test APIs.
(Tip: You will only see the My Test APIs icon if you have already created a custom API via Provar Desktop and have not set a default group.)
Order of test steps in Test Builder
Previously, if the execution was paused at the end of a parent step (e.g. On Screen, With Row or Group Step), the new test step was added as the last child of the parent. With Provar version 2.0.3., the step will be added before the step where the execution is currently paused.
Known Issues: Test steps added via the Test Palette in the Test Builder may not work as expected if:
- Added inside conditional steps, e.g. If Else and Switch Case
- Added inside loops e.g. While, Wait For and For Each
If you encounter this issue, simply revert to Provar Desktop to reposition the test step in the correct indentation and/or location.
Above: View of the Test Builder when specifying the order of test steps.
Expanded text editor support
In the Test Builder, you now have more flexibility in how you edit test step parameters. You will now see the expression editor icon, and to the right, up and down arrows within fields enabling you to edit the field using a drop-down menu.
Above: View of Expression Editor and drop-down menu options within the Test Builder.
Combined play/resume and pause
To make it easier to run tests, the Play/Resume and Pause buttons have been combined into one button within the Test Builder. After pressing Play, the button changes to display vertical lines (Pause mode icon). After pressing Pause, you can then toggle the same button to again Play/Resume.
Above: View of Test Builder Play/Resume-enabled button.
Above: View of Test Builder Pause-enabled button.
Assert lists within UI assert test steps
You can now assert lists directly within a UI Assert test step using the new <equals> operator. This lets you assert values of a list using a single assertion step. Previously, if a field contained a list, you couldn’t perform the read and assert functions in the same step.
Test plan functionality is now generally available
Earlier this year, we released test plans as part of a pilot project. This feature is now generally available for all Provar users. We’re planning further enhancements around integration of Test Plan with tools such as ALM, Test Rail and Zephyr to allow you to import plans from other tools and you’ll start to see these in the next few releases.
Test plans are designed to help users streamline the testing processes associated with supporting new software releases. With test plans, you build multiple test plans and run a repeatable collection of tests per each release cycle. You can also make global changes to the environment settings such as browser settings, build number and build server. What’s more, you can get consolidated reports of your results!
This makes it much easier for you to configure different test plans in Provar without having to keep editing your ANT build.xml manually. Test plans are also compatible with ProvarDX (beta) allowing you to execute a particular set of test cases and environments from a single command.
Above: View of Provar Desktop while creating a new test plan.
Contains options for UI handle alerts
Provar now supports Contains options in UI Handle Alert test steps. This is designed to help assert aspects of an alert message without needing to specify an entire string. This includes Case Sensitive, Regular Expression and Normalize options.
Above: View of a Salesforce UI Handle Alert.
Function support for row locators
Provar now allows the use of functions as part of a row locator when testing lists and tables. You can now access all available functions within Provar Desktop or the Test Builder anywhere a WithRow is used with a Row Number or a WHERE clause.
Raise Cases via Provar Desktop
We have transitioned recently to a new customer support platform via the Provar Success Community. With this release, we have updated our in-tool bug reporting so that you can raise a success case and attach files from right within Provar Desktop. Cases raised via this method will be visible to you when you log into the Success Community so you can monitor case progress. They will also trigger case email notifications in the same way as if you raised the case in the Community.
From the top navigation of Provar Desktop, click Help and then Report Bug or Enhancement in Provar and follow the prompts on the screen. The first time you use this feature you will need to enter your Success Community login details. These can be accessed at any time by clicking the Connect to Customer Community button.
Above: View of Report Bug or Enhancement in Provar feature within Provar Desktop.
Above: View of the Provar Success Community > View/Raise Case functionality.
Recent Workspaces show current version Workspaces only
From 2.0.3, the Recent Workspaces list will be refreshed each time you take a new Provar version. This means that workspaces used in earlier versions of Provar will not show under Recent Workspaces, until they are selected on your current version. This change applies to 2.0.3 and future Provar versions.
When launching Provar, Recent Workspaces are listed on the initial Select a directory as workspace pop-up screen. These are displayed immediately below the field where you can browse to select a directory as a workspace.
It is important to note:
- Workspaces are not deleted. You can continue to click the Browse button to find and select workspaces that you have created and saved.
- Recent Workspaces will show any workspaces recently used by you on the version of Provar you are currently using.
Above: View of the Select a directory as workspace pop-up screen.
Convert Lead Screen (Lightning)
To streamline the testing process, we now offer standard support for the Salesforce Convert Leads screen. This supersedes the need to create PageObjects to map the conversion popup as Provar will now recognise the Convert Lead page automatically and each of the fields and buttons.
Above: View of Convert Lead screen within Salesforce.
Select Product from Price Book object
You can now automate the flow of selecting products from Price Book entries in the related list of a Price Book Object. With our latest release, you can click the Add Products button and easily map that as a test step within the Test Builder.
Above: View of Add Products screen within Price Book.
Danish language support
Provar supports internationalization testing of Salesforce, i.e. the end-user testing of Salesforce in languages other than English. We have now added Danish language support.
Provar now supports Danish, Dutch, German, Italian, Portuguese, Spanish, French and Swedish.
Quick action navigation based on components instead of the tabs
Previously, Provar automatically managed the required quick action navigation for standard pages. Now, you also map and execute test steps using the quick action navigation on pages that include custom elements and when standard components are not included in standard tabs. This includes case and work order objects, activity objects/the activity panel, Chatter related quick actions and Chatter feed components.
Changes to new page layouts and contact roles
In Winter ‘20, Salesforce included new page layout options for contact roles. Provar now supports testing of the new page layouts available for contact roles.
Accordion support in FlexiPages
In Salesforce, an accordion component is a collection of vertically stacked sections with multiple content areas that can be added to a Lightning FlexiPage. Provar now supports the mapping of fields within FlexiPage accordion components created via the Salesforce App Builder.
Expanded support for add leads and contacts within the campaigns screen
Provar now has inbuilt support for adding leads and contacts to Campaigns via the Campaign page itself or via the individual lead or contact pages in Lightning.
Global date and timestamps
We identified an issue that was related to country and time zone specific date and timestamp formats – resulting in field mapping and testing errors. With this release, Provar better supports three interaction types for the date and time fields within Salesforce Lightning. Specifically, the SetDate, SetTime and Set features. With 2.0.2, Provar can now test those fields, specifically that the format of the fields and corresponding information is set correctly.
Field Service Lightning
Field Service Lightning Dispatcher Console Service Appointment and Service Resource pop-up screens
Within Field Service Lightning, the Gantt table gives a bird-eye view of scheduled Service Appointments for the selected calendar date and the dispatcher can quickly check details of the Service Appointment, Assigned Resource and Resource Availability using popups.
With 2.0.3, Provar supports the testing of these automated pop ups.
Above: View of Service Appointment pop up.
Field Service Lightning Dispatcher Console within the Console applications
Provar now supports testing of the Field Service Lightning Dispatcher Console within Console applications. Previously, Provar only supported testing of the Field Service Lightning Dispatcher Console within non-console applications.
- General information
- Licensing Provar
- Provar trial guide and extensions
- Using Provar
- API testing
- Behavior-driven development
- Creating and importing projects
- Creating test cases
- Custom table mapping
- Debugging tests
- Defining a namespace prefix on a connection
- Defining proxy settings
- Environment management
- Exporting test cases into a PDF
- Exporting test projects
- Managing test steps
- Namespace org testing
- Provar desktop
- Provar Test Builder
- Refresh and Recompile
- Reload Org Cache
- Running tests
- Searching Provar with find usages
- Secrets management and encryption
- Setup and teardown test cases
- Tags and Service Level Agreements (SLAs)
- Test cycles
- Test plans
- Testing browser options
- Tooltip testing
- Using the Test Palette
- Test Palette introduction
- Control test steps
- List compare
- Read test step
- String test steps
- UI Test Steps
- Using custom APIs
- Callable tests
- Data-driven testing
- Page objects
- Block locator strategies
- Introduction to XPaths
- Creating an XPath
- Label locator strategies
- Maintaining page objects
- Mapping non-Salesforce fields
- Page object operations
- Refresh and reselect field locators in Test Builder
- Using Java method annotations for custom objects
- Applications testing
- Database testing
- Document testing
- Email testing
- Mobile testing
- OrchestraCMS Testing
- Salesforce CPQ testing
- ServiceMax testing
- Skuid testing
- Vlocity testing
- Webservices testing
- Introduction to test scheduling
- Apache Ant
- Configuration for sending emails via the Provar Command Line Interface (CLI)
- Continuous integration
- Azure DevOps
- Running a Provar CI task in Azure DevOps
- Configuring the Provar secrets password in Microsoft Azure Pipelines
- Parallel execution in Microsoft Azure Pipelines using multiple build.xml files
- Parallel execution in Microsoft Azure Pipelines using targets
- Parallel execution in Microsoft Azure Pipelines using Test Plans
- Bitbucket Pipelines
- GitHub Actions
- Running a Provar CI task in GitHub Actions
- Remote Trigger in GitHub Actions
- Parameterization using Environment Variables in GitHub Actions
- Parallel Execution in GitHub Actions using multiple build.xml files
- Parallel Execution in GitHub Actions using Targets
- Parallel Execution in GitHub Actions using Test Plan
- Parallel Execution in GitHub Actions using Job Matrix
- GitLab CI
- Travis CI
- Parallel Execution
- Running Provar on Linux
- Salesforce DX
- Team foundation server
- Version control
- Zephyr Cloud and Server
- Salesforce testing
- Adding a Salesforce connection
- Assert Page Error Messages on Add/Edit Product
- Dynamic Forms
- Internationalization support
- List and table testing
- Salesforce Release Updates
- Salesforce Lightning Testing
- Salesforce Lightning Web Component (LWC) locator support
- Salesforce console testing
- Visualforce Testing
- Testing best practices
- Configurations and permissions
- Error messages
- Licensing, installation and firewalls
- Test Builder and test cases
- Release notes