Qualitia Boson categorizes execution failures to help you identify issues in your test suite executions. The failure category is sorted by the number of corresponding failures.
You can select a failure category to view the failed steps.
Note: Failure categorization is not available for desktop projects.
Here are some predefined failure categories:
|
Failure Category |
Description |
|
Action Failure |
The action defined for the step did not execute correctly. |
|
Action Is Not Supported |
The action in the step is not defined in Qualitia or cannot be used in the selected browser/environment. |
|
Cannot Select From Dropdown |
The specified dropdown list does not exist, or it does not contain the defined parameter. |
|
Class File Is Missing In The Project |
The custom action did not execute because its source file is missing. |
|
Failed To Store Data |
The action related to storing data failed. |
|
File Does Not Exist |
The specified file is not found in the defined location, or the file extension is incorrect, or the step failed to create a file in the specified location. |
|
Incorrect Data Format |
The parameters contain data in an invalid format. |
|
Data Is Not Supported |
The parameter contains data that the object or the action does not support. |
|
Invalid Expression |
The conditional expression syntax or the input parameter for an action is invalid. |
|
Invalid Input Parameters |
The test data provided for the action is invalid. |
|
Object Does Not Exist |
The object is not found or disabled on the selected browser/environment. |
|
Timeout Encountered |
The associated object is not found within the specified Wait Time. |
|
Uniqueness Violation |
Unique values are not provided. |
|
TestCase_Cannot_Execute |
The whole test case was aborted due to incorrect application URL, wrong environment selection, or invalid Javascript expression. |
|
Expected Result Not Met |
The step's result is a defect when actual results and expected results are different. |
|
Lack Of Permissions |
You do not have access to the environment or on application under test feature you are testing. |
You can add custom failure categories to custom actions as needed.
To view a failure summary for a suite execution:
-
From Suite of Suites screen, click the test suite execution you want to view.
-
In Test Suite Execution Summary Report, click the Failure Summary button.
-
You can view failure categories and the number of failed steps for each category.
-
Click a failure category to view test case iterations where the failure occurred.
-
Click a test case iteration to view the failure categories in that iteration.
-
Click a failure category to view the failed steps in that iteration. If the step is part of a task, the task name and task iteration are also shown.
-
Click on a failed step to open the test case iteration detailed report with the selected step highlighted. You can also view the screenshot and Info Log for the failed step.