Skip to main content

Test Case Categories

We want to keep you updated on the status of your Test Plans and Test Cases with more context than just a simple Pass or Fail result.

Each Test Case Result will have a detailed format, including a Status, Category, and Reason. This will help you focus your efforts and identify the reason behind test results at a higher level.

For example, we have a Needs Review status that makes it very clear to you which Test Cases require your analysis.

Statuses​

Statuses show which state the Test Case is in. For example, if a Test Case is currently being executed, it will show the Pending status!

Archived​

🙈 The test is removed from their Test Cases. It won’t be executed or added to the Test Coverage

Passed​

✅ The test completed execution and passed!

Failed​

🚫 The test completed execution but failed. The Category and Category Reason helps describe why before diving deeper into details like the Trace Viewer

Qualiti Review​

🐨 The test ran into an issue that was Qualiti’s fault. The Category and Category Reason will help, but if you need further assistance, you can contact our support team

Needs Review​

👀 The test completed execution and failed. This could be a Qualiti issue or a Customer issue, but requires your analysis.

Pending​

⏳ The test is waiting to be executed or currently running

Skipped​

⏩ The test will not be executed, but still count towards Test Coverage as Skipped Test Coverage

Categories​

Test Results are categorized into specific buckets, which helps in identifying the root cause and implementing a more focused and effective solution. The following categories and reasons provide insights into why a test did not pass.

Failed​

This means the Test Case failed and Qualiti was able to determine it was an Environment or Application issue.

  • Data Issue
  • Failed On Action
  • Element Not Found
  • Login
  • Page Timed Out

Needs Review​

This means that Qualiti was unable to determine if the test passed or failed and requires you to analyze it to see what action should be taken. For example, should you create a Bug in your project management tool or do you need to update a Test Case Step?

  • Network Error
  • Element Not Found
  • Stale Element
  • Navigation
  • Element Not Interactable
  • Unreliable Selector
  • Failed On Action
  • Failed On Assert
  • Failed On Locator
  • Login

Qualiti Review​

This means that an issue happened within Qualiti's system and has been flagged for our team to investigate and resolve. We recommend running the test again.

  • Runtime Error
  • Unsupported Event
  • Browser Setup
  • Ignored
  • Infrastructure Error
  • Login
  • Result Parser
  • Results
  • Step Finalization
  • Step Initialization
  • Test Run Setup
  • Test Run Teardown
  • Timed Out
  • Validation

Right now, a lot of the test triage and analysis must be performed by you. However, in the future, Qualiti will be able to provide better groupings, insights, and automatic analysis to speed up this process so you can focus on running Test Cases and getting feedback about your products.