What is a Test Plan?
A Test Plan is a collection of tests configured for execution. Test Plans help you group relevant tests and configure triggers. You can execute Test Plans as needed.
Qualiti provides detailed status information beyond simple Passed
or Failed
results. Tests are categorized into granular groups with specific failure reasons, helping you focus your efforts and understand issues at a high level.
Test Plans come with a report of Test Case results, and you can dive into each one for more details.
Add New Plan
We recommend tagging Test Cases and creating Test Folders first. This way, when your Test Cases are well-organized, it's much easier to create your Test Plans.
-
Click
Create test plan
-
Name your Test Plan
-
Enter a brief description
-
Select a User Profile for the Plan
-
Select the browser(s) for test execution
-
Set a trigger for your Plan You can choose to trigger your plan in one of two ways:
Option A: Schedule
- Toggle on the Schedule option
- Choose the Interval (e.g., Monthly, Weekly, Daily)
- Set the hour and/or minute (in UTC) for the trigger
Example:
- Interval = Daily
- Hour = 12
- This runs your plan once a day at 12:00 PM UTC (Cron equivalent:
0 12 * * *
)
infoBest practice: Avoid running plans more than once every 24 hours to prevent test overload.
Option B: CI/CD
-
Toggle on the CI/CD option
-
This allows the test plan to be triggered externally via your CI/CD pipeline using our API integration
infoSee Integrations for more information
-
Click
Save
to save your plan
Run a Test Plan
Test plans can be executed in multiple ways: manually, scheduled, or with CI/CD Integration.
Manually
Each Test Plan has a Run
button. Simply click it to start a Test Run!
On a Schedule
You can add one or more Scheduled Triggers to a Test Plan. Scheduled Triggers are cron expressions and are run in UTC time.
Configure the minutes, hours, days, and months, then save. Your Test Plan will execute automatically on that schedule.
Edit a Test Plan
You can edit several aspects of a Test Plan:
- Plan Name
- User Profile
- Browsers
- Triggers
Editing follows the same process as creation; refer to the Add New Plan section. Additionally, you can enable, disable, or delete Test Plans as described below.
Enable and Disable
- Test Plans are enabled by default and can be executed manually or by scheduled triggers.
- Disabling a Test Plan prevents it from being executed by any triggers.
Delete a Test Plan
To delete a Test Plan:
- Click on the Test Plan name
- Click
Delete Plan
next to the Test Plan details - From the confirmation modal, click
Confirm
Deleting a Test Plan is permanent and cannot be undone
Run History
The Run History tab shows all test executions for a plan with details including:
- Date: When the Test Run was executed
- Environment: The environment used (e.g., Staging, Production)
- Tests: Number of tests executed
- Browser: Browser used for testing (e.g., Chrome, Firefox)
- Duration: Time taken to execute
- Status: Current status (e.g., Complete, In Progress)
This history helps track performance over time and identify patterns or recurring issues.
View All Test Cases
The Test Cases tab displays all test cases in the Test Plan. You can:
- Add or remove test cases directly from this tab
- Review the status of each test case
- Click into the test case to view its details