Every load test should have a pass/fail status. This can be easily done using check profile rules. Rules can be evaluated periodically while the test is running to get the real-time status of the test. You can use this to stop the test from failing to avoid time and resource wastage.

For overall test status, rules can be evaluated at the end of the test. Detailed pass/fail report highlights metrics as green, yellow, or red for quick root cause analysis.

In this, we have the following two ways to evaluate:

Evaluate Pass/Fail status periodically while test is running
Run rules for overall Pass/Fail criteria

Evaluate Pass/Fail status periodically while test is running

Rules should be run by keeping in mind the following conditions:

Window: Select whether the window should be fixed or moving.

Time: Choose the time in minutes.

Once conditions are applied then select the profile from the drop-down if any are available or from the local directory.

Profile Name: It shows the profile name.

Profile Description: Describe the profile selected.

Check Rules: This column checks the rules applied to the profile.

Last Updated: It is the time when the profile was last updated.

Updated by:Shows the name of the person or team updated on the profile.

Action:It is used to edit or delete the profile selected.

Pass/Fail Criteria

Metrics used in rules are:

Green:if SLA is upto 20%

Yellow:if SLA is 21% - 50%

Red:if SLA is more than 50%

You can also check the box available if you want to stop the test in case of failure.

You can check the box, if you want to generate a report in case of:

All cases

Failure Cases

Run Rules for overall Pass/Fail criteria

To apply the same CheckRules as the periodic case check the available box.

Once the above conditions are applied then select the profile from the drop-down if any are available or from the local directory.

Profile Name: It shows the profile name.

Profile Description: Describe the profile selected.

Check Rules: This column checks the rules applied to the profile.

Last Updated: It is the time when the profile was last updated.

Updated by:Shows the name of the person or team updated on the profile.

Action:It is used to edit or delete the profile selected.

Show metrics of baseline testruns in the pass/fail report.

In this, you can select the scenario and the test run in the respective baseline.

Pass/Fail Criteria

Metrics used in rules are:

Green:if SLA is upto 20%

Yellow:if SLA is 21% - 50%

Red:if SLA is more than 50%

NOTES

You can also check the given box if you want to skip the Ramp up, Stabilize and Ramp down phases. It will show Simple Scenario-based Scheduling only.

You can also override the check profile SLA by selecting the check box available with the respective baseline by choosing them from the dropdown.