3.4.8 Thresholds By Test Types

Abbreviations, used in manual:

DV - Data Validation

This manual explains the various types of Thresholds available for each Test type.
For general Threshold definitions, please refer the following manual: Test Results - Thresholds 

1. Compare Tests:

The Thresholds settings are different for each type of comparison.

a. Data Integrity:

This Test type compares keys. Therefore, there is only one Threshold option available: "High is Bad".

If there is a mismatch between keys => the Test should fail:

Divide by Master (in the top-left corner) - mark this option if you want to divide the Test results by the Master table.

b. Aggregated Data & Raw Data:

There are 2 different Threshold types that can be defined:

1.  Threshold for each column that was chosen for comparison. See the picture marked as 1.

2. Threshold for the entire Test (Global Threshold). See the picture marked as 2.

By clicking Threshold per column,  the following form will open:

You can define Thresholds for specific column values to trigger Failure, Success, or Warning statuses.

The Global Threshold determines whether the entire Test passes or fails, based on the number of failed records across all columns.

For example:

In the following Test the Threshold values for each column and also values for the Global Threshold are defined differently:

And these are the Test results:

Each column showed different results based on its Threshold settings.

In the end, the Test failed because there were 1,116 failing records, which is over the threshold of more than 1,000 failures is bad.

2. DV Tests:

In DV Test you have to set the Threshold values for each defined Rule separately:

By clicking "Edit" for each Rule, you can set the Threshold values:

You can set Rule's Threshold in Percentage or in Number, with or without a Warning.

For example:

In the following Test there are three Rules defined, each Rule has it's own Threshold definition. Therefore, each Rule results differs:

The Test will end with a "Failed" status if at least one of it's Rules fails.

The Test will end with a "Warning" status if there are no failed Rules and there is at least one Rule that ended with a Warning.

The Test will end with a "Success" status if all of the Rules have passed.

3. KPI Tests:

In KPI Tests, you can set unique Threshold values for each record as well as for each rule.

The key appears in the left column, grouping all records by that key. (1) represents all the Threshold rules you have created.

You can also define a Global Threshold rule that applies to all records within a specific Threshold rule (2).

Additionally, you can set a custom Threshold for each individual record by clicking (3).

Once you’ve set the Thresholds, the rules you defined will be displayed at the bottom of the page.

 

And these are Test results:

There are different results for every rule and record you have defined. 

Overall, the Test received a Failure status because there is at least one failing result.

The Test will end "Failed" status if at least one of it's results failed.

The Test will end with a "Warning" status if there are no failed results and there is at least one result that ended with a Warning.

The Test will end as with a "Success" status if all of the results are passed.

4. Custom Tests:

The custom Test's Threshold refers to the number of scanned rows in the Test. 

Example:

If the Threshold value is set to be:

 

Then if the Test scanned 5 rows or fewer, it will fail:

And if the Test scanned over 5 rows, it will pass: