Add a Data Quality rule
Add a Data Quality rule
To create a new Data Quality Rule for a Model Object, Term(s) of a Model Object, or Relationships to another Model Object, access the Data Quality rules overview page for a Model Object:
The Data Quality rules management is available or not on a Model Object Type, depending on the Generator Configuration of your project.
Then click on the Add Rule button:
This button is available for:
- The Model Object itself by selecting the Model Object option in the left menu:
- The Terms of the Model Object by selecting the Terms option in the left menu, then marking a Term:
- The Relationship(s) defined on the Model Object by selecting the Relationships option in the left menu, then marking a Relationship:
The Add Rule side panel window is opened:
Fill in the following information:
- Terms: displayed only for a Data Quality Rule on a Term
- One or several Terms can be selected in the list of Terms of the Model Object
- One or several Terms can be selected in the list of Terms of the Model Object
- Rule: list if available Data Quality Rules
- For the Model Object:
- Nulled Non-Nullable Business Keys
- Duplicated Business Keys
- For Terms:
- Nulled Non-Nullable Term
- Duplicated Term
- For Relationships:
- Missing Foreign Keys
- For the Model Object:
- Description (optional): Data Quality rule's description
- Active: checkbox to activate or deactivate the data Quality rule
- Execution Behavior: choose if you want to check the Data Quality rule Before or After:
- Before: the Data Quality rule check is done before filling the main Table of the Silver or Gold layer - the rows which doesn't respect the rule will not be available in the main Table
- After: the Data Quality rule check is done after filling the main Table of the Silver or Gold layer - the rows which doesn't respect the rule will be available in the main Table with a flag that indicates the rule is not respected
- This option will be ready in the future. Please don't use it.
- Continue on failure: checkbox to decide if the data load continues if the Data Quality rule is not respected
- Logging: checkbox to decide if the Data Quality rule unrespect will be looged or not
Then click on the SAVE button:
- The new Data Quality Rule appears, and a Grey icon indicates there is a Data Quality rule set
- A notification confirms the correct creation:
tdb
Demonstration video