No incremental load with a Deduplication (Business Rule)
Applies to
Platform: Microsoft SQL Server · Snowflake · Snowflake dbt · Databricks · Databricks dbt · Fabric Lakehouse · Fabric Warehouse · Oracle
Architecture: Stage · Data Mart
This business rule checked whether a model object with incremental load also has the deduplication method Distinct. Generator 1.8 and later no longer check this rule. Up to Generator 1.7, such a model object got warning ID-10029.
Since Generator 1.8, warning ID-10047 reports a deduplication method on a Stage instead, see No deduplication for Stage objects (Business Rule).
Former message
The message named the model object and its type in place of <model object name> and <type>:
Model object has deduplication method 'distinct' in combination with incremental load configured. Model object '<model object name>' of type '<type>' has deduplication method 'Distinct' and incremental load configured. This might lead to unexpected results. Consider using a Composite Model Object for deduplication.
Related articles
- Reference: Deduplication Method (Dataflow)
- See also: No deduplication for Stage objects (Business Rule), Understand warnings and errors