Ignore Downstream Dependencies (Dataflow Model Object)
Applies to
Platform: Snowflake
Ignore Downstream Dependencies (IgnoreDownstreamDependencies) removes a dataflow from the stage-driven task of its source model object. Set it when a source should not start the load of a target model object in Stage-Driven Tasks.
Only the native Snowflake generator configurations offer the property; Snowflake dbt does not. It has an effect only with the LoadControl Option Stage-Driven Tasks.
Where to set it
The property belongs to one source model object of one dataflow.
- Open Manage Term Mappings of the target model object.
- Open the menu of the source model object and choose Edit Dataflow Model Object.
- Select Ignore Downstream Dependencies and save.
Values and default
false(default): the stage-driven task of the source calls the loader of the target model object.true: the stage-driven task of the source does not call it.
Effect on generated output
- In
LoadControl\snowflake_stage_driven_tasks.sql, the task that starts from the source no longer calls the loader of the target model object. - If every source of a model object ignores downstream dependencies, no stage-driven task loads the object.
- Depending Tasks, Near-Realtime Tasks and Airflow ignore the property.
Example
A Satellite BRANCH loads from the Stage BRANCH only. Ignore Downstream Dependencies is true for the Stage in the dataflow of the Satellite. The task of the Stage then calls these loaders, shortened:
CREATE OR REPLACE TASK LC_STG_ST_BRANCH_TASK
...
CALL <stage database>.<stage schema>.STG_ST_BRANCH_LOADER(...);
CALL <vault database>.<vault schema>.RDV_HUB_BRANCH_LOADER(...);
CALL <mart database>.<mart schema>.DM_MD_BK_NULLABLE_LOADER(...);
...
Without the property, RDV_SAT_BRANCH_LOADER follows RDV_HUB_BRANCH_LOADER. The Satellite has no other source, so no stage-driven task loads it. Its task LC_RDV_SAT_BRANCH_TASK in Depending Tasks is unchanged.
Related articles
- Previous: Edit a Dataflow Model Object
- Reference: LoadControl Options (Project)
- See also:
- Snowflake: Load data - Native Load Control