Use Sequential Dataflow Execution (Model Object)
Applies to
Platform: Databricks · Fabric Lakehouse
Use Sequential Dataflow Execution (UseSequentialDataflowExecution) decides whether the dataflow loaders of an object run in sequence or in parallel. It matters only for model objects with more than one dataflow.
The dbt generators do not offer the property.
Where to set it
Set the property when you edit a model object of a type with dataflow loaders: Store Entity, Entity, Fact, Mart Dimension, Mart Fact, the Hub, Link and Satellite types of Data Vault, and Reference Table. Stage, the composite types and PIT do not offer it.
Values and default
true(default): the load control runs the dataflow loaders of the object one after another.false: the load control may run them in parallel.
A model object with one dataflow has a single loader, so the value has no effect on it. Parallel loaders can be faster. Because they write into the same table, they can need a distinct partition for each dataflow, set with Optimization Method and Optimization Method Columns.
Related articles
- Reference: Optimization Method (Model Object), Optimization Method Columns (Model Object)
- See also:
- Databricks: Load data - Native Load Control
- Fabric Lakehouse: Load data - Native Load Control