Create a Stage
A Model Object of type Stage can be created in the Bronze Layer.
What is a Stage
A Stage represents a source object in the target architecture. Therefore, a Stage is created for each source object accessed in the Data Warehouse (DWH).
Creation steps
There are three possibilities to create a Stage Model Object:
- Create the Stage Model Objects at the same time as the Source Model Objects:
- Recommended possibility
- Create a Model Object with the Wizard:
- Recommended possibility
- Use the Wizard Create a Stage from a Source that contains the following steps:
- Create a Model Object manually:
- Not recommended possibility
- Create a Model Object of type Stage in the Bronze Layer
- Create a Dataflow Set
- Add a Model Object to the Dataflow Set: add the Source Model Object
- Auto-map the Source Terms: select the auto-map mode and auto-map all the Source Terms to create the Target Terms and map them to the Source Terms
If a Business Key is defined in the Source Model Object, the same key will also be defined in the Stage Model Object when you you use auto-mapping.
If you used the Wizard and your Source Model Object was a file, the Stage name may, by default, include the extension of the file such as CreditCard.parquet, for example.
Please remove the extension and rename the Stage object to CreditCard (in this example).
Properties
A Stage Model Object can be customized using the following Properties:
-
Deduplication Method or Optimization Method (Only for Spark Generator)
- Deduplication Partition or Optimization Method Columns (Only for Spark Generator)
- File format (Only for Spark Generator)
Default Terms
A Stage Model Object will include the following Default Terms: