The Generated Artifacts zip file contains files with placeholders for the target environment parameters.
You should replace all the placeholders to deploy to Microsoft Fabric Target System.
Replace the Placeholders
A toolkit is provided in the generated artifacts to replace the placeholders.
It is composed of a Powershell script to execute: replace_placeholders.ps1.
To execute commands with Powershell later in this article, please use at least version 7 provided by Microsoft. If you would like to install the latest version, please check here.
The process to follow is:
- Update the replacement_config.json file with your values:
- Insert the value to replace into the value node
- Each database_name is filled by default with the layer name (example: rawvault)
- It should contain the database name of the target lakehouse
- In our example, we want to create the target tables in the lakehouse bglakehouse1
- It should contain the database name of the target lakehouse
- Each database_directory placeholder must be empty, it is not needed for Microsoft Fabric
- Each file_path placeholder should contain the path where the Source Parquet files are available.
-
- If you are using our Microsoft Fabric environment example, you can copy the path by:
- Opening the Lake House (bglakehouse1 in our example) in the left menu:
- Opening the Context menu of the Files folder and choosing the Properties entry:
- Copying the ABFS path:
- Add at the end your folder structure for each source as for the Creditcard source data:
- They are stored inside the Files folder on the path Parquet
- The ABFS path of the Files folder is abfss://bgfabricworkspace1@onelake.dfs.fabric.microsoft.com/bglakehouse1.Lakehouse/Files
- The file_path to fill in the replacement_config.json file for the credit card source is: abfss://bgfabricworkspace1@onelake.dfs.fabric.microsoft.com/bglakehouse1.Lakehouse/Files/Parquet/
- They are stored inside the Files folder on the path Parquet
- Opening the Lake House (bglakehouse1 in our example) in the left menu:
- If you are using our Microsoft Fabric environment example, you can copy the path by:
All the paths should have a slash appended at the end: abfss://bgfabricworkspace1@onelake.dfs.fabric.microsoft.com/bglakehouse1.Lakehouse/Files/Parquet/
Depending on your load control environment:
- If you plan to use a native loaded control using multi-threading load, please update the execution_dependencies_file_path placeholder with the path that contains the dependencies file
- In our example, it is abfss://bgfabricjdbc@onelake.dfs.fabric.microsoft.com/bglakehousejdbc.Lakehouse/Files/Dependencies/
Replace the placeholders in the files:
- Open Windows Powershell (or equivalent) in the replace_placeholders.ps1 location:
- Execute the following command :
-
.\replace_placeholders.ps1
- You should have a similar result:
- You should have a similar result:
- The configured values in all generated artifacts replaced the placeholders
- You can now use these files and deploy your Target system
Some parameters can be added to the replace_placeholders.ps1 command.
All are described and available by executing:
.\replace_placeholders.ps1 - help
The -ReplacementConfigPath parameter mainly permits using a replacement_config.json file in another path. It is beneficial when you are in a development mode for your project.
Example of usage:
.\replace_placeholders.ps1 -ReplacementConfigPath "C:\TEMP\Replacement config files\replacement_config_