Databricks Stage JDBC - Replace the placeholders - 1.4

The Generated Artifacts zip file contains files with placeholders for the target environment parameters.

You should replace all the placeholders to deploy your Databricks Stage JDBC Target System.

Replace the Placeholders

A toolkit is provided in the generated artifacts to replace the placeholders.

It is composed of a Powershell script to execute: replace_placeholders.ps1.

The process to follow is:

• Update the replacement_config.json file with your values:
  
  • Insert the value to replace into the value node
    • The database_directory placeholder should contain the path to create the Target Parquet files.
      • If you are using our Databricks environment example, the path is the one inside the Storage Account chosen to store the Target Data Lake
        abfss://claire-datalake@bgdatabricksdatalake1.dfs.core.windows.net/stage/
        • claire-datalake is the name of the folder we created inside the Storage Account
        • bgdatabricksdatalake1 is the name of the Storage Account itself

• • • The jdbc-url placeholder should contain the JDBC URL to connect to the source through JDBC:
      • If you are using our Databricks environment example, the JDBC URL is the following:
        jdbc:sqlserver://bgsqlserver.database.windows.net:1433;encrypt=true;databaseName=AdventureWorks2019;trustServerCertificate=true;
        
        • bgsqlserver is the name of the Azure SQL Server
        • AdventureWorks2019 is the name of the Azure database
    • The jdbc-user and jdbc-password placeholders should have credentials to connect to the JDBC source.
      • You can enter the user and password directly in plain text, for example:

{
    "name": "databricks1.4.0stagejdbc#adventureworks#jdbc_user",
    "value": "'user_name'",
    "secretname": ""
},
{
    "name": "databricks1.4.0stagejdbc#adventureworks#jdbc_password",
    "value": "'password'",
    "secretname": ""
}

• • • • Or you can use KeyVault to store a secret. In this case, the syntax should be:
        • dbutils.secrets.get(scope='jdbc', key='<name of the secret>') 

• Replace the placeholders in the files:
  • Open Windows Powershell (or equivalent) in the replace_placeholders.ps1 location:
    
  • Execute the following command :

  • .\replace_placeholders.ps1

• • • You should have a similar result:
      
  • The configured values in all generated artifacts replaced the placeholders
  • You can now use these files and deploy your Target system

.\replace_placeholders.ps1 - help

.\replace_placeholders.ps1 -ReplacementConfigPath "C:\TEMP\Replacement config files\replacement_config_