Discover a Snowflake database

Discover a Snowflake database

To discover a Snowflake database with the Discovery Companion, please first prepare the source YAML file with the following:

  • The specifications to access the source system
  • The specifications for the output file

 

Here is an example:

  • A Snowflake database and schema named TRAINING_DATABASE.AW2017
  • A local output folder for the Discovery JSON file is named outputs.
    The complete path is: 
    ./outputs/snowflake_discovery_output.json
source:
  type: snowflake
  config:
    store_last_usage_extraction_timestamp: false # To disabled to avoid a warning
    match_fully_qualified_names: true # To enabled to precise database.schemas for schema_pattern
    
    # Coordinates
    account_id: "XXXXXXX"
    warehouse: "TRAINING_WH"
    schema_pattern: {'allow': ['TRAINING_DATABASE.AW2017'], 'deny': [], 'ignoreCase': True}

    # Credentials
    username: "training"
    password: "training"
    role: "sysadmin"
    
sink:
  type: file
  config:
    filename: ./outputs/snowflake_discovery_output.json

The output folder in your source YAML file should exist.

You can download this YAML file example here or create a .yaml file with the previous example and then adapt it:

  • The Snowflake account ID (XXXXXXX in the example)
  • The Snowflake Warehouse name (TRAINING_WH in the example)
  • The schema_pattern: database and schema names (TRAINING_DATABASE.AW2017 in the example)
  • The username (training in the example)
  • The password (training in the example)
  • The output path

Then, you can use it in the Discovery Companion.

All possible configurations are described on the DataHub official website.