Skip to content
  • There are no suggestions because the search field is empty.

Discovery Application Release - 2.0

Highlights

Discovery App Cross-Platform CLI application

In addition to the existing GUI version of the discovery, which is available for Microsoft Windows only, a completely new command line interface application is now available for Windows, Linux and MacOS.

You can now create, manage and execute discoveries on all platforms and even include the biGENIUS Discovery App CLI in automation pipelines running on supported operating systems.

biGENIUS-X Data Marketplace API upload

Both the GUI and CLI versions of the biGENIUS Discovery App are now able to directly upload a generated discovery file to the biGENIUS-X Data Marketplace API. After discovering source information, you can decide to either save the discovery file to your machines, as before, or directly upload it to biGENIUS-X.

 

New Features

  • App / UI

    • Added the display of the last execution time on the recent tab.

    • Implemented new user settings management.

    • Added a new user settings view to the UI.

    • Added the capability to directly upload discovery files to the biGENIUS-X Data Marketplace via its API.

    • Added a check in the UI to ensure source objects are selected before enabling the "Save As" and "Upload" buttons in the source system view.

    • Implemented a uniqueness check for discovery configuration names to ensure they are unique.

  • App / CLI

    • Introduced a new cross-platform Command Line Interface (CLI) application for using the Discovery App on Windows, Linux, and macOS.

    • Implemented new user settings management in the CLI version.

    • Added several commands for creating and executing discoveries using the CLI.

    • Added support for using external configuration files during the creation of discovery configurations via the CLI.

    • Added the capability to directly upload discovery files to the biGENIUS-X Data Marketplace via its API.

  • Discovery File Generation

    • Added the discovery application version to generated discovery files, indicating which version was used for generation.

  • Oracle Discovery

    • Added support for discovering Views in addition to tables.

  • Snowflake Discovery

    • Added a new "SSO Authentication" type for Snowflake discoveries.

  • Unity Catalog – Databricks

    • Implemented missing decimal scale and precision attributes for discovering source system data.

    • Enhanced discovery for Unity Catalog to include tables where the user has metadata access but not read access by adding an additional parameter to the API call.

 

Bug Fixes

  • App / UI
    • Resolved an issue where cancelling a discovery configuration was not working correctly.
    • Fixed several issues where mandatory field indicators were not displayed correctly in the UI.
    • Fixed an issue where the Last Execution Time was not displayed correctly in the UI after restarting the application.
    • Fixed an issue where discovery configurations on the recent tab were incorrectly ordered after cancelling a discovery configuration.

  • CSV – AWS Discovery

    • Fixed an issue where specific file paths were not properly recognized.

  • Microsoft SQL Server Discovery

    • Fixed an issue preventing discovery of source system data from SQL Servers with specific collations.

  • Parquet – Azure Platform Discovery

    • Fixed an issue where the "Directory with multiple entities" file path type used incompatible delta log paths.

    • Fixed an issue causing exceptions during Parquet on Azure discoveries for single files or directories.

  • Snowflake Discovery

    • Corrected the field description for the account identifier in the UI for Snowflake discoveries.

    • Added optional field for Warehouse parameter, which can be used when not default warehouse if configured on snowflake.

  • Unity Catalog – Databricks

    • Fixed an issue occurring when the 'columns' property was missing for a table in the JSON document.

 

Technical Improvements

  • App

    • Updated the data storage implementation from a collection-based approach to single file storage for discovery configurations.

    • Implemented migration and backup procedures to automatically update existing discovery configuration data storage from the collection-based to the new file-based implementation.



You can download this Discovery application release (2.0) here:

 

With version 2 of the biGENIUS Discovery App, we are introducing a new way of storing discovery configurations.

Existing discovery configurations will automatically be migrated to the new structure during the first startup of the UI or the CLI app.

As a redundancy, a backup of existing discovery configurations will be created as well.