Discovery Application Release - 1.2.0

New Features

  • AWS S3 Discovery: Added support for discovering data in AWS S3 storage.
  • AWS CSV Discovery: Added support for discovering CSV files in AWS environments.
  • Version Number Integration: Integrated version number generation into output files for better tracking and management.

Bug Fixes

  • Oracle Discovery:
    • Fixed precision issues for numeric values in Oracle discoveries.
    • Resolved an issue with duplicate rows appearing in Oracle discovery results.
    • Replaced `data_length` with `char_length` for more accurate data type handling.
    • Special handling was added for timestamp data types in Oracle discoveries.
    • Fixed hardcoded schema issues for enhanced query flexibility.
  • Snowflake Discovery:
    • Implemented a separate query to retrieve primary key columns for better performance in Snowflake discoveries.
    • Updated Snowflake discovery to execute a single query for fetching all columns across tables, improving performance.
    • Changed schema filtering from `LIKE` to `EQUAL` for more precise schema matching.
  • Parquet Discovery: Renamed, reordered, and centralized file path types for all Parquet discoveries, improving consistency.

Technical Improvements

  • Logging System Refactor: Refactored the app's messaging system to integrate with a new logging implementation, enhancing error tracking and monitoring.
  • Serilog Integration: Added Serilog as the application's logging provider, enabling structured logging and better handling errors, warnings, and informational/debug messages.

 

Download it here.