Discover Parquet or Delta files on OneLake

Please first read how to use the Discovery Application.

Discover Parquet or Delta files

To discover Parquet or Delta files on OneLake with the Discovery Application, please choose the following source system type:

Then fill in the following information:

• Name: discovery name
  • Example: Parquet_AW2019_OneLake
• Workspace: Microsoft Fabric workspace name
  • Example: bgDocumentation

• Authentication Type: 
  
  
  • Example: Default Azure Credential
• Tenant ID: only when you select authentication type = Service Principal 
  • Example: 3574bfa7-4f2a-...................-e9911c8e8c5e
• Service Principal Client ID: only when you select authentication type = Service Principal
  • Example: 6ceb9535-..............................-0773b6485451
• Service Principal Client Secret: only when you select authentication type = Service Principal 
  • Example: N5x8Q~78k9..............................................Q_T~Jcs3

• File Path Type:
  
  
  • Directory With Multiple Entities (Delta or Parquet): select this option if you want to discover several entities (Parquet or Delta) contained in the OneLake folder:
    • Example of 6 entities in a Files > Parquet folder:
      
      
    • Each entity folder contains the file to discover:
      
  • Folder for a Single Entity (Delta or Parquet): select this option to discover a folder containing all the Parquet or Delta files concerning an Entity:

• • • Example of 1 entity Customer with multiple Parquet files stored by partition (date):
      

• • Single File (Parquet only): select this option if you want to discover a single Parquet file
    
    • Example of a single Parquet file:
      
  • File Path (starting with {your-lakehouse}.lakehouse): according to the File Path Type selected, fill:

• • • Directory With Multiple Entities (Delta or Parquet): the path to the folder containing all the entity's folders
      
      • Example: bg_lakehouse_doc.Lakehouse/Files/Parquet

• • • Folder for a Single Entity (Delta or Parquet): the path to the folder containing all the entity files
      
      • Example: bg_lakehouse_doc.Lakehouse/Files/Parquet/CreditCard_partition
    • Single File (Parquet only): the path to the single file
      
      • Example: bg_lakehouse_doc.Lakehouse/Files/Parquet/CreditCard