Databricks - Datamart - 1.10

In this article, we will explain the architecture layer of the Databricks - Datamart Generator version 1.10.

You can consult Understand the Generator Configuration to better understand what's in a Generator.

Target Layers

In this configuration, the following Target Layers are available:

• Source
  • Linked

• Gold
  • Data Mart

More information here: Understand the Layering concept.

Model Object Types

In this configuration, the following Model Object Types can be used:

• Source Layer:
  • Only Linked Model Objects

• Datamart Layer:
  • Mart Composite
  • Mart Dimension
  • Mart Fact
  • Mart Hierarchy Flatten

Project Properties

In this configuration, the following Properties are available on a Project:

• Push view to repo
• Notebook Deployment Objects Limit
• Deployment Options
• Begin of Universe
• End of Universe
• Delta Detection- tbd
• Hash algorithm
• Target Object Comment Type- tbd
• Unity Catalog
• Configure Load Control
• Deploy Load Control
• Load Control Options
• Logging Method

Target environment

For this configuration, we proposed the following possible target environment:

• Databricks - Target environment
• Databricks Unity - Target environment