--- title: Databricks dbt - DataVault description: Databricks dbt - DataVault generates a Stage, Raw Vault and Business Vault for Databricks as a dbt project. --- [Skip to content](https://knowledge.bigenius-x.com/databricks-dbt-datavault#main-content) [Contact us](https://knowledge.bigenius-x.com/kb-tickets/new?hsLang=en) [Go to Customer Portal](https://knowledge.bigenius-x.com/customer-portal?hsLang=en) [![TRI\_Logo\_biGENIUS\_2020\_RGB\_s](https://knowledge.bigenius-x.com/hs-fs/hubfs/Marketing/TRI_Logo_biGENIUS_2020_RGB_s.png?width=150&height=42&name=TRI_Logo_biGENIUS_2020_RGB_s.png)](https://www.bigenius-x.com/) Open main navigation Close main navigation - [Contact us](https://knowledge.bigenius-x.com/kb-tickets/new) - [Go to Customer Portal](https://knowledge.bigenius-x.com/customer-portal) How can we help you? - There are no suggestions because the search field is empty. 1. [biGENIUS-X Knowledge Base](https://knowledge.bigenius-x.com/?hsLang=en) 2. [Generators](https://knowledge.bigenius-x.com/generators?hsLang=en) 3. [Databricks](https://knowledge.bigenius-x.com/generators?hsLang=en#databricks) # Databricks dbt - DataVault **Applies to** Platform: Databricks dbt Architecture: Data Vault Databricks dbt - DataVault generates a Stage, Raw Vault and Business Vault for Databricks as a dbt project. Select it in Project Settings, where Generator Configuration shows `Databricks Dbt DataVault`, when you load your Data Vault with dbt on Databricks. This article lists what the configuration supports and where it differs from [Databricks - DataVault](https://knowledge.bigenius-x.com/databricks-datavault-2.0?hsLang=en). The configuration offers no load control, no deployment scripts and no data quality checks. The full list of features that are not available is under [Capabilities and limitations](https://knowledge.bigenius-x.com/databricks-dbt-datavault#capabilities-and-limitations). ### Scope and output - Platform: Databricks with Unity Catalog. The configuration is available since Generator 2.2; Generator 2.1 contained a preview. - Layers: Source, Stage, Raw Vault and Business Vault. See [Understand the Layering concept](https://knowledge.bigenius-x.com/understand-the-layering-concept?hsLang=en). - Output: one dbt project with SQL models, model YAML files and macros, described in [dbt - Artifacts](https://knowledge.bigenius-x.com/dbt-artifacts?hsLang=en). dbt creates and loads the tables, see [dbt - Deployment](https://knowledge.bigenius-x.com/dbt-deployment?hsLang=en). ### Prerequisites - A Databricks workspace with Unity Catalog, dbt Core with the adapter dbt-databricks, and a connection profile, as described in [Databricks dbt - Target environment](https://knowledge.bigenius-x.com/databricks-dbt-target-environment?hsLang=en). dbt 2 is not supported with Databricks dbt. - The values in `dbt_project.yml`, listed in [dbt - Placeholder values](https://knowledge.bigenius-x.com/dbt-placeholder-values?hsLang=en). ### Sources and linked projects Source systems have the type `Spark`, as with Databricks - DataVault. To create source model objects from Unity Catalog tables, see [Discover a Databricks Unity Catalog](https://knowledge.bigenius-x.com/discover-a-databricks-unity-catalog?hsLang=en). You can [export this project as a linked project](https://knowledge.bigenius-x.com/export-a-project-to-be-used-as-linked-project?hsLang=en), for example for a project with the configuration `Databricks Dbt DataMart`. With Create Result Views on, the export names each object by its result view, for example `RDV_HUB_common_customer_Result`. With it off, the export names the table, `RDV_HUB_common_customer`. The dbt models carry the same names in lower case. ### Supported model objects #### Source and Stage - [Source](https://knowledge.bigenius-x.com/create-a-source?hsLang=en) - [Stage](https://knowledge.bigenius-x.com/create-a-stage?hsLang=en) #### Raw Vault - [Hub](https://knowledge.bigenius-x.com/create-a-hub?hsLang=en) - [Link](https://knowledge.bigenius-x.com/create-a-link?hsLang=en) - [Satellite](https://knowledge.bigenius-x.com/create-a-satellite?hsLang=en) - [Link Satellite](https://knowledge.bigenius-x.com/create-a-link-satellite?hsLang=en) - [Multi-Active Satellite](https://knowledge.bigenius-x.com/create-a-multi-active-satellite?hsLang=en) - [Same As Link](https://knowledge.bigenius-x.com/create-a-same-as-link?hsLang=en) - [Hierarchical Link](https://knowledge.bigenius-x.com/create-a-hierachical-link?hsLang=en) - [Driving Key Link](https://knowledge.bigenius-x.com/create-a-driving-key-link?hsLang=en) - [Record Tracking Satellite](https://knowledge.bigenius-x.com/create-a-record-tracking-satellite?hsLang=en) - [Effectivity Satellite](https://knowledge.bigenius-x.com/create-an-effectivity-satellite?hsLang=en) - [Record Tracking Link Satellite](https://knowledge.bigenius-x.com/create-a-record-tracking-link-satellite?hsLang=en) - [Effectivity Link Satellite](https://knowledge.bigenius-x.com/create-an-effectivity-link-satellite?hsLang=en) - [Non-Historized Link Satellite](https://knowledge.bigenius-x.com/create-a-non-historized-link-satellite?hsLang=en) - Non-Historized Satellite (no article yet), since Generator 2.4 - [PIT](https://knowledge.bigenius-x.com/create-a-pit?hsLang=en) - [Reference Table](https://knowledge.bigenius-x.com/create-a-reference-table?hsLang=en) - [RawVault Composite](https://knowledge.bigenius-x.com/create-a-raw-vault-composite?hsLang=en) - [Current View](https://knowledge.bigenius-x.com/create-a-current-view?hsLang=en) - [History View](https://knowledge.bigenius-x.com/create-a-history-view?hsLang=en) #### Business Vault - [Business Hub](https://knowledge.bigenius-x.com/create-a-business-hub?hsLang=en) - [Business Link](https://knowledge.bigenius-x.com/create-a-business-link?hsLang=en) - [Business Satellite](https://knowledge.bigenius-x.com/create-a-business-satellite?hsLang=en) - [Business Link Satellite](https://knowledge.bigenius-x.com/create-a-business-link-satellite?hsLang=en) - [Same As Business Link](https://knowledge.bigenius-x.com/create-a-same-as-business-link?hsLang=en) - [Hierarchical Business Link](https://knowledge.bigenius-x.com/create-a-hierarchical-business-link?hsLang=en) - [Business Driving Key Link](https://knowledge.bigenius-x.com/business-driving-key-link?hsLang=en) - [Effectivity Business Satellite](https://knowledge.bigenius-x.com/create-an-effectivity-business-satellite?hsLang=en) - [Record Tracking Business Link Satellite](https://knowledge.bigenius-x.com/create-a-record-tracking-business-link-satellite?hsLang=en) - [Effectivity Business Link Satellite](https://knowledge.bigenius-x.com/create-an-effectivity-business-link-satellite?hsLang=en) - [Non-Historized Business Link Satellite](https://knowledge.bigenius-x.com/create-a-non-historized-business-link-satellite?hsLang=en) - Non-Historized Business Satellite (no article yet), since Generator 2.4 - [Business PIT](https://knowledge.bigenius-x.com/create-a-business-pit?hsLang=en) - [BusinessVault Composite](https://knowledge.bigenius-x.com/create-a-business-vault-composite?hsLang=en) - [Business Current View](https://knowledge.bigenius-x.com/create-a-business-current-view?hsLang=en) - [Business History View](https://knowledge.bigenius-x.com/create-a-business-history-view?hsLang=en) - [Hierarchy Flatten](https://knowledge.bigenius-x.com/create-a-hierachy-flatten?hsLang=en) - [Vault Out](https://knowledge.bigenius-x.com/create-a-vault-out?hsLang=en) ### Capabilities and limitations - Loading: dbt runs the models in the order of their references. A model object with more than one dataflow gets one loader model per dataflow. - Incremental reads: a model reads only new source rows when `BG_IncrementalFilter` is mapped to the source's `BG_LoadTimestamp`, see [Configure an incremental load](https://knowledge.bigenius-x.com/configure-an-incremental-load?hsLang=en). - Keys: the model YAML files declare primary keys, unique constraints on business keys and, with [Foreign Key Mode](https://knowledge.bigenius-x.com/foreign-key-mode-model-object?hsLang=en) `Create Disabled` (default), foreign keys. Foreign Key Mode offers `None` and `Create Disabled`. - Hashes: [Hash Algorithm](https://knowledge.bigenius-x.com/hash-algorithm-project?hsLang=en) offers only `SHA-256`. Hash keys and row hashes have the data type `Binary`. - Data quality: data quality checks are not available. Manage Data Quality is greyed out in the menu of the model objects. - Reference Table: the table has no unknown-member row. Implementation Type offers these values per model object type: - Hubs, Links, all satellite types and Reference Table: `Permanent` - PIT and Business PIT: `Permanent` or `Cached` - Stage: `Cached` (default) or `Virtual` - RawVault Composite, BusinessVault Composite and Vault Out: `Cached` or `Virtual` (default) - Hierarchy Flatten: `Cached` - Current View, History View and their Business counterparts: `Virtual` These properties of Databricks - DataVault are not available: - Model object: [Load Caching](https://knowledge.bigenius-x.com/load-caching-model-object?hsLang=en), Use Embryo Loader (see [Embryo Loader](https://knowledge.bigenius-x.com/embryo-loader?hsLang=en)), Increment Management Type, [Use Sequential Dataflow Execution](https://knowledge.bigenius-x.com/use-sequential-dataflow-execution-model-object?hsLang=en) - Project: [Configure LoadControl](https://knowledge.bigenius-x.com/configure-loadcontrol-project?hsLang=en), [Deploy LoadControl](https://knowledge.bigenius-x.com/deploy-loadcontrol-project?hsLang=en), [LoadControl Options](https://knowledge.bigenius-x.com/loadcontrol-options-project?hsLang=en), [Logging Method](https://knowledge.bigenius-x.com/logging-method-project?hsLang=en), [Deployment Options](https://knowledge.bigenius-x.com/deployment-options-project?hsLang=en), [Notebook Deployment Objects Limit](https://knowledge.bigenius-x.com/notebook-deployment-objects-limit-project?hsLang=en), [Use Unity Catalog](https://knowledge.bigenius-x.com/unity-catalog-project?hsLang=en) ### Project properties Project Settings shows these properties in the groups Governance, Hashing, Historization and Implementation, with their defaults: - [Apply Sensitivity Level Tags](https://knowledge.bigenius-x.com/apply-sensitivity-level-tags-project?hsLang=en): off - [Sensitivity Level Tag Name](https://knowledge.bigenius-x.com/sensitivity-level-tag-name-project?hsLang=en): `sensitivity_level` - [Hash Algorithm](https://knowledge.bigenius-x.com/hash-algorithm-project?hsLang=en): `SHA-256` - [Hash Casing](https://knowledge.bigenius-x.com/hash-casing-project?hsLang=en): `None`; also `Upper` and `Lower` - [Hash Concatenation Separator](https://knowledge.bigenius-x.com/hash-concatenation-separator-project?hsLang=en): `_` - [Hash Null Placeholder](https://knowledge.bigenius-x.com/hash-null-placeholder-project?hsLang=en): `_NULL_` - [Hash Trim](https://knowledge.bigenius-x.com/hash-trim-project?hsLang=en): off - [Begin of Universe](https://knowledge.bigenius-x.com/begin-of-universe-project?hsLang=en): `1900-01-01` - [End of Universe](https://knowledge.bigenius-x.com/end-of-universe-project?hsLang=en): `9999-12-31` - [Persist Validity](https://knowledge.bigenius-x.com/persist-validity-project?hsLang=en): on - [Behaviour for Nulled Business Keys in Links](https://knowledge.bigenius-x.com/behaviour-for-nulled-business-keys-in-links?hsLang=en): `Nulled Business Keys Point to Non-Existing Hub Key` - [Create Result Views](https://knowledge.bigenius-x.com/create-result-views-project?hsLang=en): off - [Target Object Comment Type](https://knowledge.bigenius-x.com/target-object-comment-type-project?hsLang=en): `None`; also `Tables and Views` - [Use Unique Constraints](https://knowledge.bigenius-x.com/use-unique-constraints-project?hsLang=en): on Model object properties: [Deduplication Method](https://knowledge.bigenius-x.com/deduplication-method-model-object?hsLang=en), [Sort Order within Partition](https://knowledge.bigenius-x.com/deduplication-partition-model-object?hsLang=en), [Implementation Type](https://knowledge.bigenius-x.com/implementation-type-model-object?hsLang=en), [Version Valid From Term](https://knowledge.bigenius-x.com/validfrom-source-term-dataflow-model-object?hsLang=en), [Delete Detection Method](https://knowledge.bigenius-x.com/delete-detection-method?hsLang=en), Foreign Key Mode, [Custom Singleton Values](https://knowledge.bigenius-x.com/custom-singleton-values-model-object?hsLang=en), [File Format](https://knowledge.bigenius-x.com/file-format-model-object?hsLang=en) (`delta`), [Optimization Method](https://knowledge.bigenius-x.com/optimization-method-model-object?hsLang=en), [Optimization Method Columns](https://knowledge.bigenius-x.com/optimization-method-columns-model-object?hsLang=en), [Driving Key](https://knowledge.bigenius-x.com/driving-key-relationship?hsLang=en), [Calculate Effectivity End From Begin](https://knowledge.bigenius-x.com/calculate-effectivity-end-from-begin-model-object?hsLang=en) and [Excluded from Delta Detection](https://knowledge.bigenius-x.com/excluded-from-delta-detection-model-object?hsLang=en). ### Platform differences Compared with Databricks - DataVault of the same release: - Output: a dbt project with SQL models instead of PySpark notebooks and deployment scripts. - Loading: dbt runs the models; there is no load control and no Apache Airflow option. - Create Result Views: off by default; on by default in Databricks - DataVault. - Target Object Comment Type: no value `Tables`. - Unity Catalog: always used; Databricks - DataVault has the property Use Unity Catalog. ### Example A Hub `common_customer` with the business key term `CUSTOMER_ID` gives the models `rdv_hub_common_customer_source` and `rdv_hub_common_customer`. The excerpt of `models/rawvault/models_rawvault.yml` declares its keys: ``` - name: rdv_hub_common_customer constraints: - type: primary_key columns: [hub_hk] name: pk_rdv_hub_common_customer - type: unique columns: [customer_id] name: uc_rdv_hub_common_customer columns: - name: bg_loadtimestamp data_type: Timestamp - name: bg_sourcesystem data_type: String - name: customer_id data_type: Decimal(38,0) - name: hub_hk data_type: Binary ``` The excerpt leaves out descriptions, the `not_null` constraints and `warn_unsupported: false`. With Use Unique Constraints off, the `unique` constraint is left out. ### Release differences Project Settings shows the Generator Version of your project. - Generator 2.2: first release after the preview in Generator 2.1. Compared with the preview: Vault Out; Create Result Views, default off; the incremental read filter on `BG_LoadTimestamp`; primary key and foreign key constraints; loaders for more than one dataflow on all model object types; Reference Tables without an unknown-member row. - Generator 2.3: the catalog and schema of each source system are variables in `dbt_project.yml`; the model object property [Custom Singleton Values](https://knowledge.bigenius-x.com/custom-singleton-values-model-object?hsLang=en), see [Generators Release - 2.3.0](https://knowledge.bigenius-x.com/generators-release-2.3.0?hsLang=en). - Generator 2.4: Non-Historized Satellite and Non-Historized Business Satellite; Excluded from Delta Detection; Use Unique Constraints; the materializations apply the constraints; table columns use the modeled data types. See [Generators Release - 2.4.0](https://knowledge.bigenius-x.com/generators-release-2.4.0?hsLang=en). - Generator 2.4.1: Driving Key Links and Business Driving Key Links with more than one dataflow no longer report the validation warning ID-10065. The generated models stay the same. See [Generators Release - 2.4.1](https://knowledge.bigenius-x.com/generators-release-2.4.1?hsLang=en). ### Related articles - Previous: [Databricks dbt - Target environment](https://knowledge.bigenius-x.com/databricks-dbt-target-environment?hsLang=en) - Next: [Generate artifacts](https://knowledge.bigenius-x.com/generate-artifacts?hsLang=en), [dbt - Placeholder values](https://knowledge.bigenius-x.com/dbt-placeholder-values?hsLang=en), [dbt - Deployment](https://knowledge.bigenius-x.com/dbt-deployment?hsLang=en) - Reference: [dbt - Artifacts](https://knowledge.bigenius-x.com/dbt-artifacts?hsLang=en), [Foreign Key Mode (Model Object)](https://knowledge.bigenius-x.com/foreign-key-mode-model-object?hsLang=en), [Implementation Type (Model Object)](https://knowledge.bigenius-x.com/implementation-type-model-object?hsLang=en), [Create Result Views (Project)](https://knowledge.bigenius-x.com/create-result-views-project?hsLang=en), [Use Unique Constraints (Project)](https://knowledge.bigenius-x.com/use-unique-constraints-project?hsLang=en) - See also: [Available Generator Configurations](https://knowledge.bigenius-x.com/available-generator-configurations?hsLang=en), [Source Systems per Generator Configurations](https://knowledge.bigenius-x.com/source-systems-per-generator-configurations?hsLang=en), [Databricks - DataVault](https://knowledge.bigenius-x.com/databricks-datavault-2.0?hsLang=en), [How biGENIUS-X builds hash values](https://knowledge.bigenius-x.com/how-bigenius-x-builds-hash-values?hsLang=en), [Databricks dbt - Datamart](https://knowledge.bigenius-x.com/databricks-dbt-datamart?hsLang=en), [Databricks dbt - DataVault and Mart](https://knowledge.bigenius-x.com/databricks-dbt-datavault-and-mart?hsLang=en) - [Getting started](https://knowledge.bigenius-x.com/getting-started?hsLang=en#main-content) - [Guidelines](https://knowledge.bigenius-x.com/getting-started?hsLang=en#guidelines) - [Start working](https://knowledge.bigenius-x.com/getting-started?hsLang=en#start-working) - [Account](https://knowledge.bigenius-x.com/getting-started?hsLang=en#account) - [General overview](https://knowledge.bigenius-x.com/general-overview?hsLang=en) - [Artificial Intelligence](https://knowledge.bigenius-x.com/artificial-intelligence?hsLang=en) - [Application Modules](https://knowledge.bigenius-x.com/application-modules?hsLang=en#main-content) - [Administration](https://knowledge.bigenius-x.com/application-modules?hsLang=en#administration) - [Solutions](https://knowledge.bigenius-x.com/application-modules?hsLang=en#solutions) - [Global Features](https://knowledge.bigenius-x.com/application-modules?hsLang=en#global-features) - [Projects](https://knowledge.bigenius-x.com/application-modules?hsLang=en#projects) - [Branches](https://knowledge.bigenius-x.com/application-modules?hsLang=en#branches) - [Data Connections](https://knowledge.bigenius-x.com/application-modules?hsLang=en#data-connections) - [Dataflow Modeling - Overview](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-overview) - [Dataflow Modeling - Wizard Steps](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-wizard-steps) - [Dataflow Modeling - Terms](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-terms) - [Dataflow Modeling - Term Mapping](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-term-mapping) - [Dataflow Modeling - Relationships](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-relationships) - [Dataflow Modeling - Data Quality](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-data-quality) - [Dataflow Modeling - Indexes](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-indexes) - [Relationship Modeling](https://knowledge.bigenius-x.com/application-modules?hsLang=en#relationship-modeling) - [Generate Artifacts](https://knowledge.bigenius-x.com/application-modules?hsLang=en#generate-artifacts) - [Project Settings](https://knowledge.bigenius-x.com/application-modules?hsLang=en#project-settings) - [Data Marketplace](https://knowledge.bigenius-x.com/application-modules?hsLang=en#data-marketplace) - [Generators](https://knowledge.bigenius-x.com/generators?hsLang=en#main-content) - [Fabric Warehouse](https://knowledge.bigenius-x.com/generators?hsLang=en#fabric-warehouse) - [Fabric Lakehouse](https://knowledge.bigenius-x.com/generators?hsLang=en#fabric-lakehouse) - [Databricks](https://knowledge.bigenius-x.com/generators?hsLang=en#databricks) - [Snowflake](https://knowledge.bigenius-x.com/generators?hsLang=en#snowflake) - [Microsoft SQL Server](https://knowledge.bigenius-x.com/generators?hsLang=en#microsoft-sql-server) - [Oracle](https://knowledge.bigenius-x.com/generators?hsLang=en#oracle) - [Artifacts](https://knowledge.bigenius-x.com/generators?hsLang=en#artifacts) - [Replace Placeholders](https://knowledge.bigenius-x.com/generators?hsLang=en#replace-placeholders) - [Target solution environment](https://knowledge.bigenius-x.com/generators?hsLang=en#target-solution-environment) - [Deployment](https://knowledge.bigenius-x.com/generators?hsLang=en#deployment) - [Deployment with an Azuze DevOps pipeline](https://knowledge.bigenius-x.com/generators?hsLang=en#deployment-with-an-azuze-devops-pipeline) - [Delta Deployment](https://knowledge.bigenius-x.com/generators?hsLang=en#delta-deployment) - [Load control environment](https://knowledge.bigenius-x.com/generators?hsLang=en#load-control-environment) - [Load data with a native load control](https://knowledge.bigenius-x.com/generators?hsLang=en#load-data-with-a-native-load-control) - [Load data with Apache Airflow](https://knowledge.bigenius-x.com/generators?hsLang=en#load-data-with-apache-airflow) - [Model Object Type](https://knowledge.bigenius-x.com/generators?hsLang=en#model-object-type) - [Properties](https://knowledge.bigenius-x.com/generators?hsLang=en#properties) - [Default Terms](https://knowledge.bigenius-x.com/generators?hsLang=en#default-terms) - [Discovery application](https://knowledge.bigenius-x.com/discovery-application?hsLang=en#main-content) - [Discovery configurations](https://knowledge.bigenius-x.com/discovery-application?hsLang=en#discovery-configurations) - [Best practices](https://knowledge.bigenius-x.com/best-practices?hsLang=en#main-content) - [Modeling Approaches](https://knowledge.bigenius-x.com/best-practices?hsLang=en#modeling-approaches) - [Use Cases](https://knowledge.bigenius-x.com/best-practices?hsLang=en#use-cases) - [Business Rules](https://knowledge.bigenius-x.com/best-practices?hsLang=en#business-rules) - [Data Quality Rules](https://knowledge.bigenius-x.com/best-practices?hsLang=en#data-quality-rules) - [FAQs](https://knowledge.bigenius-x.com/faqs?hsLang=en) - [Product Release Notes](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#main-content) - [SaaS Application](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#saas-application) - [Discovery application](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#discovery-application) - [Generators](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#generators) - [Legal Documents](https://knowledge.bigenius-x.com/legal-documents?hsLang=en#main-content) - [Current legal docs](https://knowledge.bigenius-x.com/legal-documents?hsLang=en#current-legal-docs) - [Software Product and Limits](https://knowledge.bigenius-x.com/legal-documents?hsLang=en#software-product-and-limits) - [Contact us](https://knowledge.bigenius-x.com/kb-tickets/new?hsLang=en) - [Customer Portal](https://knowledge.bigenius-x.com/customer-portal) - [Sign in](https://knowledge.bigenius-x.com/_hcms/mem/login) [![biGENIUS logo](https://knowledge.bigenius-x.com/hubfs/TRI_Logo_biGENIUS_2020_RGB-1.svg "biGENIUS logo")](https://www.bigenius-x.com) All rights reserved © 2025, biGENIUS AG