--- title: Core Composite description: A Core Composite prepares data in the Cleanse layer with joins, filters, expressions and aggregations on Stages, Store Entities or other Core Composites. --- [Skip to content](https://knowledge.bigenius-x.com/core-composite#main-content) [Contact us](https://knowledge.bigenius-x.com/kb-tickets/new?hsLang=en) [Go to Customer Portal](https://knowledge.bigenius-x.com/customer-portal?hsLang=en) [![TRI\_Logo\_biGENIUS\_2020\_RGB\_s](https://knowledge.bigenius-x.com/hs-fs/hubfs/Marketing/TRI_Logo_biGENIUS_2020_RGB_s.png?width=150&height=42&name=TRI_Logo_biGENIUS_2020_RGB_s.png)](https://www.bigenius-x.com/) Open main navigation Close main navigation - [Contact us](https://knowledge.bigenius-x.com/kb-tickets/new) - [Go to Customer Portal](https://knowledge.bigenius-x.com/customer-portal) How can we help you? - There are no suggestions because the search field is empty. 1. [biGENIUS-X Knowledge Base](https://knowledge.bigenius-x.com/?hsLang=en) 2. [Generators](https://knowledge.bigenius-x.com/generators?hsLang=en) 3. [Model Object Type](https://knowledge.bigenius-x.com/generators?hsLang=en#model-object-type) # Core Composite **Applies to** Platform: Microsoft SQL Server · Snowflake · Databricks · Fabric Lakehouse · Fabric Warehouse Architecture: Dimensional A Core Composite prepares data in the Cleanse layer with joins, filters, expressions and aggregations on Stages, Store Entities or other Core Composites. Use it for an intermediate result that an Entity, a Fact or another Core Composite reads. By default it is a view; with Implementation Type `Cached` it is a table that each load empties and refills. ### Sources and relationships A Core Composite reads [Stages](https://knowledge.bigenius-x.com/stage?hsLang=en), [Store Entities](https://knowledge.bigenius-x.com/store-entity?hsLang=en) of a linked Data Store project and other Core Composites, in exactly one dataflow. It has no relationships. An [Entity](https://knowledge.bigenius-x.com/entity?hsLang=en), a [Fact](https://knowledge.bigenius-x.com/fact?hsLang=en) or another Core Composite reads its result view. Mart objects of a Dimensional and Mart project do not read it. ### Create a Core Composite - With the wizard: open the menu of a Stage, Core Composite or Store Entity, choose **Automate** and then **Create Core Composite**. Its steps are [Create Model Object](https://knowledge.bigenius-x.com/wizard-step-create-model-object?hsLang=en), [Create Dataflow](https://knowledge.bigenius-x.com/wizard-step-create-dataflow?hsLang=en), [Map Selected Terms](https://knowledge.bigenius-x.com/wizard-step-map-selected-terms?hsLang=en) and [Add to View](https://knowledge.bigenius-x.com/wizard-step-add-to-view?hsLang=en). See [Create a Model Object with the wizard](https://knowledge.bigenius-x.com/create-a-model-object-with-the-wizard?hsLang=en). - Manually: [create a model object](https://knowledge.bigenius-x.com/create-a-model-object?hsLang=en) of type Core Composite in the Dimensional column, [create a dataflow set](https://knowledge.bigenius-x.com/create-a-data-flow-set?hsLang=en), [add the source model objects](https://knowledge.bigenius-x.com/add-a-model-object-into-a-data-flow-set?hsLang=en) and [map the terms](https://knowledge.bigenius-x.com/map-a-source-term-with-a-target-term?hsLang=en). Then add joins, a where clause or expressions to the dataflow sets as the composite needs. ### Properties - [Implementation Type](https://knowledge.bigenius-x.com/implementation-type-model-object?hsLang=en): `Virtual` (default) creates views only, so every query reads the current data of the sources. `Cached` adds a table that the loader empties and refills on every load. - [Deduplication Method](https://knowledge.bigenius-x.com/deduplication-method-dataflow?hsLang=en): `None` (default), `Distinct` or `Partition`, with [Sort Order within Partition](https://knowledge.bigenius-x.com/sort-order-within-partition-dataflow?hsLang=en). A method other than `None` adds a deduplication view. Core Composite terms can be marked as Business Key in Edit Term; with `Partition` and no business key, validation reports a warning. ### Default Terms - [`BG_LoadTimestamp`](https://knowledge.bigenius-x.com/bg_loadtimestamp?hsLang=en): with `Cached`, the loader writes the timestamp of the load. With `Virtual`, the term is NULL unless you map it. - [`BG_SourceSystem`](https://knowledge.bigenius-x.com/bg_sourcesystem?hsLang=en): the source system of the row; empty unless you map it. ### Generated objects These are the names on Microsoft SQL Server for a Core Composite `large_branch`: | Role | Generated name | Purpose | | --- | --- | --- | | Source | `CLS_CC_large_branch_Source` | Joins, filters and maps the sources | | Deduplication | `CLS_CC_large_branch_Deduplication` | Removes duplicate rows | | Loader | `CLS_CC_large_branch_Loader` | Empties and refills the table | | Storage | `CLS_CC_large_branch` | Composite table | | Result | `CLS_CC_large_branch_Result` | View read by the next model object | - All objects are in the Cleanse layer. The loader is a stored procedure; `CLS_CC_large_branch` is a table; all other objects are views. - The deduplication view exists only with a Deduplication Method other than `None`. - The loader and the table exist only with `Cached`. The dependencies are: ``` Virtual: sources -> _Source [-> _Deduplication] -> _Result Cached: sources -> _Source [-> _Deduplication] -> _Loader _Loader -> CLS_CC_large_branch -> _Result ``` ### Example The Core Composite `large_branch` on Microsoft SQL Server keeps only the large branches of the Stage `branch`. It maps `BRANCH_ID`, `BRANCH_NAME` and `MARKET_SIZE`; `BG_LoadTimestamp` is not mapped. Its dataflow set has this where clause, in which `s1` is the alias of the Stage: ``` s1.MARKET_SIZE = 'large' ``` The generated source view ends with: ``` FROM [].[stg].[STG_ST_branch_Result] AS [s1] WHERE [s1].[MARKET_SIZE] = 'large' ``` `` is the Stage database that you set when you [replace the placeholders](https://knowledge.bigenius-x.com/replace-the-placeholders-in-the-artifacts?hsLang=en), and `stg` is the Stage schema of the example. The Stage `branch` holds three branches after load 1 on 2026-10-28 08:00 and two after load 2 on 2026-10-29 08:00: - Load 1: 1 Basel `large`, 2 Bern `small`, 3 Zurich `large`. - Load 2: Zurich is deleted, and Bern changes to `large`. ### Check the result Query the result view, here in the schema `cls`: ``` SELECT BRANCH_ID, BRANCH_NAME, BG_LoadTimestamp FROM cls.CLS_CC_large_branch_Result ORDER BY BRANCH_ID; ``` With the default Implementation Type `Virtual`, after load 1 and after load 2 of the Stage: ``` After load 1 After load 2 BRANCH_ID BRANCH_NAME LoadTs BRANCH_ID BRANCH_NAME LoadTs 1 Basel NULL 1 Basel NULL 3 Zurich NULL 2 Bern NULL ``` With `Cached`, the result changes only when the loader of the Core Composite runs. The loader ran after Stage load 1 on 2026-10-28; this is the result after Stage load 2, before and after the loader runs again on 2026-10-29: ``` Before the loader After the loader BRANCH_ID BRANCH_NAME LoadTs BRANCH_ID BRANCH_NAME LoadTs 1 Basel 2026-10-28 1 Basel 2026-10-29 3 Zurich 2026-10-28 2 Bern 2026-10-29 ``` - The filter excludes Bern in load 1. Zurich is missing after load 2 because the Stage no longer holds it. - A `Virtual` Core Composite follows the Stage at once, because its views read the result view of the Stage. - A `Cached` Core Composite keeps the rows of its last load until its loader runs again; the loader writes its load timestamp to every row. ### Platform differences - Snowflake: names are in capitals, and the table of a `Cached` Core Composite is a transient table. The load control task `LC_CLS_CC__TASK` calls its loader. The dataflow properties [Use Stream](https://knowledge.bigenius-x.com/use-stream-model-object?hsLang=en) and [Warehouse Placeholder Variable Name](https://knowledge.bigenius-x.com/warehouse-placeholder-variable-name-dataflow?hsLang=en) apply. - Databricks and Fabric Lakehouse: the loader is the notebook `CLS_CC__Loader`. The properties [File Format](https://knowledge.bigenius-x.com/file-format-model-object?hsLang=en), [Optimization Method](https://knowledge.bigenius-x.com/optimization-method-model-object?hsLang=en) and [Optimization Method Columns](https://knowledge.bigenius-x.com/optimization-method-columns-model-object?hsLang=en) apply. - Fabric Warehouse: the deployment notebooks create the same objects as on Microsoft SQL Server. Fabric Warehouse is available since Generator 2.2. ### Limitations - A Core Composite has exactly one dataflow, at least one term that is not a Default Term, and no relationships. - An aggregation must be defined in all dataflow sets or in none. - Dataflows between Core Composites must not form a cycle. - A Core Composite keeps no history; it has no validity terms. ### Related articles - Previous: [Stage](https://knowledge.bigenius-x.com/stage?hsLang=en) - Next: [Entity](https://knowledge.bigenius-x.com/entity?hsLang=en), [Fact](https://knowledge.bigenius-x.com/fact?hsLang=en) - Reference: [Implementation Type (Model Object)](https://knowledge.bigenius-x.com/implementation-type-model-object?hsLang=en), [Deduplication Method (Dataflow)](https://knowledge.bigenius-x.com/deduplication-method-dataflow?hsLang=en), [Sort Order within Partition (Dataflow)](https://knowledge.bigenius-x.com/sort-order-within-partition-dataflow?hsLang=en), [BG\_LoadTimestamp](https://knowledge.bigenius-x.com/bg_loadtimestamp?hsLang=en), [BG\_SourceSystem](https://knowledge.bigenius-x.com/bg_sourcesystem?hsLang=en) - See also: [Create a Model Object with the wizard](https://knowledge.bigenius-x.com/create-a-model-object-with-the-wizard?hsLang=en), [Model a Dimensional Solution](https://knowledge.bigenius-x.com/model-a-dimensional-solution?hsLang=en) - [Getting started](https://knowledge.bigenius-x.com/getting-started?hsLang=en#main-content) - [Guidelines](https://knowledge.bigenius-x.com/getting-started?hsLang=en#guidelines) - [Start working](https://knowledge.bigenius-x.com/getting-started?hsLang=en#start-working) - [Account](https://knowledge.bigenius-x.com/getting-started?hsLang=en#account) - [General overview](https://knowledge.bigenius-x.com/general-overview?hsLang=en) - [Artificial Intelligence](https://knowledge.bigenius-x.com/artificial-intelligence?hsLang=en) - [Application Modules](https://knowledge.bigenius-x.com/application-modules?hsLang=en#main-content) - [Administration](https://knowledge.bigenius-x.com/application-modules?hsLang=en#administration) - [Solutions](https://knowledge.bigenius-x.com/application-modules?hsLang=en#solutions) - [Global Features](https://knowledge.bigenius-x.com/application-modules?hsLang=en#global-features) - [Projects](https://knowledge.bigenius-x.com/application-modules?hsLang=en#projects) - [Branches](https://knowledge.bigenius-x.com/application-modules?hsLang=en#branches) - [Data Connections](https://knowledge.bigenius-x.com/application-modules?hsLang=en#data-connections) - [Dataflow Modeling - Overview](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-overview) - [Dataflow Modeling - Wizard Steps](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-wizard-steps) - [Dataflow Modeling - Terms](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-terms) - [Dataflow Modeling - Term Mapping](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-term-mapping) - [Dataflow Modeling - Relationships](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-relationships) - [Dataflow Modeling - Data Quality](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-data-quality) - [Dataflow Modeling - Indexes](https://knowledge.bigenius-x.com/application-modules?hsLang=en#dataflow-modeling-indexes) - [Relationship Modeling](https://knowledge.bigenius-x.com/application-modules?hsLang=en#relationship-modeling) - [Generate Artifacts](https://knowledge.bigenius-x.com/application-modules?hsLang=en#generate-artifacts) - [Project Settings](https://knowledge.bigenius-x.com/application-modules?hsLang=en#project-settings) - [Data Marketplace](https://knowledge.bigenius-x.com/application-modules?hsLang=en#data-marketplace) - [Generators](https://knowledge.bigenius-x.com/generators?hsLang=en#main-content) - [Fabric Warehouse](https://knowledge.bigenius-x.com/generators?hsLang=en#fabric-warehouse) - [Fabric Lakehouse](https://knowledge.bigenius-x.com/generators?hsLang=en#fabric-lakehouse) - [Databricks](https://knowledge.bigenius-x.com/generators?hsLang=en#databricks) - [Snowflake](https://knowledge.bigenius-x.com/generators?hsLang=en#snowflake) - [Microsoft SQL Server](https://knowledge.bigenius-x.com/generators?hsLang=en#microsoft-sql-server) - [Oracle](https://knowledge.bigenius-x.com/generators?hsLang=en#oracle) - [Artifacts](https://knowledge.bigenius-x.com/generators?hsLang=en#artifacts) - [Replace Placeholders](https://knowledge.bigenius-x.com/generators?hsLang=en#replace-placeholders) - [Target solution environment](https://knowledge.bigenius-x.com/generators?hsLang=en#target-solution-environment) - [Deployment](https://knowledge.bigenius-x.com/generators?hsLang=en#deployment) - [Deployment with an Azuze DevOps pipeline](https://knowledge.bigenius-x.com/generators?hsLang=en#deployment-with-an-azuze-devops-pipeline) - [Delta Deployment](https://knowledge.bigenius-x.com/generators?hsLang=en#delta-deployment) - [Load control environment](https://knowledge.bigenius-x.com/generators?hsLang=en#load-control-environment) - [Load data with a native load control](https://knowledge.bigenius-x.com/generators?hsLang=en#load-data-with-a-native-load-control) - [Load data with Apache Airflow](https://knowledge.bigenius-x.com/generators?hsLang=en#load-data-with-apache-airflow) - [Model Object Type](https://knowledge.bigenius-x.com/generators?hsLang=en#model-object-type) - [Properties](https://knowledge.bigenius-x.com/generators?hsLang=en#properties) - [Default Terms](https://knowledge.bigenius-x.com/generators?hsLang=en#default-terms) - [Discovery application](https://knowledge.bigenius-x.com/discovery-application?hsLang=en#main-content) - [Discovery configurations](https://knowledge.bigenius-x.com/discovery-application?hsLang=en#discovery-configurations) - [Best practices](https://knowledge.bigenius-x.com/best-practices?hsLang=en#main-content) - [Modeling Approaches](https://knowledge.bigenius-x.com/best-practices?hsLang=en#modeling-approaches) - [Use Cases](https://knowledge.bigenius-x.com/best-practices?hsLang=en#use-cases) - [Business Rules](https://knowledge.bigenius-x.com/best-practices?hsLang=en#business-rules) - [Data Quality Rules](https://knowledge.bigenius-x.com/best-practices?hsLang=en#data-quality-rules) - [FAQs](https://knowledge.bigenius-x.com/faqs?hsLang=en) - [Product Release Notes](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#main-content) - [SaaS Application](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#saas-application) - [Discovery application](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#discovery-application) - [Generators](https://knowledge.bigenius-x.com/product-release-notes?hsLang=en#generators) - [Legal Documents](https://knowledge.bigenius-x.com/legal-documents?hsLang=en#main-content) - [Current legal docs](https://knowledge.bigenius-x.com/legal-documents?hsLang=en#current-legal-docs) - [Software Product and Limits](https://knowledge.bigenius-x.com/legal-documents?hsLang=en#software-product-and-limits) - [Contact us](https://knowledge.bigenius-x.com/kb-tickets/new?hsLang=en) - [Customer Portal](https://knowledge.bigenius-x.com/customer-portal) - [Sign in](https://knowledge.bigenius-x.com/_hcms/mem/login) [![biGENIUS logo](https://knowledge.bigenius-x.com/hubfs/TRI_Logo_biGENIUS_2020_RGB-1.svg "biGENIUS logo")](https://www.bigenius-x.com) All rights reserved © 2025, biGENIUS AG