Skip to content
  • There are no suggestions because the search field is empty.

BG_ID

Applies to
Platform: Microsoft SQL Server · Snowflake · Databricks · Fabric Lakehouse · Fabric Warehouse · Oracle

BG_ID is the surrogate key of an increment table. The increment table holds the values that limit the loads of a model object, one row per load or per range.

Objects that carry it

The increment table of Stage, the satellite types except the Record Tracking satellites, PIT, Business PIT, Fact and Mart Fact. The generator creates this table, named <target table>_Increment, when the object uses an incremental load or a Partition Filter. Objects without either have no increment table and no BG_ID. You do not map it; the generator fills it. Snowflake dbt and Databricks dbt have no increment table.

Value

With Increment Management Type Auto, each load that reads new rows adds one row with a new number. With User, each range you insert is a row with its own number. The mechanism depends on the platform:

  • Microsoft SQL Server, Snowflake, Databricks, Oracle: an identity column of the table.
  • Fabric Warehouse: the loader adds a row number to the highest value in the table. A row that you insert yourself needs its own value, for example the highest BG_ID plus 1.
  • Fabric Lakehouse: the loader derives the value from the load time and a generated row ID. A row that you insert yourself needs its own value above the highest BG_ID. The loads use the rows in the order of BG_ID.

The row also holds BG_LoadTimestamp, BG_DataflowName, BG_DataflowSetName and the filter value of the load, for example the highest BG_IncrementalFilter. With Auto, the deployment inserts one row per dataflow and dataflow set, numbered from 1, with the load timestamp 1900-01-01 and no filter value.

Data type

  • Microsoft SQL Server, Fabric Warehouse: int
  • Oracle: NUMBER
  • Snowflake: INTEGER
  • Databricks, Fabric Lakehouse: long

Example

A Satellite on Microsoft SQL Server loads incrementally on UPDATE_DATE. After loads at 10:00 and 11:00 UTC its table RDV_SAT_load_incremental_sat_Increment holds:

BG_ID  BG_LoadTimestamp  BG_DataflowName  BG_DataflowSetName
1      1900-01-01 00:00  Dataflow1        Set1
2      2026-10-27 10:00  Dataflow1        Set1
3      2026-10-27 11:00  Dataflow1        Set1
BG_ID  BG_IncrementalFilter
1      NULL
2      2026-10-01 00:00
3      2026-10-02 00:00

Related articles