Skip to main content

Module reference

Module reference 

Source
Expand description

Reference table source trait and refresh modes. Reference table source trait and refresh modes.

A ReferenceTableSource populates a reference/dimension table from an external connector. The source produces an initial snapshot (one or more RecordBatches) followed by an optional stream of incremental changes.

RefreshMode controls how and when the table is refreshed:

  • SnapshotOnly — load once at startup, never update.
  • SnapshotPlusCdc — load at startup, then apply CDC changes.
  • Periodic — re-snapshot on a timer.
  • Manual — no automatic loading; the user triggers refreshes.

Structs§

MockReferenceTableSource
A mock ReferenceTableSource for testing.

Enums§

RefreshMode
How a reference table is refreshed after initial population.

Traits§

ReferenceTableSource
A source that populates a reference/dimension table.