Skip to main content

Module cdc_adapter

Module cdc_adapter 

Source
Expand description

CDC-to-reference-table adapter for using CDC sources as lookup tables. CDC-to-reference-table adapter.

Wraps any SourceConnector (Postgres CDC, MySQL CDC) as a ReferenceTableSource so CDC streams can populate lookup tables.

The adapter has two phases:

  1. Snapshot: calls poll_batch() until the source returns None, treating the initial burst as a consistent snapshot.
  2. Changes: subsequent poll_changes() calls continue polling for incremental CDC events.

Structsยง

CdcTableSource
Adapts a SourceConnector into a ReferenceTableSource.