Skip to main content

Module iceberg_source

Module iceberg_source 

Source
Expand description

Apache Iceberg source connector implementation.

IcebergSource implements SourceConnector for polling Iceberg snapshots. It is a reference/lookup table source — Iceberg tables are snapshot-based with no push mechanism.

On each poll cycle the source checks for a newer snapshot. If one exists, only the newly added data files are read via manifest-level diff (see iceberg_incremental::scan_incremental). The first read is a full scan.

Structs§

IcebergSource
Apache Iceberg source connector.