Skip to main content

Module lakehouse

Module lakehouse 

Source
Expand description

Lakehouse connectors (Delta Lake, Iceberg). Lakehouse connectors (Delta Lake, Apache Iceberg).

Re-exports§

pub use delta::DeltaLakeSink;
pub use delta_config::DeltaCatalogType;
pub use delta_config::DeltaLakeSinkConfig;
pub use delta_config::DeltaWriteMode;
pub use delta_lookup::DeltaLookupSource;
pub use delta_lookup::DeltaLookupSourceConfig;
pub use delta_metrics::DeltaLakeSinkMetrics;
pub use delta_reference::DeltaReferenceTableSource;
pub use delta_source::DeltaSource;
pub use delta_source_config::DeltaReadMode;
pub use delta_source_config::DeltaSourceConfig;
pub use delta_source_config::SchemaEvolutionAction;
pub use metrics::LakehouseSinkMetrics;
pub use iceberg::IcebergSink;
pub use iceberg_config::IcebergCatalogConfig;
pub use iceberg_config::IcebergCatalogType;
pub use iceberg_config::IcebergSinkConfig;
pub use iceberg_config::IcebergSourceConfig;
pub use iceberg_lookup::IcebergLookupSource;
pub use iceberg_lookup::IcebergLookupSourceConfig;
pub use iceberg_reference::IcebergReferenceTableSource;
pub use iceberg_source::IcebergSource;

Modules§

delta
Delta Lake sink connector implementation.
delta_config
Delta Lake sink config. Parsed from SQL WITH (...) via DeltaLakeSinkConfig::from_config.
delta_io
Delta Lake I/O integration module.
delta_lookup
Delta Lake on-demand lookup source for cache-miss fallback.
delta_metrics
Prometheus-backed Delta Lake sink metrics.
delta_reference
Delta Lake startup snapshot source for reference tables.
delta_source
Delta Lake source connector.
delta_source_config
Delta Lake source config. Parsed from SQL WITH (...) via DeltaSourceConfig::from_config.
delta_table_provider
Delta Lake table provider integration with DataFusion.
iceberg
Apache Iceberg append sink connector.
iceberg_config
Apache Iceberg connector configuration.
iceberg_incremental
Incremental snapshot diff for Iceberg tables.
iceberg_io
Feature-gated I/O operations for Apache Iceberg.
iceberg_lookup
Iceberg on-demand lookup source for cache-miss fallback.
iceberg_reference
Iceberg startup snapshot source for reference tables.
iceberg_source
Apache Iceberg source connector implementation.
metrics
Common metrics for Lakehouse sink connectors.

Functions§

register_delta_lake_sink
Registers the Delta Lake sink connector with the given registry.
register_delta_lake_source
Registers the Delta Lake source connector with the given registry.
register_iceberg_sink
Registers the Iceberg sink connector with the given registry.
register_iceberg_source
Registers the Iceberg source connector with the given registry.
register_lakehouse_sinks
Registers all lakehouse sink connectors (Delta Lake, Iceberg).
register_lakehouse_sources
Registers all lakehouse source connectors.