Skip to main content

Module lakehouse

Module lakehouse 

Source
Expand description

Lakehouse connectors (Delta Lake, Iceberg). Lakehouse connectors (Delta Lake, Apache Iceberg).

Re-exports§

pub use delta::DeltaLakeSink;
pub use delta_config::CompactionConfig;
pub use delta_config::DeliveryGuarantee;
pub use delta_config::DeltaCatalogType;
pub use delta_config::DeltaLakeSinkConfig;
pub use delta_config::DeltaWriteMode;
pub use delta_metrics::DeltaLakeSinkMetrics;
pub use delta_source::DeltaSource;
pub use delta_source_config::DeltaReadMode;
pub use delta_source_config::DeltaSourceConfig;
pub use delta_source_config::SchemaEvolutionAction;
pub use metrics::LakehouseSinkMetrics;
pub use iceberg::IcebergSink;
pub use iceberg_config::IcebergCatalogConfig;
pub use iceberg_config::IcebergCatalogType;
pub use iceberg_config::IcebergSinkConfig;
pub use iceberg_config::IcebergSourceConfig;
pub use iceberg_reference::IcebergReferenceTableSource;
pub use iceberg_source::IcebergSource;

Modules§

delta
Delta Lake sink connector implementation.
delta_config
Delta Lake sink config. Parsed from SQL WITH (...) via DeltaLakeSinkConfig::from_config.
delta_io
Delta Lake I/O integration module.
delta_metrics
Prometheus-backed Delta Lake sink metrics.
delta_source
Delta Lake source connector.
delta_source_config
Delta Lake source config. Parsed from SQL WITH (...) via DeltaSourceConfig::from_config.
delta_table_provider
Delta Lake table provider integration with DataFusion.
iceberg
Apache Iceberg sink connector implementation.
iceberg_config
Apache Iceberg connector configuration.
iceberg_incremental
Incremental snapshot diff for Iceberg tables.
iceberg_io
Feature-gated I/O operations for Apache Iceberg.
iceberg_reference
Iceberg reference table source for lookup/enrichment joins.
iceberg_source
Apache Iceberg source connector implementation.
metrics
Common metrics for Lakehouse sink connectors.

Functions§

register_delta_lake_sink
Registers the Delta Lake sink connector with the given registry.
register_delta_lake_source
Registers the Delta Lake source connector with the given registry.
register_iceberg_sink
Registers the Iceberg sink connector with the given registry.
register_iceberg_source
Registers the Iceberg source connector with the given registry.
register_lakehouse_sinks
Registers all lakehouse sink connectors (Delta Lake, Iceberg).
register_lakehouse_sources
Registers all lakehouse source connectors.