Expand description
Lakehouse connectors (Delta Lake, Iceberg). Lakehouse connectors (Delta Lake, Apache Iceberg).
Re-exports§
pub use delta::DeltaLakeSink;pub use delta_config::CompactionConfig;pub use delta_config::DeliveryGuarantee;pub use delta_config::DeltaCatalogType;pub use delta_config::DeltaLakeSinkConfig;pub use delta_config::DeltaWriteMode;pub use delta_metrics::DeltaLakeSinkMetrics;pub use delta_source::DeltaSource;pub use delta_source_config::DeltaReadMode;pub use delta_source_config::DeltaSourceConfig;pub use delta_source_config::SchemaEvolutionAction;pub use metrics::LakehouseSinkMetrics;pub use iceberg::IcebergSink;pub use iceberg_config::IcebergCatalogConfig;pub use iceberg_config::IcebergCatalogType;pub use iceberg_config::IcebergSinkConfig;pub use iceberg_config::IcebergSourceConfig;pub use iceberg_reference::IcebergReferenceTableSource;pub use iceberg_source::IcebergSource;
Modules§
- delta
- Delta Lake sink connector implementation.
- delta_
config - Delta Lake sink config. Parsed from SQL
WITH (...)viaDeltaLakeSinkConfig::from_config. - delta_
io - Delta Lake I/O integration module.
- delta_
metrics - Prometheus-backed Delta Lake sink metrics.
- delta_
source - Delta Lake source connector.
- delta_
source_ config - Delta Lake source config. Parsed from SQL
WITH (...)viaDeltaSourceConfig::from_config. - delta_
table_ provider - Delta Lake table provider integration with
DataFusion. - iceberg
- Apache Iceberg sink connector implementation.
- iceberg_
config - Apache Iceberg connector configuration.
- iceberg_
incremental - Incremental snapshot diff for Iceberg tables.
- iceberg_
io - Feature-gated I/O operations for Apache Iceberg.
- iceberg_
reference - Iceberg reference table source for lookup/enrichment joins.
- iceberg_
source - Apache Iceberg source connector implementation.
- metrics
- Common metrics for Lakehouse sink connectors.
Functions§
- register_
delta_ lake_ sink - Registers the Delta Lake sink connector with the given registry.
- register_
delta_ lake_ source - Registers the Delta Lake source connector with the given registry.
- register_
iceberg_ sink - Registers the Iceberg sink connector with the given registry.
- register_
iceberg_ source - Registers the Iceberg source connector with the given registry.
- register_
lakehouse_ sinks - Registers all lakehouse sink connectors (Delta Lake, Iceberg).
- register_
lakehouse_ sources - Registers all lakehouse source connectors.