Module lakehouse 

Lakehouse connectors (Delta Lake, Iceberg). Lakehouse connectors (Delta Lake).

Writes Arrow RecordBatch data to lakehouse table formats with ACID transactions and at-least-once delivery (exactly-once opt-in).

Architecture

Ring 0 (Hot Path):  SPSC push only (~5ns, zero sink code)
Ring 1 (Background): Batch buffering -> Parquet writes -> transaction commits
Ring 2 (Control):    Schema management, configuration, health checks

Module Structure

Delta Lake

• delta - DeltaLakeSink implementing SinkConnector
• delta_config - Configuration and enums
• delta_metrics - Lock-free atomic metrics

Usage

Delta Lake

use laminar_connectors::lakehouse::{DeltaLakeSink, DeltaLakeSinkConfig, DeltaWriteMode};

let config = DeltaLakeSinkConfig {
    table_path: "s3://data-lake/trades/".to_string(),
    write_mode: DeltaWriteMode::Append,
    partition_columns: vec!["trade_date".to_string()],
    ..Default::default()
};

let sink = DeltaLakeSink::new(config);

Re-exports

pub use delta::DeltaLakeSink;

pub use delta_config::CompactionConfig;

pub use delta_config::DeliveryGuarantee;

pub use delta_config::DeltaCatalogType;

pub use delta_config::DeltaLakeSinkConfig;

pub use delta_config::DeltaWriteMode;

pub use delta_metrics::DeltaLakeSinkMetrics;

pub use delta_source::DeltaSource;

pub use delta_source_config::DeltaSourceConfig;

pub use metrics::LakehouseSinkMetrics;

Modules

delta

Delta Lake sink connector implementation.

delta_config

Delta Lake sink connector configuration.

delta_io

Delta Lake I/O integration module.

delta_metrics

Delta Lake sink connector metrics.

delta_source

Delta Lake source connector implementation.

delta_source_config

Delta Lake source connector configuration.

delta_table_provider

Delta Lake table provider integration with DataFusion.

metrics

Common metrics for Lakehouse sink connectors.

Functions

register_delta_lake_sink

Registers the Delta Lake sink connector with the given registry.

register_delta_lake_source

Registers the Delta Lake source connector with the given registry.

register_lakehouse_sinks

Registers all lakehouse sink connectors (Delta Lake).