Expand description
Core streaming engine for LaminarDB.
Re-exports§
pub use checkpoint as storage;
Modules§
- changelog
- Z-set changelog
__weightcolumn name, shared between the MV producer and upsert-sink consumers. Z-set changelog encoding shared between the materialized-view producer (laminar-db) and the upsert-sink consumers (laminar-connectors). - checkpoint
- Distributed checkpoint barrier protocol. Checkpoint barrier protocol and storage.
- checkpoint_
decision - Per-epoch checkpoint commit marker store. Used by the checkpoint coordinator’s 2PC to record the commit decision durably before sinks are told to commit, so recovery can re-establish the verdict after a crash. Lives outside the cluster gate because single-instance also needs it. Durable commit marker for checkpoint 2PC.
- cluster
- Distributed cluster coordination. Unstable: gated behind
cluster. Cluster coordination: discovery and control plane. - error_
codes - Structured error code registry (
LDB-NNNN) and Ring 0 hot path error type. LaminarDB structured error code registry. - lookup
- Lookup table types and predicate pushdown. Lookup table traits, predicate pushdown, and caching.
- mv
- Cascading materialized view registry with dependency tracking and cycle detection.
- operator
- Streaming operator types and window assigners for stream processing.
- serialization
- Shared Arrow IPC serialization for
RecordBatch↔ bytes. Shared serialization helpers. - shuffle
- Cross-instance shuffle: message codec, credit flow, wire protocol.
Cross-instance shuffle over Tonic gRPC client-streaming: one
client-streaming call per peer pair carrying
ShuffleMessageframes. Backpressure is the HTTP/2 flow-control window plus the bounded crossfire inbound queue on the consuming side. The real transport is compiled undercluster; the default build keeps a networking-free shim. - state
- Pluggable state backend (
StateBackendtrait + impls). State backend abstraction. Two concrete backends:InProcessBackendfor embedded single-process runs, andObjectStoreBackendfor anything durable (local filesystem viafile://, or S3/GCS/Azure). - streaming
- In-memory streaming API — Source, Sink, Subscription with broadcast fan-out.
- time
- Event time, watermarks, and timer management.
Enums§
- Error
- Error types for laminar-core
Type Aliases§
- Result
- Result type for laminar-core operations