Skip to main content

Crate laminar_core

Crate laminar_core 

Source
Expand description

Core streaming engine for LaminarDB.

Re-exports§

pub use checkpoint as storage;

Modules§

changelog
Z-set changelog __weight column name, shared between the MV producer and upsert-sink consumers. Z-set changelog encoding shared between the materialized-view producer (laminar-db) and the upsert-sink consumers (laminar-connectors).
checkpoint
Distributed checkpoint barrier protocol. Checkpoint barrier protocol and storage.
checkpoint_decision
Per-epoch checkpoint commit marker store. Used by the checkpoint coordinator’s 2PC to record the commit decision durably before sinks are told to commit, so recovery can re-establish the verdict after a crash. Lives outside the cluster gate because single-instance also needs it. Durable commit marker for checkpoint 2PC.
cluster
Distributed cluster coordination. Unstable: gated behind cluster. Cluster coordination: discovery and control plane.
error_codes
Structured error code registry (LDB-NNNN) and Ring 0 hot path error type. LaminarDB structured error code registry.
lookup
Lookup table types and predicate pushdown. Lookup table traits, predicate pushdown, and caching.
mv
Cascading materialized view registry with dependency tracking and cycle detection.
operator
Streaming operator types and window assigners for stream processing.
serialization
Shared Arrow IPC serialization for RecordBatch ↔ bytes. Shared serialization helpers.
shuffle
Cross-instance shuffle: message codec, credit flow, wire protocol. Cross-instance shuffle over Tonic gRPC client-streaming: one client-streaming call per peer pair carrying ShuffleMessage frames. Backpressure is the HTTP/2 flow-control window plus the bounded crossfire inbound queue on the consuming side. The real transport is compiled under cluster; the default build keeps a networking-free shim.
state
Pluggable state backend (StateBackend trait + impls). State backend abstraction. Two concrete backends: InProcessBackend for embedded single-process runs, and ObjectStoreBackend for anything durable (local filesystem via file://, or S3/GCS/Azure).
streaming
In-memory streaming API — Source, Sink, Subscription with broadcast fan-out.
time
Event time, watermarks, and timer management.

Enums§

Error
Error types for laminar-core

Type Aliases§

Result
Result type for laminar-core operations