Expand description
Core streaming engine for LaminarDB.
Modules§
- catalog
- Feature-neutral catalog identity types. Feature-neutral catalog identity types.
- changelog
- Z-set changelog
__weightcolumn name, shared between the MV producer and upsert-sink consumers. Z-set changelog encoding shared between the materialized-view producer (laminar-db) and the upsert-sink consumers (laminar-connectors). - checkpoint
- Distributed checkpoint barrier protocol. Checkpoint barrier protocol and storage.
- checkpoint_
decision - Per-epoch checkpoint commit marker store. Used by the checkpoint coordinator’s 2PC to record the commit decision durably before sinks are told to commit, so recovery can re-establish the verdict after a crash. Lives outside the cluster gate because single-instance also needs it. Durable checkpoint identity, ID allocation, and immutable terminal outcomes.
- cluster
- Distributed cluster coordination. Runtime services are gated behind
cluster; the control namespace retains feature-neutral checkpoint value types in every build. Cluster coordination: discovery and control plane. - durable_
fs - Crash-durable same-directory file publication primitives. Crash-durable same-directory file publication.
- error_
codes - Structured error code registry (
LDB-NNNN) and Ring 0 hot path error type. LaminarDB structured error code registry. - gcs_
credentials - Refreshable Google workload-identity credentials for pinned object-store clients. Refreshable GCS workload-identity credentials.
- lookup
- Lookup table types and predicate pushdown. Lookup table traits, predicate pushdown, and caching.
- mv
- Cascading materialized view registry with dependency tracking and cycle detection.
- operator
- Streaming operator types and window assigners for stream processing.
- serialization
- Shared Arrow IPC serialization for
RecordBatch↔ bytes. Shared serialization helpers. - shuffle
- Cross-instance shuffle: message codec, credit flow, wire protocol.
Cross-instance shuffle over Tonic gRPC client-streaming: one
client-streaming call per peer pair carrying
ShuffleMessageframes. Backpressure is the HTTP/2 flow-control window plus the bounded crossfire inbound queue on the consuming side. The real transport is compiled undercluster; the default build keeps a networking-free shim. - state
- Partition-key encoding and virtual-node routing. Partition-key encoding and virtual-node routing.
- storage_
auth - Non-secret object-store credential-source classification. Non-secret classification of object-store credential discovery.
- storage_
location - Provider-neutral object-store locations and consumer-specific URL adapters. Provider-neutral parsing for object-store locations.
- streaming
- In-memory streaming API — Source, Sink, Subscription with broadcast fan-out.
- time
- Event time, watermarks, and timer management.
Enums§
- Error
- Error types for laminar-core
Type Aliases§
- Result
- Result type for laminar-core operations