Expand description
Ring 0 / Ring 1 pipeline bridge via lock-free SPSC queue.
The PipelineBridge (Ring 0 producer) sends compiled pipeline output as
individual BridgeMessages through an SpscQueue. The BridgeConsumer
(Ring 1) accumulates events into Arrow RecordBatch according to a
BatchPolicy, emitting Ring1Actions for downstream stateful operators.
This explicit, watermark-aware handoff prevents partial-batch emissions tied to arbitrary batch boundaries (Issue #55). Watermarks flush pending rows before the watermark is forwarded, ensuring Ring 1 operators see complete event sets.
Structs§
- Bridge
Consumer - Ring 1 side of the pipeline bridge (consumer).
- Bridge
Stats - Shared counters between producer and consumer.
- Bridge
Stats Snapshot - A point-in-time snapshot of
BridgeStats. - Pipeline
Bridge - Ring 0 side of the pipeline bridge (producer).
Enums§
- Bridge
Message - A message sent from Ring 0 through the SPSC queue to Ring 1.
- Pipeline
Bridge Error - Errors from the pipeline bridge.
- Ring1
Action - An action for Ring 1 produced by the
BridgeConsumer.
Functions§
- create_
pipeline_ bridge - Creates a paired
PipelineBridge(producer) andBridgeConsumer(consumer).