Expand description
Checkpoint barrier types and cross-thread injection. Checkpoint barrier protocol.
The coordinator injects barriers into sources via CheckpointBarrierInjector.
Sources deliver barriers alongside events. The fast path (no pending barrier)
is a single AtomicU64 load (~10ns).
Modules§
- flags
- Barrier flags — packed into the
flagsfield.
Structs§
- Barrier
Poll Handle - Handle used by source operators to poll for pending barriers.
- Checkpoint
Barrier - A checkpoint barrier that flows through the dataflow graph.
- Checkpoint
Barrier Injector - Cross-thread barrier injector for source operators.
Enums§
- Stream
Message - A message that flows through streaming channels.
Constants§
- MAX_
SHUFFLE_ FLUSH_ WAVE - Largest shuffle flush wave representable in a checkpoint barrier.
Functions§
- decode_
shuffle_ flush_ flags - Decode one internal clustered-shuffle flush marker into
(wave, sender_activity). - encode_
shuffle_ flush_ flags - Encode one internal clustered-shuffle flush marker.