Skip to main content

Module barrier

Module barrier 

Source
Expand description

Checkpoint barrier types and cross-thread injection. Checkpoint barrier protocol.

The coordinator injects barriers into sources via CheckpointBarrierInjector. Sources deliver barriers alongside events. The fast path (no pending barrier) is a single AtomicU64 load (~10ns).

Modules§

flags
Barrier flags — packed into the flags field.

Structs§

BarrierPollHandle
Handle used by source operators to poll for pending barriers.
CheckpointBarrier
A checkpoint barrier that flows through the dataflow graph.
CheckpointBarrierInjector
Cross-thread barrier injector for source operators.

Enums§

StreamMessage
A message that flows through streaming channels.

Constants§

MAX_SHUFFLE_FLUSH_WAVE
Largest shuffle flush wave representable in a checkpoint barrier.

Functions§

decode_shuffle_flush_flags
Decode one internal clustered-shuffle flush marker into (wave, sender_activity).
encode_shuffle_flush_flags
Encode one internal clustered-shuffle flush marker.