Module transport 

Cross-node shuffle transport over Tonic gRPC client-streaming.

A leading Hello binds each stream to certified process incarnations and an assignment. Per-peer and per-node byte admission propagates backpressure to the HTTP/2 stream.

Structs

ReceivedBatch

A decoded shuffle batch together with the memory admission charged for its source IPC payload.

ReceivedFrontierCut

A frontier and the same-stage batches from its ordered peer stream that precede it.

ReceivedShuffle

A received shuffle message whose decoded memory remains admitted until the envelope is dropped. Consumers retain it while processing shallow clones of the message or its batch.

ShuffleBatchAdmission

Opaque ownership of the memory admission charged to a decoded shuffle batch. The charge is released when the last clone is dropped.

ShuffleReceiver

Inbound side of the shuffle fabric: a Tonic ShuffleTransport server that surfaces every received frame, attributed to its peer, on the bounded queue.

ShuffleSender

Lazy pool of ordered streams per peer.

Constants

SHUFFLE_ADDR_KEY

Gossip KV key under which a receiver publishes its listener address for peer discovery.

Functions

is_scope_cancelled

Whether an outbound shuffle operation was cancelled by an assignment or recovery scope transition. Generic connection cancellation is deliberately not classified as a scope change.

shuffle_send_may_have_been_admitted

Whether a failed outbound operation may already have entered the peer’s ordered send queue.

Type Aliases

ShufflePeerId

Peer identifier on the wire; matches cluster::discovery::NodeId’s inner type.