Skip to main content

Module message

Module message 

Source
Expand description

Logical messages carried by the ordered shuffle transport.

The data/barrier wire encoding is gRPC/protobuf (proto/shuffle.proto, ShuffleFrame); transport identity is internal to super::transport. A data message’s batch is Arrow IPC-encoded as one self-contained logical payload. Wire fragmentation slices that allocation without copying it or retaining per-stage codec state.

Enums§

ShuffleMessage
Logical message carried on a shuffle connection.

Constants§

MAX_PAYLOAD_BYTES
Maximum reassembled Arrow IPC payload for one logical shuffled batch: 16 MiB.