Expand description
Wire format for the shuffle: [u32 length][u8 tag][payload].
Each frame is self-contained. The receiver reads a 4-byte
big-endian length, a 1-byte tag, then exactly length − 1 bytes of
payload. This avoids entangling the shuffle with Arrow IPC stream
framing: a Data message’s payload is itself an Arrow IPC single-
batch stream (schema + batch), so a schema roll on one message
doesn’t poison the connection.
Enums§
- Shuffle
Message - Logical message carried on a shuffle connection.
Constants§
- MAX_
PAYLOAD_ BYTES - Maximum payload size accepted by the codec: 64 MiB. Receivers reject oversized frames instead of allocating unbounded memory.