Enum ShuffleMessage 

pub enum ShuffleMessage {
    Barrier(CheckpointBarrier),
    Data {
        stage: String,
        routed_vnodes: Arc<[u32]>,
        batch: RecordBatch,
    },
}

Logical message carried on a shuffle connection.

Variants

Barrier(CheckpointBarrier)

An aligned checkpoint barrier ordered after preceding checkpointed data.

Data

A stage batch with a non-empty canonical route set.

Fields

stage: String

Stable stage demultiplexing scope.

routed_vnodes: Arc<[u32]>

Ascending, duplicate-free receiver-owned vnode route set.

batch: RecordBatch

User batch, with its schema left unchanged.

Implementations

impl ShuffleMessage

pub fn checkpointed(stage: String, vnode: u32, batch: RecordBatch) -> Self

Construct stateful data covered by checkpoint delivery accounting.

pub fn checkpointed_routed( stage: String, routed_vnodes: Arc<[u32]>, batch: RecordBatch, ) -> Self

Construct owner-coalesced stateful data with canonical out-of-band vnode metadata.

Trait Implementations

impl Clone for ShuffleMessage

fn clone(&self) -> ShuffleMessage

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ShuffleMessage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ShuffleMessage

fn eq(&self, other: &ShuffleMessage) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ShuffleMessage