Expand description
Shared Arrow IPC serialization for RecordBatch ↔ bytes.
Shared serialization helpers.
- Arrow IPC:
RecordBatch↔ bytes conversion using the Arrow IPC stream format. jsonb_tags: Canonical JSONB binary format type tag constants.
Modules§
- jsonb_
tags - Canonical JSONB binary format type tag constants. JSONB binary format type tags.
Structs§
- Batch
Stream Decoder - Decoder for an incrementally chunked Arrow IPC stream. The first chunk’s schema decodes all later schema-less chunks.
- Bounded
Bytes Writer - A growable byte writer that rejects payloads and retained capacities above a fixed limit. This is shared by Arrow IPC and archive encoders at checkpoint/shuffle boundaries.
Functions§
- deserialize_
batch_ stream - Deserializes a single [
RecordBatch] from Arrow IPC stream bytes. - serialize_
batch_ stream - Serializes a single [
RecordBatch] to Arrow IPC stream bytes. - serialize_
batches_ stream_ bounded - Serializes batches as one Arrow IPC stream without allowing the writer to allocate beyond
max_bytes.