Skip to main content

Module serialization

Module serialization 

Source
Expand description

Shared Arrow IPC serialization for RecordBatch ↔ bytes. Shared serialization helpers.

  • Arrow IPC: RecordBatch ↔ bytes conversion using the Arrow IPC stream format.
  • jsonb_tags: Canonical JSONB binary format type tag constants.

Modules§

jsonb_tags
Canonical JSONB binary format type tag constants. JSONB binary format type tags.

Structs§

BatchStreamDecoder
Decoder for an incrementally chunked Arrow IPC stream. The first chunk’s schema decodes all later schema-less chunks.
BoundedBytesWriter
A growable byte writer that rejects payloads and retained capacities above a fixed limit. This is shared by Arrow IPC and archive encoders at checkpoint/shuffle boundaries.

Functions§

deserialize_batch_stream
Deserializes a single [RecordBatch] from Arrow IPC stream bytes.
serialize_batch_stream
Serializes a single [RecordBatch] to Arrow IPC stream bytes.
serialize_batches_stream_bounded
Serializes batches as one Arrow IPC stream without allowing the writer to allocate beyond max_bytes.