Skip to main content

Module serialization

Module serialization 

Source
Expand description

Shared Arrow IPC serialization for RecordBatch ↔ bytes. Shared serialization helpers.

  • Arrow IPC: RecordBatch ↔ bytes conversion using the Arrow IPC stream format.
  • jsonb_tags: Canonical JSONB binary format type tag constants.

Modules§

jsonb_tags
Canonical JSONB binary format type tag constants. JSONB binary format type tags.

Structs§

BatchStreamDecoder
Decoder for a stream produced by BatchStreamEncoder: feed each chunk in order; the first chunk’s schema decodes all later schema-less chunks.
BatchStreamEncoder
Incremental Arrow IPC encoder that writes the schema once: concatenating the per-call blobs in order yields one IPC stream for BatchStreamDecoder.

Functions§

deserialize_batch_stream
Deserializes a single [RecordBatch] from Arrow IPC stream bytes.
serialize_batch_stream
Serializes a single [RecordBatch] to Arrow IPC stream bytes.