Skip to main content

Module serde

Module serde 

Source
Expand description

Record serialization and deserialization framework. Record serialization and deserialization framework.

Provides traits and implementations for converting between external data formats and Arrow RecordBatch:

  • RecordDeserializer: Converts raw bytes to RecordBatch
  • RecordSerializer: Converts RecordBatch to raw bytes
  • Format: Enum of supported serialization formats

§Implementations

  • json: JSON format using serde_json
  • csv: CSV format
  • raw: Raw bytes pass-through
  • debezium: Debezium CDC envelope format

Modules§

csv
CSV serialization and deserialization.
debezium
Debezium CDC envelope format deserialization.
json
JSON serialization and deserialization.
raw
Raw bytes pass-through serialization.

Enums§

Format
Supported serialization formats.

Traits§

RecordDeserializer
Trait for deserializing raw bytes into Arrow RecordBatch.
RecordSerializer
Trait for serializing Arrow RecordBatch into raw bytes.

Functions§

create_deserializer
Creates a deserializer for the given format.
create_serializer
Creates a serializer for the given format.