Skip to main content

Module debezium

Module debezium 

Source
Expand description

Debezium CDC envelope format deserialization.

Parses Debezium JSON change events into Arrow RecordBatch.

§Debezium Envelope Format

{
  "before": { ... },       // null for inserts
  "after":  { ... },       // null for deletes
  "source": { ... },       // source metadata
  "op": "c|u|d|r",         // operation: create, update, delete, read (snapshot)
  "ts_ms": 1234567890      // timestamp
}

The deserializer extracts the after payload for inserts/updates and the before payload for deletes, adding __op and __ts_ms metadata columns.

Structs§

DebeziumDeserializer
Debezium CDC envelope deserializer.

Enums§

DebeziumOp
Debezium operation types.