Expand description
Sink-agnostic changelog collapse for upsert sinks (Z-set / CDC → key-unique
_op batch). Pulled in by upsert-capable sink features (e.g. delta-lake).
Sink-agnostic changelog collapse for upsert sinks. A commit epoch can carry
many changelog events for one merge key (every aggregate value change is a
retract + insert), which an upsert writer rejects as a cardinality
violation. collapse_changelog folds an epoch down to one row per key.
Functions§
- collapse_
changelog - Collapse a concatenated changelog epoch
batchinto a key-unique batch carrying a_opcolumn ofU(upsert) orD(delete), one row permerge_key.