Expand description
Schema evolution engine (F-SCHEMA-009).
Provides:
DefaultSchemaEvolver— a general-purpose implementation ofSchemaEvolvablethat performs name-based schema diffing, compatibility evaluation, and schema mergingSchemaEvolutionEngine— orchestrates the full evolution flow: detect → diff → evaluate → apply → recordSchemaHistory— tracks per-source schema version historyis_safe_widening— determines whether a type can be safely widened
Structs§
- Default
Schema Evolver - A general-purpose implementation of
SchemaEvolvablethat uses name-based schema matching (suitable for JSON, CSV, Avro, etc.). - Schema
Evolution Engine - Orchestrates the full schema evolution flow.
- Schema
History - Tracks schema version history for all sources.
- Schema
History Entry - A record in the schema history.
Enums§
- Evolution
Result - Result of an evolution attempt.
- Evolution
Trigger - How a schema evolution was triggered.
Functions§
- apply_
changes - Applies a set of schema changes to produce a new schema and a column projection mapping old columns to new positions.
- diff_
schemas_ by_ name - Computes the diff between two Arrow schemas using name-based matching.
- evaluate_
changes - Evaluates a set of schema changes against a compatibility mode.
- is_
safe_ widening - Returns
trueiffromcan be safely widened totowithout data loss.