Expand description
Typed source position tracking for checkpoint recovery. Typed source position tracking for checkpoint recovery.
Provides SourcePosition — a strongly typed enum representing
connector-specific offsets — alongside conversion methods to/from
the existing ConnectorCheckpoint format.
Also provides:
SourceId— newtype for source identifiers within a pipeline.SourceOffset— combines aSourceIdwith aSourcePosition.RecoveryPlan— recovery plan built from checkpoint manifests.DeterminismWarning— warnings about non-determinism during recovery.
Structs§
- Determinism
Validator - Validates that operators in a pipeline are deterministic.
- Determinism
Warning - A warning generated during recovery planning.
- File
Position - File source position.
- Generic
Position - Generic position for custom connectors.
- Kafka
Partition Offset - Kafka partition-level offset.
- Kafka
Position - Kafka source position (all partitions for a consumer group).
- Mysql
CdcPosition MySQLCDC position tracked via GTID set or binlog coordinates.- Postgres
CdcPosition PostgreSQLCDC position tracked via replication slot.- Recovery
Plan - Recovery plan built from a checkpoint manifest.
- Source
Id - Unique identifier for a source within a pipeline.
- Source
Offset - A source’s read position at checkpoint time.
Enums§
- Operator
Determinism Warning - Warning about potential non-determinism in an operator.
- Source
Position - Strongly typed source position.
- Warning
Severity - Severity level for recovery warnings.
Traits§
- Operator
Descriptor - Trait describing an operator’s determinism properties.