Skip to main content

Module source_offsets

Module source_offsets 

Source
Expand description

Typed source position tracking for checkpoint recovery. Typed source position tracking for checkpoint recovery.

Provides SourcePosition — a strongly typed enum representing connector-specific offsets — alongside conversion methods to/from the existing ConnectorCheckpoint format.

Also provides:

  • SourceId — newtype for source identifiers within a pipeline.
  • SourceOffset — combines a SourceId with a SourcePosition.
  • RecoveryPlan — recovery plan built from checkpoint manifests.
  • DeterminismWarning — warnings about non-determinism during recovery.

Structs§

DeterminismValidator
Validates that operators in a pipeline are deterministic.
DeterminismWarning
A warning generated during recovery planning.
FilePosition
File source position.
GenericPosition
Generic position for custom connectors.
KafkaPartitionOffset
Kafka partition-level offset.
KafkaPosition
Kafka source position (all partitions for a consumer group).
MysqlCdcPosition
MySQL CDC position tracked via GTID set or binlog coordinates.
PostgresCdcPosition
PostgreSQL CDC position tracked via replication slot.
RecoveryPlan
Recovery plan built from a checkpoint manifest.
SourceId
Unique identifier for a source within a pipeline.
SourceOffset
A source’s read position at checkpoint time.

Enums§

OperatorDeterminismWarning
Warning about potential non-determinism in an operator.
SourcePosition
Strongly typed source position.
WarningSeverity
Severity level for recovery warnings.

Traits§

OperatorDescriptor
Trait describing an operator’s determinism properties.