Skip to main content

Module checkpoint

Module checkpoint 

Source
Expand description

Distributed checkpoint barrier protocol. Checkpoint barrier protocol and storage.

Coordinator-triggered barriers flow through sources to trigger consistent state snapshots. The fast path is a single AtomicU64 load (~10ns).

Re-exports§

pub use barrier::flags;
pub use barrier::BarrierPollHandle;
pub use barrier::CheckpointBarrier;
pub use barrier::CheckpointBarrierInjector;
pub use barrier::StreamMessage;
pub use checkpoint_manifest::CheckpointManifest;
pub use checkpoint_manifest::ConnectorCheckpoint;
pub use checkpoint_manifest::OperatorCheckpoint;
pub use checkpoint_store::CheckpointStore;
pub use checkpoint_store::CheckpointStoreError;
pub use checkpoint_store::FileSystemCheckpointStore;
pub use checkpoint_store::ObjectStoreCheckpointStore;
pub use checkpoint_store::RecoveryReport;
pub use checkpoint_store::ValidationIssue;
pub use checkpoint_store::ValidationResult;

Modules§

barrier
Checkpoint barrier types and cross-thread injection. Checkpoint barrier protocol.
checkpoint_manifest
Unified checkpoint manifest types Checkpoint manifest types.
checkpoint_store
Checkpoint persistence trait and filesystem/object store implementations Checkpoint persistence via the CheckpointStore trait.
object_store_builder
Object store factory — builds S3, GCS, Azure, or local backends from URL schemes. Factory for building ObjectStore instances from URL schemes.