Skip to main content

Module checkpoint

Module checkpoint 

Source
Expand description

Distributed checkpoint barrier protocol. Checkpoint barrier protocol and storage.

Coordinator-triggered barriers flow through sources to trigger consistent state snapshots. The fast path is a single AtomicU64 load (~10ns).

Re-exports§

pub use assignment::AssignmentDrainId;
pub use assignment::AssignmentDrainTransition;
pub use assignment::CheckpointAssignmentAdoption;
pub use assignment::CheckpointAssignmentFence;
pub use assignment::CheckpointParticipant;
pub use assignment::MAX_CHECKPOINT_PARTICIPANTS;
pub use authority::LeaderProof;
pub use authority::LeaderProofOwner;
pub use barrier::flags;
pub use barrier::BarrierPollHandle;
pub use barrier::CheckpointBarrier;
pub use barrier::CheckpointBarrierInjector;
pub use barrier::StreamMessage;
pub use checkpoint_manifest::CheckpointManifest;
pub use checkpoint_manifest::ConnectorCheckpoint;
pub use checkpoint_manifest::OperatorCheckpoint;
pub use checkpoint_manifest::PipelineIdentity;
pub use checkpoint_manifest::PIPELINE_IDENTITY_VERSION;
pub use checkpoint_store::CheckpointStore;
pub use checkpoint_store::CheckpointStoreError;
pub use checkpoint_store::FileSystemCheckpointStore;
pub use checkpoint_store::ObjectStoreCheckpointStore;
pub use checkpoint_store::RecoveryReport;
pub use checkpoint_store::ValidationIssue;
pub use checkpoint_store::ValidationResult;
pub use prepared_witness::PreparedCheckpointWitness;
pub use prepared_witness::MAX_PREPARED_CHECKPOINT_WITNESSES;
pub use recovery_capsule::canonical_json_bytes;
pub use recovery_capsule::canonical_json_sha256;
pub use recovery_capsule::CheckpointWatermark;
pub use recovery_capsule::ClusterRecoveryCapsule;
pub use recovery_capsule::CommittedSourceHandoff;
pub use recovery_capsule::ParticipantRecoveryRef;
pub use recovery_capsule::RecoveryCapsuleRef;
pub use recovery_capsule::SourceHandoffState;
pub use recovery_capsule::CLUSTER_RECOVERY_CAPSULE_VERSION;
pub use recovery_capsule::MAX_RECOVERY_CAPSULE_BYTES;

Modules§

assignment
Feature-neutral assignment certificate retained by exact checkpoint attempts. Feature-neutral checkpoint assignment certificate.
authority
Feature-neutral leader authority retained by durable protocol records. Feature-neutral authority values for durable checkpoint protocol records.
barrier
Checkpoint barrier types and cross-thread injection. Checkpoint barrier protocol.
checkpoint_manifest
Unified checkpoint manifest types Checkpoint manifest types.
checkpoint_store
Checkpoint persistence trait and filesystem/object store implementations Checkpoint persistence via the CheckpointStore trait.
object_store_builder
Object store factory — builds S3, GCS, Azure, or local backends from URL schemes. Factory for building ObjectStore instances from URL schemes.
prepared_witness
Compact inventory evidence for unresolved prepared checkpoints. Compact inventory records for unresolved prepared checkpoints.
recovery_capsule
Canonical recovery image selected by a committed cluster checkpoint. Canonical, content-addressed recovery image for a committed cluster checkpoint.