Expand description
Distributed checkpoint barrier protocol. Checkpoint barrier protocol and storage.
Coordinator-triggered barriers flow through sources to trigger consistent
state snapshots. The fast path is a single AtomicU64 load (~10ns).
Re-exports§
pub use assignment::AssignmentDrainId;pub use assignment::AssignmentDrainTransition;pub use assignment::CheckpointAssignmentAdoption;pub use assignment::CheckpointAssignmentFence;pub use assignment::CheckpointParticipant;pub use assignment::MAX_CHECKPOINT_PARTICIPANTS;pub use authority::LeaderProof;pub use authority::LeaderProofOwner;pub use barrier::flags;pub use barrier::BarrierPollHandle;pub use barrier::CheckpointBarrier;pub use barrier::CheckpointBarrierInjector;pub use barrier::StreamMessage;pub use checkpoint_manifest::CheckpointManifest;pub use checkpoint_manifest::ConnectorCheckpoint;pub use checkpoint_manifest::OperatorCheckpoint;pub use checkpoint_manifest::PipelineIdentity;pub use checkpoint_manifest::PIPELINE_IDENTITY_VERSION;pub use checkpoint_store::CheckpointStore;pub use checkpoint_store::CheckpointStoreError;pub use checkpoint_store::FileSystemCheckpointStore;pub use checkpoint_store::ObjectStoreCheckpointStore;pub use checkpoint_store::RecoveryReport;pub use checkpoint_store::ValidationIssue;pub use checkpoint_store::ValidationResult;pub use prepared_witness::PreparedCheckpointWitness;pub use prepared_witness::MAX_PREPARED_CHECKPOINT_WITNESSES;pub use recovery_capsule::canonical_json_bytes;pub use recovery_capsule::canonical_json_sha256;pub use recovery_capsule::CheckpointWatermark;pub use recovery_capsule::ClusterRecoveryCapsule;pub use recovery_capsule::CommittedSourceHandoff;pub use recovery_capsule::ParticipantRecoveryRef;pub use recovery_capsule::RecoveryCapsuleRef;pub use recovery_capsule::SourceHandoffState;pub use recovery_capsule::CLUSTER_RECOVERY_CAPSULE_VERSION;pub use recovery_capsule::MAX_RECOVERY_CAPSULE_BYTES;
Modules§
- assignment
- Feature-neutral assignment certificate retained by exact checkpoint attempts. Feature-neutral checkpoint assignment certificate.
- authority
- Feature-neutral leader authority retained by durable protocol records. Feature-neutral authority values for durable checkpoint protocol records.
- barrier
- Checkpoint barrier types and cross-thread injection. Checkpoint barrier protocol.
- checkpoint_
manifest - Unified checkpoint manifest types Checkpoint manifest types.
- checkpoint_
store - Checkpoint persistence trait and filesystem/object store implementations
Checkpoint persistence via the
CheckpointStoretrait. - object_
store_ builder - Object store factory — builds S3, GCS, Azure, or local backends from URL schemes.
Factory for building
ObjectStoreinstances from URL schemes. - prepared_
witness - Compact inventory evidence for unresolved prepared checkpoints. Compact inventory records for unresolved prepared checkpoints.
- recovery_
capsule - Canonical recovery image selected by a committed cluster checkpoint. Canonical, content-addressed recovery image for a committed cluster checkpoint.