Module checkpoint 

Distributed checkpoint barrier protocol. Checkpoint barrier protocol and storage.

Coordinator-triggered barriers flow through sources to trigger consistent state snapshots. The fast path is a single AtomicU64 load (~10ns).

Re-exports

pub use assignment::AssignmentDrainId;

pub use assignment::AssignmentDrainTransition;

pub use assignment::CheckpointAssignmentAdoption;

pub use assignment::CheckpointAssignmentFence;

pub use assignment::CheckpointParticipant;

pub use assignment::MAX_CHECKPOINT_PARTICIPANTS;

pub use attempt::CheckpointAttempt;

pub use attempt::CheckpointAttemptRelation;

pub use authority::LeaderProof;

pub use authority::LeaderProofOwner;

pub use barrier::flags;

pub use barrier::BarrierPollHandle;

pub use barrier::CheckpointBarrier;

pub use barrier::CheckpointBarrierInjector;

pub use barrier::StreamMessage;

pub use checkpoint_manifest::checkpoint_artifact_intent_sha256;

pub use checkpoint_manifest::checkpoint_descriptor_sha256;

pub use checkpoint_manifest::checkpoint_sha256;

pub use checkpoint_manifest::ByteRange;

pub use checkpoint_manifest::ChannelProgress;

pub use checkpoint_manifest::CheckpointManifest;

pub use checkpoint_manifest::ConnectorCheckpoint;

pub use checkpoint_manifest::NodeDataObject;

pub use checkpoint_manifest::PipelineIdentity;

pub use checkpoint_manifest::PreparedSinkArtifactIntent;

pub use checkpoint_manifest::PreparedSinkDescriptor;

pub use checkpoint_manifest::ReferencedStateChunk;

pub use checkpoint_manifest::StateChunkId;

pub use checkpoint_manifest::StateFrame;

pub use checkpoint_manifest::StateFrameKey;

pub use checkpoint_manifest::PIPELINE_IDENTITY_VERSION;

pub use checkpoint_manifest::PREPARED_SINK_DESCRIPTOR_VERSION;

pub use checkpoint_store::checkpoint_artifact_identity_sha256;

pub use checkpoint_store::checkpoint_manifest_bytes;

pub use checkpoint_store::probe_object_store_conditional_create;

pub use checkpoint_store::probe_object_store_conditional_update;

pub use checkpoint_store::CheckpointManifestAbortSeal;

pub use checkpoint_store::CheckpointSinkArtifactIntent;

pub use checkpoint_store::CheckpointStore;

pub use checkpoint_store::CheckpointStoreError;

pub use checkpoint_store::ObjectStoreCheckpointStore;

pub use checkpoint_store::MAX_CHECKPOINT_SINK_ARTIFACT_INTENT_AGGREGATE_BYTES;

pub use checkpoint_store::MAX_CHECKPOINT_SINK_ARTIFACT_INTENT_BYTES;

pub use committed_checkpoint::canonical_json_bytes;

pub use committed_checkpoint::canonical_json_sha256;

pub use committed_checkpoint::CheckpointScope;

pub use committed_checkpoint::CheckpointWatermark;

pub use committed_checkpoint::CommittedCheckpointIndex;

pub use committed_checkpoint::CommittedCheckpointRef;

pub use committed_checkpoint::CommittedParticipantRef;

pub use committed_checkpoint::COMMITTED_CHECKPOINT_INDEX_VERSION;

pub use committed_checkpoint::MAX_COMMITTED_CHECKPOINT_INDEX_BYTES;

pub use subscription::merge_node_subscription_manifests;

pub use subscription::ChangelogMode;

pub use subscription::MergedSubscriptionCheckpoint;

pub use subscription::NodePartitionRange;

pub use subscription::NodeSubscriptionManifest;

pub use subscription::NodeSubscriptionStreamManifest;

pub use subscription::OutputDistribution;

pub use subscription::OutputDistributionCertificate;

pub use subscription::OutputFrameId;

pub use subscription::OutputPartitionId;

pub use subscription::OutputSegmentRef;

pub use subscription::PartitionFrontier;

pub use subscription::PartitionSequence;

pub use subscription::StreamGeneration;

pub use subscription::SubscriptionCheckpointManifest;

pub use subscription::SubscriptionContractError;

pub use subscription::SubscriptionDigest;

pub use subscription::SubscriptionProtocolVersion;

pub use subscription::MAX_OUTPUT_FRAMES_PER_SEGMENT;

pub use subscription::MAX_OUTPUT_SEGMENT_BYTES;

pub use subscription::OUTPUT_DISTRIBUTION_CERTIFICATE_VERSION;

pub use subscription::SUBSCRIPTION_PROTOCOL_VERSION;

Modules

assignment

Feature-neutral assignment certificate retained by exact checkpoint attempts. Feature-neutral checkpoint assignment certificate.

attempt

Identity and ordering for checkpoint attempts. Identity and ordering for checkpoint attempts.

authority

Feature-neutral leader authority retained by durable protocol records. Feature-neutral authority values for durable checkpoint protocol records.

barrier

Checkpoint barrier types and cross-thread injection. Checkpoint barrier protocol.

checkpoint_manifest

Unified checkpoint manifest types Versioned checkpoint manifest.

checkpoint_store

Checkpoint persistence trait and filesystem/object store implementations Provider-neutral checkpoint persistence over [object_store].

committed_checkpoint

Canonical global index selected by a committed checkpoint. Immutable global index for one committed checkpoint cut.

object_store_builder

Object store factory — builds S3, GCS, Azure, or local backends from URL schemes. Factory for building ObjectStore instances from URL schemes.

subscription

Durable identities and canonical metadata for committed subscription output. Versioned, feature-neutral contract for durable subscription output.

Constants

SINGLETON_WATERMARK_CHANNEL

Reserved input-channel identity for one logical watermark per source and participant.

Functions

channel_progress_frontier

Numeric frontier retained by a channel cut, including an all-idle cut.

channel_progress_frontiers_by_source

Numeric decision frontier retained for each source in an exact channel cut.

classify_channel_progress

Reconstruct the event-time state represented by an exact channel cut.