Module checkpoint_manifest

Expand description

Unified checkpoint manifest types Versioned checkpoint manifest.

Structs§

ByteRange: A byte range within an immutable node data object.
ChannelProgress: Watermark and idleness state for one stable input channel.
CheckpointManifest: A point-in-time snapshot of one participant’s pipeline state.
ConnectorCheckpoint: Connector-owned offset map stored at the exact checkpoint cut.
EventTimeBounds: Inclusive event-time range of one segment’s rows.
ManifestValidationError: Errors found during manifest validation.
NodeDataObject: The one data object written by this participant for this checkpoint.
PipelineIdentity: SHA-256 identity of the logical pipeline and recovery-state ABI.
PreparedSinkArtifactIntent: Recovery evidence persisted before a checkpoint-committable sink may write.
PreparedSinkDescriptor: Opaque phase-one sink descriptor stored in the current node data object.
ReferencedStateChunk: Metadata and exact logical reference count for an older immutable object.
StateChunkId: Stable identity of one immutable node data object.
StateFrame: A checksummed state payload in the current or a prior node data object.
ViewLog: One append-only view’s retained log at this cut.
ViewLogSegment: One immutable run of rows in a view-log partition.

StateFrameKey: State-frame identity. Whole-operator metadata and vnode-keyed state are distinct.

CHECKPOINT_MANIFEST_VERSION: Current checkpoint manifest format. Every other version is rejected.
MAX_CLUSTER_VIEW_LOG_SEGMENTS: Most segments one cluster cut retains across all of its participants. Cleanup and topology migration load a cut’s manifests, and a migration root beside its first target cut, within 16 MiB together; at about 285 encoded bytes a segment, two cuts at this budget stay near 13 MiB and leave room for state frames.
MAX_VIEW_LOG_SEGMENTS: Most segments one manifest may retain across every view log. The bound keeps the manifest within its encoded-size limit; compaction merges a log’s segments, so their number follows the log’s bytes rather than the checkpoints that wrote it.
PIPELINE_IDENTITY_VERSION: Canonical pipeline-identity payload version.
PREPARED_SINK_DESCRIPTOR_VERSION: Runtime envelope used for prepared sink descriptors.

checkpoint_artifact_intent_sha256: SHA-256 for one optional sink artifact intent.
checkpoint_descriptor_sha256: Domain-separated digest for an optional prepared sink descriptor.
checkpoint_sha256: SHA-256 helper used by capture and focused format tests.
view_log_segment_limit: Most segments one manifest may retain when its cut has participants participants: in a cluster an even share of MAX_CLUSTER_VIEW_LOG_SEGMENTS, and never more than MAX_VIEW_LOG_SEGMENTS.