Skip to main content

Module checkpoint_store

Module checkpoint_store 

Source
Expand description

Checkpoint persistence trait and filesystem/object store implementations Checkpoint persistence via the CheckpointStore trait.

Provides a filesystem-backed implementation (FileSystemCheckpointStore) that writes manifests as atomic JSON files with a latest.txt pointer for crash-safe recovery.

§Disk Layout

{base_dir}/checkpoints/
  checkpoint_000001/
    manifest.json     # CheckpointManifest as pretty-printed JSON
    state.bin         # Optional: large operator state sidecar
  checkpoint_000002/
    manifest.json
  latest.txt          # "checkpoint_000002" — pointer to latest good checkpoint

Structs§

CheckpointArtifacts
Manifest and optional operator-state sidecar loaded for one exact checkpoint.
FileSystemCheckpointStore
Filesystem-backed checkpoint store.
ObjectStoreCheckpointStore
Object-store-backed checkpoint store.
RecoveryReport
Report from a crash-safe recovery walk.
ValidationResult
Result of validating a single checkpoint.

Enums§

CheckpointStoreError
Errors from checkpoint store operations.
ValidationIssue
Classification of a single validation finding.

Constants§

DEFAULT_MAX_CHECKPOINT_STATE_BYTES
Default upper bound for both one checkpoint’s aggregate raw logical operator state and its external sidecar.
MAX_CHECKPOINT_INVENTORY_ENTRIES
Maximum number of checkpoint entries one bounded inventory operation may materialize.

Traits§

CheckpointStore
Trait for checkpoint persistence backends.

Functions§

validate_max_checkpoint_state_bytes
Validate a configured per-checkpoint operator-state byte budget.