Skip to main content

Module gossip_aggregates

Module gossip_aggregates 

Source
Expand description

Gossip-based partial aggregate replication across nodes. Gossip-based partial aggregate replication across nodes.

Reuses the chitchat gossip protocol from the gossip discovery module to disseminate partial aggregates across the delta. Each node publishes its local partials to chitchat, and a merger reads both local and remote partials to produce cluster-wide aggregates.

§Key Format

Chitchat key namespace: agg/{pipeline_id}/{aggregate_name}/{window_scope}

§Watermark-Gated Windows

A window is considered FINAL when ALL nodes have a watermark >= window_end.

Structs§

AggregateKeyspace
Chitchat key builder for aggregate namespacing.
ClusterAggregateResult
Result of merging aggregates across the cluster.
GossipAggregateValue
A gossip-published aggregate value.

Enums§

AggregateScope
The scope of a gossip aggregate.
AggregateState
Aggregate state for a single partial.
WatermarkGateStatus
Watermark-gated window completion status.

Functions§

check_watermark_gate
Checks watermark convergence for window completion.
merge_cluster_aggregates
Merges partial aggregates from multiple nodes.