Expand description
Event time, watermarks, and timer management.
Structs§
- Ascending
Timestamps Generator - Watermark generator for strictly ascending timestamps; the watermark equals the current timestamp.
- Bounded
OutOf Orderness Generator - Watermark =
max_timestamp_seen - max_out_of_orderness.on_eventignores timestamps far beyond wall clock for advancement. - Cast
Error - Error returned when a column isn’t a
Timestamp(_)type or Arrow’s cast kernel fails. - Event
Time Extractor - Extracts event timestamps from Arrow
RecordBatchcolumns. - Periodic
Generator - Wraps another generator and emits watermarks at fixed wall-clock intervals so idle sources don’t stall time-based windows.
- Processing
Time Generator - Processing-time watermark generator.
- Punctuated
Generator - Punctuated watermark generator that emits based on special events.
- Source
Provided Generator - Watermark generator for sources with embedded watermarks.
- Timer
Registration - A timer registration for delayed processing.
- Timer
Service - Timer service for scheduling and managing timers.
- Watermark
- A monotonically-increasing assertion that no events with timestamps earlier than this will arrive. Drives window emission, late-event detection, and cross-operator time alignment.
- Watermark
Tracker - Tracks watermarks across multiple input sources.
Enums§
- Event
Time Error - Errors that can occur during event time extraction.
- Extraction
Mode - Multi-row extraction strategy.
- Filter
Error - Reasons
filter_batch_by_timestampcannot filter a batch. - Threshold
Op - Direction of timestamp threshold comparison.
- Time
Error - Errors that can occur in time operations.
- Timestamp
Field - Column identifier for timestamp field.
Constants§
- DEFAULT_
MAX_ FUTURE_ SKEW_ MS - Default
max_future_skew_ms: 5 min.
Traits§
- Watermark
Generator - Trait for generating watermarks from event timestamps.
Functions§
- cast_
to_ millis_ array - Cast any
Timestamp(_)array toTimestampMillisecondArray. - filter_
batch_ by_ timestamp - Filter a
RecordBatchby comparing aTimestamp(_)column against a millisecond threshold. ReturnsOk(None)when no rows survive. - now_
unix_ millis - Wall clock as epoch milliseconds;
0if unreadable (callers fail open). - parse_
duration_ str - Parses a config duration string. Returns
Noneon malformed input.
Type Aliases§
- Fired
Timers Vec - Collection type for fired timers.
- Timer
Key - Timer key type optimized for window IDs (16 bytes).