Module streaming 

In-memory streaming API — a bounded Source queue drained by its single Sink.

Re-exports

pub use channel::channel;

pub use channel::AsyncConsumer;

pub use channel::Producer;

pub use checkpoint::StreamCheckpointConfig;

pub use config::BackpressureStrategy;

pub use config::ChannelConfig;

pub use config::SourceConfig;

pub use config::WaitStrategy;

pub use error::RecvError;

pub use error::StreamingError;

pub use error::TryPushError;

pub use sink::Sink;

pub use source::create_for_schema_planning;

pub use source::create;

pub use source::create_with_config;

pub use source::Record;

pub use source::Source;

Modules

channel

Bounded MPSC channel backed by crossfire.

checkpoint

Streaming checkpoint configuration.

config

Configuration types for channels, sources, and sinks.

error

Streaming error types.

sink

Sink — the single consumer of a source’s bounded queue.

source

Source — entry point for data into a streaming pipeline.

Constants

DEFAULT_SOURCE_MAX_QUEUED_BYTES

Default Arrow-byte limit per source for batches its sink has not yet received (64 MiB).

MAX_SOURCE_QUEUED_BYTES

Largest byte limit supported by source semaphore reservations.

Functions

retained_arrow_bytes

Arrow-reported retained array storage plus fixed batch/column charges.

validate_source_max_queued_bytes

Validates an in-process source’s Arrow-byte limit.