Expand description
AutoLoader-style file source and sink connectors. File source and sink connectors.
Re-exports§
pub use config::FileFormat;pub use config::FileSinkConfig;pub use config::FileSourceConfig;pub use config::SinkMode;pub use manifest::FileEntry;pub use manifest::FileIngestionManifest;pub use sink::FileSink;pub use source::FileSource;pub use text_decoder::TextLineDecoder;
Modules§
- arrow_
ipc_ codec - Arrow IPC file format decoder and encoder.
- config
- Configuration types for the file source and sink connectors.
- discovery
- File discovery engine (Ring 2).
- manifest
- File ingestion manifest with bounded retention.
- sink
- File sink connector implementing
SinkConnector. - source
- File source connector implementing
SourceConnector. - text_
decoder - Plain text line decoder implementing
FormatDecoder.
Functions§
- register_
file_ sink - Registers the file sink connector in the registry.
- register_
file_ source - Registers the file source connector in the registry.