Skip to main content

Module sink

Module sink 

Source
Expand description

File sink connector implementing SinkConnector.

Every flush publishes immutable files by atomically renaming same-directory temporary files. Publication generations are independent of checkpoint epochs so periodic flushes and process restarts cannot reuse final names. This is durable at-least-once output, not an atomic external checkpoint commit protocol.

Structsยง

FileSink
File sink connector that publishes immutable rolling files.