Skip to main content

Module sink

laminar_connectors::postgres

Module sink 

Source
Expand description

PostgreSQL sink connector implementation.

PostgresSink implements SinkConnector, writing Arrow RecordBatch data to PostgreSQL tables via two strategies:

  • Append mode: COPY BINARY for maximum throughput (>500K rows/sec)
  • Upsert mode: INSERT ... ON CONFLICT DO UPDATE with UNNEST arrays

The connector provides durable at-least-once delivery. Typed runtime admission excludes it from exactly-once pipelines because it has no coordinated external checkpoint committer.

§Ring Architecture

  • Ring 0: No sink code. Data arrives via SPSC channel (~5ns push).
  • Ring 1: Batch buffering, COPY/INSERT writes, transaction management.
  • Ring 2: Connection pool and table creation.

Structs§

PostgresSink
PostgreSQL sink connector.