Crate laminar_connectors 

LaminarDB Connectors

External system connectors and the Connector SDK for streaming data in and out of LaminarDB.

Connector SDK

The SDK provides traits and utilities for building connectors:

• connector - Core traits (SourceConnector, SinkConnector)
• serde - Serialization framework (JSON, CSV, Debezium)
• registry - Factory pattern for connector instantiation
• testing - Mock connectors and test utilities (feature-gated)

Architecture

Ring 0: Hot Path
  Source<T>::push_arrow() <-- deserialized RecordBatch
  Subscription::poll()   --> RecordBatch for serialization

Ring 1: Connectors
  SourceConnector(poll) -> Serde(deser) -> push_arrow
  SinkConnector(write)  <- Serde(ser)   <- subscription(poll)

Modules

cdc

Change Data Capture connectors for databases. CDC (Change Data Capture) connectors for databases.

checkpoint

Connector checkpoint types. Connector checkpoint types.

config

Connector configuration types. Connector configuration types.

connector

Core connector traits (SourceConnector, SinkConnector). Core connector traits.

error

Connector error types. Connector SDK error types.

files

AutoLoader-style file source and sink connectors. AutoLoader-style file source and sink connectors.

health

Connector health status types. Connector health status types.

kafka

Kafka source and sink connectors. Kafka source and sink connectors for LaminarDB.

lakehouse

Lakehouse connectors (Delta Lake, Iceberg). Lakehouse connectors (Delta Lake).

lookup

Lookup table support for enrichment joins.

metrics

Connector metrics types. Connector metrics types.

postgres

PostgreSQL sink connector. PostgreSQL sink connector.

reference

Reference table source trait and refresh modes. Reference table source trait and refresh modes.

registry

Connector registry with factory pattern. Connector registry with factory pattern.

schema

Schema inference, resolution, and evolution framework. Schema inference, resolution, and evolution framework.

serde

Record serialization and deserialization framework. Record serialization and deserialization framework.

storage

Cloud storage infrastructure (credential resolution, validation, secret masking). Cloud storage infrastructure for lakehouse connectors.

testing

Testing utilities (mock connectors, helpers). Testing utilities for connector implementations.

websocket

WebSocket source and sink connectors. WebSocket source and sink connectors for LaminarDB.