Skip to main content

Module connector

Module connector 

Source
Expand description

Core connector traits (SourceConnector, SinkConnector). Connector traits — async SourceConnector / SinkConnector.

Structs§

ConnectorTaskAdmission
Cloneable, non-owning admission handle for dynamically spawned connector tasks.
ConnectorTaskGuard
RAII proof that one connector-owned task is still active.
ConnectorTaskOwner
Sole admission authority for detached tasks owned by one connector generation.
ConnectorTaskTracker
Cloneable observer for terminal completion of one connector generation.
CoordinatedCommitBatch
Exact batch submitted to a designated external-sink committer.
CoordinatedCommitContext
Runtime-owned deadline for one designated external publication.
CoordinatedCommitCursor
Exact external commit position and the authority that published it.
CoordinatedCommitNamespace
Stable external commit namespace for one deployment incarnation of a logical pipeline sink.
CoordinatedCommitPayload
One participant’s validated prepared marker for one exact attempt.
SinkContract
Complete sink admission contract for a concrete connector configuration.
SourceBatch
A batch of records read from a source connector.
SourceContract
Complete source admission contract for a concrete connector configuration.
SourceDrainRequest
Exact cluster transition for which a source must stop advancing input.
SourceDrainResolution
Exact round resolution delivered to a source connector.
SourceStart
Complete source startup request.
WriteResult
Summary of a successful write_batch call.

Enums§

ConnectorCancellationPolicy
What the runtime must do when a started connector operation is cancelled.
DeliveryGuarantee
Delivery guarantee level for the pipeline.
SinkConsistency
Durability protocol provided by a sink.
SinkInputMode
The strongest input update model a configured sink understands.
SinkTopology
How a sink may be placed across runtime nodes.
SourceConsistency
Recovery semantics provided by a source.
SourceDrainOutcome
Terminal resolution of one exact source drain round.
SourcePosition
Atomic startup position for a source connector.
SourceTopology
How a source may be placed across runtime nodes.

Constants§

MAX_COORDINATED_COMMIT_BATCH_BYTES
Fixed aggregate control-plane bound for one designated commit call.
MAX_COORDINATED_COMMIT_BATCH_ENTRIES
Fixed participant-marker bound for one designated commit call.
MAX_COORDINATED_COMMIT_PAYLOAD_BYTES
Fixed control-plane bound for one connector’s coordinated-commit payload.

Traits§

CoordinatedCommitter
Leader-side commit for checkpoint-committable sinks.
SinkConnector
Trait for sink connectors that write data to external systems.
SourceConnector
Trait for source connectors that read data from external systems.