Skip to main content

Module call_log

Module call_log 

Source
Expand description

Bounded in-memory log of inference calls, surfaced as laminar.ai_calls.

One record per batch call — local and remote alike. Remote calls carry tokens and cost; local calls report Usage::ZERO. The log is written from the Ring 1 inference worker and read by queries against laminar.ai_calls, so it is behind a lock; it is never touched on Ring 0. The buffer is bounded — the oldest record is dropped once full — and a monotonic counter records how many calls were ever logged.

Structs§

AiCallLog
Bounded ring buffer of AiCallRecords.
AiCallRecord
One logged inference call.

Enums§

CallOutcome
Outcome of a batch call.