Expand description
Assembled AI subsystem: registry, provider clients, result cache, and call log.
Built once at startup; AiRuntime::resolve returns everything the inference
operator needs to run a named model.
Structs§
- AiRuntime
- The assembled AI subsystem.
- Resolved
Model - Everything the inference operator needs to run one model.
Enums§
- AiRuntime
Error - Errors from resolving a model to a runnable backend.