Skip to main content

build_ai_runtime

Function build_ai_runtime 

Source
pub(crate) fn build_ai_runtime(
    config: &ServerConfig,
) -> Result<Option<Arc<AiRuntime>>, ServerError>
Expand description

Build the AI runtime from configuration, or None if no models are configured.

ยงErrors

Returns ServerError::Build for an unset api_key_env, an unknown task name, a malformed model entry, or a provider client that fails to construct.