Skip to main content

build_provider

Function build_provider 

Source
fn build_provider(
    name: &str,
    cfg: &ProviderConfig,
) -> Result<Option<Arc<dyn InferenceProvider>>, ServerError>
Expand description

Build one remote provider client. Returns None for the local backend (it is the runtime’s separate local_provider, not an entry in the providers map).