Skip to main content

maybe_rate_limit

laminardb::ai

Function maybe_rate_limit 

Source 
fn maybe_rate_limit(
    provider: Arc<dyn InferenceProvider>,
    cfg: &ProviderConfig,
) -> Arc<dyn InferenceProvider>
Expand description

Pace a provider to requests_per_second when configured, else leave it as-is.