Struct OpenAiProvider 

pub struct OpenAiProvider { /* private fields */ }

OpenAI-compatible HTTP provider.

Implementations

impl OpenAiProvider

pub fn new( base_url: impl Into<String>, api_key: impl Into<String>, max_concurrency: usize, ) -> Result<Self, ProviderError>

Build a provider for base_url (e.g. https://api.openai.com/v1), authenticating with api_key and issuing at most max_concurrency concurrent chat requests per batch.

Errors

Returns ProviderError::Transport if the HTTP client cannot be built.

Trait Implementations

impl InferenceProvider for OpenAiProvider

fn infer_batch<'life0, 'async_trait>( &'life0 self, request: InferenceRequest, ) -> Pin<Box<dyn Future<Output = Result<InferenceResponse, ProviderError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Run one batch of inputs through the model.

fn name(&self) -> &'static str

Stable backend-kind identity for logging and the laminar.ai_calls log (e.g. anthropic, openai, local). Constant per implementor.

fn intrinsic_labels(&self, _model: &str) -> Option<Vec<String>>

Classifier labels intrinsic to a model, discovered from its own metadata. Returns None for backends that have none (remote providers, embedding models). A local classifier returns its config.json id2label once the model is on disk — the seam that lets a lazily downloaded classifier score without the labels having been known at startup. The default is None.