pub struct InferenceParams {
pub labels: Option<Vec<String>>,
}Expand description
Knobs that shape a request and contribute to the cache’s params_version,
so the same text under different parameters never collides. Generation knobs
(max_tokens, temperature, …) are added here as backends consume them.
Fields§
§labels: Option<Vec<String>>Candidate label set for classification (required for remote classify; for local classifiers it must match or be a subset of the model’s intrinsic labels, validated at plan time).
Trait Implementations§
Source§impl Clone for InferenceParams
impl Clone for InferenceParams
Source§fn clone(&self) -> InferenceParams
fn clone(&self) -> InferenceParams
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for InferenceParams
impl Debug for InferenceParams
Source§impl Default for InferenceParams
impl Default for InferenceParams
Source§fn default() -> InferenceParams
fn default() -> InferenceParams
Returns the “default value” for a type. Read more
Source§impl PartialEq for InferenceParams
impl PartialEq for InferenceParams
Source§fn eq(&self, other: &InferenceParams) -> bool
fn eq(&self, other: &InferenceParams) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for InferenceParams
Auto Trait Implementations§
impl Freeze for InferenceParams
impl RefUnwindSafe for InferenceParams
impl Send for InferenceParams
impl Sync for InferenceParams
impl Unpin for InferenceParams
impl UnsafeUnpin for InferenceParams
impl UnwindSafe for InferenceParams
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more