pub enum CachedOutput {
Text(String),
Vector(Vec<f32>),
Score(f64),
}Expand description
One row’s cached inference output. Mirrors the per-row shape of
crate::provider::InferenceOutputs but singular, since the cache is keyed
per row of input.
Variants§
Text(String)
A text output (label, completion, summary, …).
Vector(Vec<f32>)
A numeric vector output (embedding).
Score(f64)
A scalar score output (ai_sentiment, continuous in [-1, 1]).
Trait Implementations§
Source§impl Clone for CachedOutput
impl Clone for CachedOutput
Source§fn clone(&self) -> CachedOutput
fn clone(&self) -> CachedOutput
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CachedOutput
impl Debug for CachedOutput
Source§impl PartialEq for CachedOutput
impl PartialEq for CachedOutput
Source§fn eq(&self, other: &CachedOutput) -> bool
fn eq(&self, other: &CachedOutput) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for CachedOutput
Auto Trait Implementations§
impl Freeze for CachedOutput
impl RefUnwindSafe for CachedOutput
impl Send for CachedOutput
impl Sync for CachedOutput
impl Unpin for CachedOutput
impl UnsafeUnpin for CachedOutput
impl UnwindSafe for CachedOutput
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more