pub struct InferenceResponse {
pub outputs: InferenceOutputs,
pub usage: Usage,
}Expand description
The result of a batch inference call: outputs aligned 1:1 with the request’s inputs, plus usage.
Fields§
§outputs: InferenceOutputsPer-row outputs, in input order.
usage: UsageToken/cost accounting for the call.
Trait Implementations§
Source§impl Clone for InferenceResponse
impl Clone for InferenceResponse
Source§fn clone(&self) -> InferenceResponse
fn clone(&self) -> InferenceResponse
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for InferenceResponse
impl Debug for InferenceResponse
Source§impl PartialEq for InferenceResponse
impl PartialEq for InferenceResponse
Source§fn eq(&self, other: &InferenceResponse) -> bool
fn eq(&self, other: &InferenceResponse) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for InferenceResponse
Auto Trait Implementations§
impl Freeze for InferenceResponse
impl RefUnwindSafe for InferenceResponse
impl Send for InferenceResponse
impl Sync for InferenceResponse
impl Unpin for InferenceResponse
impl UnsafeUnpin for InferenceResponse
impl UnwindSafe for InferenceResponse
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more