Skip to main content

Module local

Module local 

Source
Expand description

Local inference via ONNX Runtime (loaded dynamically). Encoder models only: classify/sentiment return logits, embed returns a mean-pooled vector. Sources: hf:org/repo (downloaded on first use), file://<path>, or a bare path. onnxruntime.{dll,so} >= 1.24 must be on the search path or via ORT_DYLIB_PATH.

Structs§

LocalProvider
Local ONNX provider backed by a model cache directory.

Functions§

load_labels
Classifier labels from config.json id2label, ordered by index. Empty if absent or unparseable.
model_dir
On-disk directory for a source: hf:org/repo<cache_dir>/org/repo; file://<path> or bare path used as-is.