Expand description
Local inference via ONNX Runtime (loaded dynamically). Encoder models only:
classify/sentiment return logits, embed returns a mean-pooled vector. Sources:
hf:org/repo (downloaded on first use), file://<path>, or a bare path.
onnxruntime.{dll,so} >= 1.24 must be on the search path or via ORT_DYLIB_PATH.
Structs§
- Local
Provider - Local ONNX provider backed by a model cache directory.
Functions§
- load_
labels - Classifier labels from
config.jsonid2label, ordered by index. Empty if absent or unparseable. - model_
dir - On-disk directory for a source:
hf:org/repo→<cache_dir>/org/repo;file://<path>or bare path used as-is.