alt.freeweights.tools / Text Embeddings Inference

From:

huggingface <github.com/huggingface>Newsgroups: alt.freeweights.toolsSubject:

Text Embeddings Inference

Release: v1.9.4 (2026-09-15)Commit: e80ef22License: Apache-2.0

Fast server for embedding and reranker models, run from a container.

retrieval

v1.9.4releaseText Embeddings InferenceRustApache-2.0

FactsLicenseApache-2.0LanguageRustKindretrievalRelease2026-09-15PlatformsLinux, macOS, WindowsLinks to the projectpermissive

$ docker run --gpus all -p 8080:80 -v $PWD/data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:latest --model-id <id>

Overview Install Use with Freeweights License Provenance

Overview

Fast server for embedding and reranker models, run from a container.

Kind: retrieval
License: Apache-2.0
Language: Rust
Platforms: Linux, macOS, Windows
Latest release: v1.9.4 (2026-09-15)
Repository: huggingface/text-embeddings-inference

Topicsaiembeddingshuggingfacellmml

Freeweights links to the project and does not host tool binaries.

Install

$ docker run --gpus all -p 8080:80 -v $PWD/data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:latest --model-id <id>

$ docker run --gpus all -p 8080:80 -v $PWD/data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:latest --model-id <id>

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (284)

all-MiniLM-L6-v1 all-MiniLM-L6-v2 all-MiniLM-L6-v2-4bit all-mpnet-base-v1 allenai-specter bert-base-nli-max-tokens bert-base-nli-stsb-mean-tokens bert-large-nli-mean-tokens bge-m3-mlx-8bit bge-m3-mlx-fp16 bge-reasoner-embed-qwen3-8b-0923 BGE-VL-MLLM-S2 BGE-VL-v1.5-mmeb BGE-VL-v1.5-zs BiomedVLP-BioViL-T camembertav2-base clip-ViT-B-32-multilingual-v1 CLM-v0.1-8B-MLX-8bit CodeRankEmbed core-reranker-2b core-reranker-8b DenseOn distilbert-base-nli-mean-tokens distilbert-base-nli-stsb-mean-tokens distilbert-multilingual-nli-stsb-quora-ranking distilhubert distiluse-base-multilingual-cased E2Rank-4B E2Rank-8B embeddinggemma-2-4bit embeddinggemma-2-5bit embeddinggemma-2-bf16 embeddinggemma-2-mxfp4 embeddinggemma-2-mxfp8 embeddinggemma-2-nvfp4 encodec_48khz ettin-reranker-17m-v1 F2LLM-v2-160M F2LLM-v2-330M facebook-dpr-ctx_encoder-multiset-base granite-embedding-30m-sparse granite-embedding-reranker-english-r2 granite-vision-3.3-2b-embedding gte-small gtr-t5-base gtr-t5-large gtr-t5-xl harrier-oss-v1-27b jina-embeddings-v2-base-es jina-embeddings-v2-base-zh LaSER-Qwen3-4B LaSER-Qwen3-8B LCO-Embedding-Omni-7B LFM2.5-Embedding-350M LLARA-beir LLARA-document LLARA-passage LLARA-pretrain MEXMA mimi

and 224 more.

License

License: Apache-2.0
Class: Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From:

huggingface <github.com/huggingface>Newsgroups: alt.freeweights.toolsSubject: Text Embeddings InferenceRelease: v1.9.4 (2026-09-15)Commit: e80ef22License: Apache-2.0

Repository: huggingface/text-embeddings-inference
Pinned release: v1.9.4, 2026-09-15
Release commit: e80ef225ed0e6cb1717ce632a6a84b6cf211bb67
Default branch: main da9a9ce190444ef4326e1fbab15d298f0a1016c7
Fetched: 2026-11-14
Takedowns: None.

Freeweights links to the project and does not host tool binaries.

Get it

Install Project repository

Works with

284 catalog models. See the list