From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.qwenSubject: Qwen3-Embedding-8B-4bit-DWQ Date: 2026-11-15Commit: 885642dSigned: 2DC28CC7B26A283B ✓ Feature extraction model with 7.6B parameters. Safetensors weights, 4.27 GB in all. Published by mlx-community under Apache-2.0.
7.6B params 4.27 GB Qwen3-Embedding-8B-4bit-DWQ safetensors permissive Facts Params 7.6B Size 4.27 GB Formats safetensors Task feature extraction License Apache-2.0 permissive
fw
$ fw get mlx-community/Qwen3-Embedding-8B-4bit-DWQ
# manifest sha256 3065c233271d… · 4.27 GB · 13 files
$ fw verify ./Qwen3-Embedding-8B-4bit-DWQ mlx-community/Qwen3-Embedding-8B-4bit-DWQHosted (signed) mlx-community/Qwen3-Embedding-8B-4bit-DWQ Last check: 2026-11-15 04:58 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of Qwen3-Embedding-8B .
Works with
Runs with Ranked by fit to this model (safetensors), then by GitHub stars.
Overview
Size 4.27 GB
Weights 4.26 GB (safetensors)
Parameters 7.6B
Formats safetensors
Task feature extraction
License Apache-2.0 (permissive)
Files 13, each with a sha256
Publisher mlx-community
Added 2026-11-15
Section alt.freeweights.qwen Lineage
Original release from the publisher.
Base model: Qwen/Qwen3-Embedding-8B
Where these bytes come from
Publisher at the pinned commit →You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
Badge Host Last check Result huggingface.co 2026-11-15 04:58 UTC passed
Model card From the publisher at commit
885642d . Shown as plain text with links; images open at the publisher.
This model mlx-community/Qwen3-Embedding-8B-4bit-DWQ was converted to MLX format from Qwen/Qwen3-Embedding-8B using mlx-lm version 0.25.1 .
Use with mlx#
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/Qwen3-Embedding-8B-4bit-DWQ")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True) Files 13 files · 4.27 GB Weights 4.26 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 13 files with their sha256 File Size sha256 .gitattributes 1.57 KB 34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930 README.md 958 B 9be2a469b56df4f9bfa8e44e8c1db716b04801db1ab8f7c78391f4b934a044a6 added_tokens.json 605 B 58b54bbe36fc752f79a24a271ef66a0a0830054b4dfad94bde757d851968060b chat_template.jinja 2.43 KB 44d5f08f3f72b837eaad09f13a54c1f9f4eb58d75240334548b7fd52a5437fa5 config.json 938 B 32e5ce8200e25d6afc86908eab6e86a938903e89d73ee7771ee13fcecad6f1aa generation_config.json 117 B 28396d421a2108acce96383f6a7de78008f7f1b17f807958f3c14c51dbfb65fb merges.txt 1.67 MB 8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5 model.safetensors 4.26 GB c0a6f22bbf4ce303bd3c333841bbcf5b8ebd3669495a457326a0515ad0fe0e46 model.safetensors.index.json 64.0 KB b30895f94b9eb3f17d65bf54d25f12b26d28b3b582dee1a7990e6769d16699a4 special_tokens_map.json 613 B 76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd tokenizer.json 11.4 MB 83cdf8c3a34f68862319cb1810ee7b1e2c0a44e0864ae930194ddb76bb7feb8d tokenizer_config.json 4.69 KB 0a04a9d7d4a62b28482bdfe726c122756de85714fb64166ace92ae75b8f57614 vocab.json 2.78 MB ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
Versions Each time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commit Date Contents 885642d6b9 pinned now 2026-11-15 04:58 UTC 13 files · 4.27 GB
Use it fw
$ fw get mlx-community/Qwen3-Embedding-8B-4bit-DWQ
# manifest sha256 3065c233271d… · 4.27 GB · 13 files
$ fw verify ./Qwen3-Embedding-8B-4bit-DWQ mlx-community/Qwen3-Embedding-8B-4bit-DWQfw.py Checks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/Qwen3-Embedding-8B-4bit-DWQ.json --dir ./Qwen3-Embedding-8B-4bit-DWQ
$ python3 fw.py verify ./Qwen3-Embedding-8B-4bit-DWQ ./mlx-community__Qwen3-Embedding-8B-4bit-DWQ.jsonhf The Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/Qwen3-Embedding-8B-4bit-DWQ --revision 885642d6b98742ea03b77a1673579c92ca961efd --local-dir ./Qwen3-Embedding-8B-4bit-DWQtransformers Load the weights in Python.
import os
os.environ["HF_ENDPOINT" ] = "https://freeweights.allternit.com"
from transformers import AutoModel, AutoTokenizer
tok = AutoTokenizer.from_pretrained("mlx-community/Qwen3-Embedding-8B-4bit-DWQ", revision="885642d6b98742ea03b77a1673579c92ca961efd")
model = AutoModel.from_pretrained("mlx-community/Qwen3-Embedding-8B-4bit-DWQ", revision="885642d6b98742ea03b77a1673579c92ca961efd", device_map="auto")License Name Apache License 2.0 Id Apache-2.0 Class Permissive Redistribution yes Listing Hosted (signed) Decided License as declared by the publisher. No person read it. 2026-11-15 Text in README.md Text sha256 9be2a469b56df4f9bfa8e44e8c1db716b04801db1ab8f7c78391f4b934a044a6 Terms gate No extra terms beyond the license. Read the license text
Licenses are checked against the license table . A custom license passes only after a person reads it.
Provenance From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.qwenSubject: Qwen3-Embedding-8B-4bit-DWQ Date: 2026-11-15Commit: 885642dSigned: 2DC28CC7B26A283B ✓ How to verify
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/Qwen3-Embedding-8B-4bit-DWQ.json
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/Qwen3-Embedding-8B-4bit-DWQ.json.minisig
$ minisign -Vm Qwen3-Embedding-8B-4bit-DWQ.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tab A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree No model in the catalog names this one as its parent.
Get it
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/Qwen3-Embedding-8B-4bit-DWQOpen in Freeweights Studio Pull, verify and run it in the Allternit app on Desktop, web or phone.
2.2B params 4.37 GB Aquila-VL-2B-llava-qwen safetensors permissive Facts Params 2.2B Size 4.37 GB Formats safetensors Task visual question answering License Apache-2.0 permissive flip From: <huggingface.co/BAAI> Subject: Aquila-VL-2B-llava-qwen 34.7B params 69.3 GB Aurora-Code-1 safetensors permissive Facts Params 34.7B Size 69.3 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: Perciqa <huggingface.co/Perciqa> Subject: Aurora-Code-1 7.6B params 30.6 GB bge-reasoner-embed-qwen3-8b-0923 safetensors permissive Facts Params 7.6B Size 30.6 GB Formats safetensors Task feature extraction License Apache-2.0 permissive flip From: <huggingface.co/BAAI> Subject: bge-reasoner-embed-qwen3-8b-0923 9.3B params 18.5 GB BMOJOF-primed-HQwen3-8B-Instruct safetensors permissive Facts Params 9.3B Size 18.5 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: amazon <huggingface.co/amazon> Subject: BMOJOF-primed-HQwen3-8B-Instruct qwen 658 MB Bubba-Qwen3.6-27B-LoRA safetensors permissive Facts Params not stated Size 658 MB Formats safetensors Task not tagged License Apache-2.0 permissive flip From: nbeerbower <huggingface.co/nbeerbower> Subject: Bubba-Qwen3.6-27B-LoRA qwen 447 GB bytkim_Qwen3.8-27B-pi-GGUF gguf permissive Facts Params not stated Size 447 GB Formats gguf Task image text to text License Apache-2.0 permissive flip From: bartowski <huggingface.co/bartowski> Subject: bytkim_Qwen3.8-27B-pi-GGUF
mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.qwenSubject: 
BAAI