From: 
ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.qwenSubject: Qwen3-0.6B-GGUF
Date: 2026-11-14Commit: afe8ad3Signed: 2DC28CC7B26A283B ✓Text generation model. Gguf weights, 4.25 GB in all. Published by ggml-org under Apache-2.0.
qwen4.25GBQwen3-0.6B-GGUFggufpermissive FactsParamsnot statedSize4.25 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive
fw
$ fw get ggml-org/Qwen3-0.6B-GGUF
# manifest sha256 fb8de1119406… · 4.25 GB · 8 files
$ fw verify ./Qwen3-0.6B-GGUF ggml-org/Qwen3-0.6B-GGUF
From sourceHosted (signed)ggml-org/Qwen3-0.6B-GGUFLast check: 2026-11-14 21:28 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of Qwen3-0.6B.
Works with
Runs with
Ranked by fit to this model (gguf), then by GitHub stars.
Show all 14
Overview
- Size
- 4.25 GB
- Weights
- 429 MB (smallest of 4 GGUF variants)
- Parameters
- not stated
- Formats
- gguf
- Task
- text generation
- License
- Apache-2.0 (permissive)
- Files
- 8, each with a sha256
- Publisher
- ggml-org
- Added
- 2026-11-14
- Section
- alt.freeweights.qwen
Lineage
Original release from the publisher.
Base model: Qwen/Qwen3-0.6B
Where these bytes come from
Publisher at the pinned commit→You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
| Badge | Host | Last check | Result |
|---|
| From source | huggingface.co | 2026-11-14 21:28 UTC | passed |
Model card
From the publisher at commit
afe8ad3. Shown as plain text with links; images open at the publisher.
Files
8 files · 4.25 GBWeights 429 MB (smallest of 4 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 8 files with their sha256
| File | Size | sha256 |
|---|
| .gitattributes | 1.80 KB | d76c0a19b001f0a0cc61852f04e6de52038ba768ec8657c26c03a4976f78f590 |
| .src_sha | 49 B | 28f0fc255f8a2587eea6c64572f649f00a0fe46f368661331dc3d291c3cd2e79 |
| Qwen3-0.6B-BF16.gguf | 1.51 GB | 65a16246f5814dc0587acadcf0328186b17febf6dcaeb1b13efa9243b551d38e |
| Qwen3-0.6B-Q4_0.gguf | 429 MB | da2572f16c06133561ce56accaa822216f2391ef4d37fba427801cd6736417d4 |
| Qwen3-0.6B-Q8_0.gguf | 805 MB | 361cc68159042c36ebff7715dc5a2e4612153e88f3e9c9c234820849d6dc9e1d |
| Qwen3-0.6B-f16.gguf | 1.51 GB | ab9004daf660cd6a6ba1c07556e74fcceb2b756063ccce3f9c69d3a637b361cc |
| README.md | 406 B | f5c4763420b919dae90259601230e421bd2b4931a1c7f223735f404106bd2897 |
| convert.log | 82.7 KB | afd33323d985b1bcb32fd3a460a3f970e7c122b4f633e6dab4263b1f29949173 |
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
| Upstream commit | Date | Contents |
|---|
| afe8ad3577 pinned now manifest updated, same commit | 2026-11-14 21:28 UTC | 8 files · 4.25 GB |
| afe8ad3577 | 2026-11-14 21:28 UTC | 8 files · 4.25 GB |
Use it
fw
$ fw get ggml-org/Qwen3-0.6B-GGUF
# manifest sha256 fb8de1119406… · 4.25 GB · 8 files
$ fw verify ./Qwen3-0.6B-GGUF ggml-org/Qwen3-0.6B-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ggml-org/Qwen3-0.6B-GGUF.json --dir ./Qwen3-0.6B-GGUF
$ python3 fw.py verify ./Qwen3-0.6B-GGUF ./ggml-org__Qwen3-0.6B-GGUF.jsonhfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Qwen3-0.6B-GGUF --revision afe8ad3577aa22500b3cd1c880f153b3b0e1cae8 --local-dir ./Qwen3-0.6B-GGUFllama.cppDownload one GGUF variant (Qwen3-0.6B-Q4_0, 429 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Qwen3-0.6B-GGUF --include "Qwen3-0.6B-Q4_0*" --local-dir ./Qwen3-0.6B-GGUF
$ llama-server -m ./Qwen3-0.6B-GGUF/Qwen3-0.6B-Q4_0.ggufOllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Qwen3-0.6B-GGUF/Qwen3-0.6B-Q4_0.gguf\n' > Modelfile
$ ollama create qwen3-0.6b-gguf -f ModelfileLicense
- Name
- Apache License 2.0
- Id
- Apache-2.0
- Class
- Permissive
- Redistribution
- yes
- Listing
- Hosted (signed)
- Decided
- License as declared by the publisher. No person read it. 2026-11-14
- Text in
- README.md
- Text sha256
- f5c4763420b919dae90259601230e421bd2b4931a1c7f223735f404106bd2897
- Terms gate
- No extra terms beyond the license.
Read the license text
Licenses are checked against the license table. A custom license passes only after a person reads it.
Provenance
From: ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.qwenSubject: Qwen3-0.6B-GGUFDate: 2026-11-14Commit: afe8ad3Signed: 2DC28CC7B26A283B ✓ - Upstream
- ggml-org/Qwen3-0.6B-GGUF
- Pinned commit
- afe8ad3577aa22500b3cd1c880f153b3b0e1cae8
- Manifest
- Qwen3-0.6B-GGUF.json · .minisig
- Manifest sha256
- fb8de111940662471fd5aff84f1f9377705ebc8a0c31313ca0cad41423980e94
- Signature
- minisign, Ed25519, key 2DC28CC7B26A283B
- Created
- 2026-11-14 21:28 UTC
- Generator
- freeweights-manifest/0.1.0
- Takedowns
- None.
How to verify
$ curl -O https://freeweights.allternit.com/manifests/ggml-org/Qwen3-0.6B-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/ggml-org/Qwen3-0.6B-GGUF.json.minisig
$ minisign -Vm Qwen3-0.6B-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tabA manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree
No model in the catalog names this one as its parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Qwen3-0.6B-GGUFPull, verify and run it in the Allternit app on Desktop, web or phone.
From: 
BAAI <huggingface.co/BAAI>Subject: Aquila-VL-2B-llava-qwen From: Perciqa <huggingface.co/Perciqa>Subject: Aurora-Code-1 From: BAAI <huggingface.co/BAAI>Subject: bge-reasoner-embed-qwen3-8b-0923 From: amazon <huggingface.co/amazon>Subject: BMOJOF-primed-HQwen3-8B-Instruct From: nbeerbower <huggingface.co/nbeerbower>Subject: Bubba-Qwen3.6-27B-LoRA From: bartowski <huggingface.co/bartowski>Subject: bytkim_Qwen3.8-27B-pi-GGUF 
