From: HuggingFaceTB <huggingface.co/HuggingFaceTB> Newsgroups: alt.freeweights.smollmSubject: SmolLM2-360M-Instruct-Q8-mlx Date: 2026-11-14Commit: f490e92Signed: 2DC28CC7B26A283B ✓ Text generation model with 362M parameters. Safetensors weights, 389 MB in all. Published by HuggingFaceTB under Apache-2.0.
362M params 389 MB SmolLM2-360M-Instruct-Q8-mlx safetensors permissive
Facts Params 362M Size 389 MB Formats safetensors Task text generation License Apache-2.0 permissive
fw
$ fw get HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx
# manifest sha256 73c72dd4f05c… · 389 MB · 10 files
$ fw verify ./SmolLM2-360M-Instruct-Q8-mlx HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlxHosted (signed) HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx Last check: 2026-11-14 21:11 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of SmolLM2-360M-Instruct .
Works with
Runs with Ranked by fit to this model (safetensors), then by GitHub stars.
Show all 24 Fine-tune with Show all 29
Overview
Size 389 MB
Weights 385 MB (safetensors)
Parameters 362M
Formats safetensors
Task text generation
License Apache-2.0 (permissive)
Files 10, each with a sha256
Publisher HuggingFaceTB
Added 2026-11-14
Section alt.freeweights.smollm Lineage
Original release from the publisher.
Base model: HuggingFaceTB/SmolLM2-360M-Instruct
Where these bytes come from
Publisher at the pinned commit →You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
Badge Host Last check Result huggingface.co 2026-11-14 21:11 UTC passed
Model card From the publisher at commit
f490e92 . Shown as plain text with links; images open at the publisher.
reach-vb/SmolLM2-360M-Instruct-Q8-mlx#
The Model reach-vb/SmolLM2-360M-Instruct-Q8-mlx was converted to MLX format from HuggingFaceTB/SmolLM2-360M-Instruct using mlx-lm version 0.19.2 .
Use with mlx#
from mlx_lm import load, generate
model, tokenizer = load("reach-vb/SmolLM2-360M-Instruct-Q8-mlx")
prompt="hello"
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)Files 10 files · 389 MB Weights 385 MB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 10 files with their sha256 File Size sha256 .gitattributes 1.52 KB 11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361 README.md 1.03 KB 456b0761ae04c5177094436436ae26b169c51074ff80c9e2b8f1684ec5c26471 config.json 1.08 KB 976538caa09c68733e516e130a386fdf86333bb5d2c1c97c1f9940cfbcff2e1d merges.txt 466 KB 0b54e8aa4e53d5383e2e4bc635a56b43f9647f7b13832d5d9ecd8f82dac4f510 model.safetensors 385 MB eb63ac35b551c66cc904e79fb419ecd90cb3cd2431c686b5e7dbbacc7f8f81f9 model.safetensors.index.json 52.2 KB f3222091e3f9daf0d5976a04644101c366fb5603915ca7c10af585d59943debf special_tokens_map.json 655 B 2b7379f3ae813529281a5c602bc5a11c1d4e0a99107aaa597fe936c1e813ca52 tokenizer.json 3.52 MB 7d27c493c729a66ecefc837280b05d948b1ed50d130eebdbf911b1b36cf38ed7 tokenizer_config.json 3.76 KB a27f638bd2831f5c3dea654a75838930f2b11fbe550c4d4e1d5d7bd07157b2ee vocab.json 801 KB 82b84012e3add4d01d12ba14442026e49b8cbbaead1f79ecf3d919784f82dc79
Versions Each time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commit Date Contents f490e92c20 pinned now manifest updated, same commit 2026-11-14 21:11 UTC 10 files · 389 MB f490e92c20 2026-11-14 21:11 UTC 10 files · 389 MB
Use it fw
$ fw get HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx
# manifest sha256 73c72dd4f05c… · 389 MB · 10 files
$ fw verify ./SmolLM2-360M-Instruct-Q8-mlx HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlxfw.py Checks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx.json --dir ./SmolLM2-360M-Instruct-Q8-mlx
$ python3 fw.py verify ./SmolLM2-360M-Instruct-Q8-mlx ./HuggingFaceTB__SmolLM2-360M-Instruct-Q8-mlx.jsonhf The Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx --revision f490e92c20a48dcfdbb730c1681fc101bfeb5ef9 --local-dir ./SmolLM2-360M-Instruct-Q8-mlxtransformers Load the weights in Python.
import os
os.environ["HF_ENDPOINT" ] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx", revision="f490e92c20a48dcfdbb730c1681fc101bfeb5ef9")
model = AutoModelForCausalLM.from_pretrained("HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx", revision="f490e92c20a48dcfdbb730c1681fc101bfeb5ef9", device_map="auto")vLLM Serve an OpenAI-compatible API.
$ HF_ENDPOINT =https://freeweights.allternit.com vllm serve HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx --revision f490e92c20a48dcfdbb730c1681fc101bfeb5ef9License Name Apache License 2.0 Id Apache-2.0 Class Permissive Redistribution yes Listing Hosted (signed) Decided License as declared by the publisher. No person read it. 2026-11-14 Text in README.md Text sha256 456b0761ae04c5177094436436ae26b169c51074ff80c9e2b8f1684ec5c26471 Terms gate No extra terms beyond the license. Read the license text
Licenses are checked against the license table . A custom license passes only after a person reads it.
Provenance From: HuggingFaceTB <huggingface.co/HuggingFaceTB> Newsgroups: alt.freeweights.smollmSubject: SmolLM2-360M-Instruct-Q8-mlx Date: 2026-11-14Commit: f490e92Signed: 2DC28CC7B26A283B ✓
How to verify
$ curl -O https://freeweights.allternit.com/manifests/HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx.json
$ curl -O https://freeweights.allternit.com/manifests/HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx.json.minisig
$ minisign -Vm SmolLM2-360M-Instruct-Q8-mlx.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tab A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree No model in the catalog names this one as its parent.
Get it
$ HF_ENDPOINT =https://freeweights.allternit.com hf download HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlxOpen in Freeweights Studio Pull, verify and run it in the Allternit app on Desktop, web or phone.
135M params 272 MB 135M-lc-100k-rope-12B safetensors permissive Facts Params 135M Size 272 MB Formats safetensors Task text generation License Apache-2.0 permissive flip From: HuggingFaceTB <huggingface.co/HuggingFaceTB> Subject: 135M-lc-100k-rope-12B smollm 2.09 GB Biggie-SmoLlm-0.4B gguf permissive Facts Params not stated Size 2.09 GB Formats gguf Task text generation License Apache-2.0 permissive flip From: nisten <huggingface.co/nisten> Subject: Biggie-SmoLlm-0.4B smollm 4.29 GB Biggie-SmoLlm-0.4B-ONNX onnx permissive Facts Params not stated Size 4.29 GB Formats onnx Task text generation License unknown permissive flip From: <huggingface.co/onnx-community> Subject: Biggie-SmoLlm-0.4B-ONNX 1.8B params 1.04 GB SmolLM-1.7B-bnb-4bit safetensors permissive Facts Params 1.8B Size 1.04 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: <huggingface.co/unsloth> Subject: SmolLM-1.7B-bnb-4bit 1.7B params 3.43 GB SmolLM-1.7B-Instruct safetensors permissive Facts Params 1.7B Size 3.43 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: <huggingface.co/unsloth> Subject: SmolLM-1.7B-Instruct 138M params 115 MB SmolLM-135M-bnb-4bit safetensors permissive Facts Params 138M Size 115 MB Formats safetensors Task text generation License Apache-2.0 permissive flip From: <huggingface.co/unsloth> Subject: SmolLM-135M-bnb-4bit
onnx-community 
unsloth