From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.smollmSubject: SmolLM2-135M-Instruct-8bit Date: 2026-11-15Commit: 0f0d9b8Signed: 2DC28CC7B26A283B ✓ Text generation model with 135M parameters. Safetensors weights, 148 MB in all. Published by mlx-community under Apache-2.0.
135M params 148 MB SmolLM2-135M-Instruct-8bit safetensors permissive Facts Params 135M Size 148 MB Formats safetensors Task text generation License Apache-2.0 permissive
fw
$ fw get mlx-community/SmolLM2-135M-Instruct-8bit
# manifest sha256 dfc33927c30c… · 148 MB · 10 files
$ fw verify ./SmolLM2-135M-Instruct-8bit mlx-community/SmolLM2-135M-Instruct-8bitHosted (signed) mlx-community/SmolLM2-135M-Instruct-8bit Last check: 2026-11-15 04:59 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of SmolLM2-135M-Instruct .
Works with
Runs with Ranked by fit to this model (safetensors), then by GitHub stars.
Show all 24 Fine-tune with Show all 29
Overview
Size 148 MB
Weights 143 MB (safetensors)
Parameters 135M
Formats safetensors
Task text generation
License Apache-2.0 (permissive)
Files 10, each with a sha256
Publisher mlx-community
Added 2026-11-15
Section alt.freeweights.smollm Lineage
Original release from the publisher.
Base model: mlx-community/SmolLM2-135M-Instruct
Where these bytes come from
Publisher at the pinned commit →You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
Badge Host Last check Result huggingface.co 2026-11-15 04:59 UTC passed
Model card From the publisher at commit
0f0d9b8 . Shown as plain text with links; images open at the publisher.
The Model mlx-community/SmolLM2-135M-Instruct-8bit was converted to MLX format from mlx-community/SmolLM2-135M-Instruct using mlx-lm version 0.19.3 .
Use with mlx#
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/SmolLM2-135M-Instruct-8bit")
prompt="hello"
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True) Files 10 files · 148 MB Weights 143 MB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 10 files with their sha256 File Size sha256 .gitattributes 1.52 KB 11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361 README.md 965 B 791e1fe2d85f7a5ac40517a2f553f9f132d6e6ba883303012116217d6bcad87d config.json 1.10 KB 5da91905efdfde905f566d76d4031e6ca7c4cb2a01dc4e3812a70b855188fc73 merges.txt 466 KB 0b54e8aa4e53d5383e2e4bc635a56b43f9647f7b13832d5d9ecd8f82dac4f510 model.safetensors 143 MB ec569c771e56424636be99625aba9031abc525a68a5f4ab16d678eca96fef12c model.safetensors.index.json 49.0 KB d016e7514e8bfed162eb9d0716c73244c1b73792db3143e92e54138c1772db44 special_tokens_map.json 655 B 2b7379f3ae813529281a5c602bc5a11c1d4e0a99107aaa597fe936c1e813ca52 tokenizer.json 3.52 MB 7d27c493c729a66ecefc837280b05d948b1ed50d130eebdbf911b1b36cf38ed7 tokenizer_config.json 3.76 KB a27f638bd2831f5c3dea654a75838930f2b11fbe550c4d4e1d5d7bd07157b2ee vocab.json 801 KB 82b84012e3add4d01d12ba14442026e49b8cbbaead1f79ecf3d919784f82dc79
Versions Each time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commit Date Contents 0f0d9b8218 pinned now 2026-11-15 04:59 UTC 10 files · 148 MB
Use it fw
$ fw get mlx-community/SmolLM2-135M-Instruct-8bit
# manifest sha256 dfc33927c30c… · 148 MB · 10 files
$ fw verify ./SmolLM2-135M-Instruct-8bit mlx-community/SmolLM2-135M-Instruct-8bitfw.py Checks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/SmolLM2-135M-Instruct-8bit.json --dir ./SmolLM2-135M-Instruct-8bit
$ python3 fw.py verify ./SmolLM2-135M-Instruct-8bit ./mlx-community__SmolLM2-135M-Instruct-8bit.jsonhf The Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/SmolLM2-135M-Instruct-8bit --revision 0f0d9b8218915bc34d401e1a340b8c049d300d5e --local-dir ./SmolLM2-135M-Instruct-8bittransformers Load the weights in Python.
import os
os.environ["HF_ENDPOINT" ] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("mlx-community/SmolLM2-135M-Instruct-8bit", revision="0f0d9b8218915bc34d401e1a340b8c049d300d5e")
model = AutoModelForCausalLM.from_pretrained("mlx-community/SmolLM2-135M-Instruct-8bit", revision="0f0d9b8218915bc34d401e1a340b8c049d300d5e", device_map="auto")vLLM Serve an OpenAI-compatible API.
$ HF_ENDPOINT =https://freeweights.allternit.com vllm serve mlx-community/SmolLM2-135M-Instruct-8bit --revision 0f0d9b8218915bc34d401e1a340b8c049d300d5eLicense Name Apache License 2.0 Id Apache-2.0 Class Permissive Redistribution yes Listing Hosted (signed) Decided License as declared by the publisher. No person read it. 2026-11-15 Text in README.md Text sha256 791e1fe2d85f7a5ac40517a2f553f9f132d6e6ba883303012116217d6bcad87d Terms gate No extra terms beyond the license. Read the license text
Licenses are checked against the license table . A custom license passes only after a person reads it.
Provenance From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.smollmSubject: SmolLM2-135M-Instruct-8bit Date: 2026-11-15Commit: 0f0d9b8Signed: 2DC28CC7B26A283B ✓ How to verify
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/SmolLM2-135M-Instruct-8bit.json
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/SmolLM2-135M-Instruct-8bit.json.minisig
$ minisign -Vm SmolLM2-135M-Instruct-8bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tab A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree No model in the catalog names this one as its parent.
Get it
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/SmolLM2-135M-Instruct-8bitOpen in Freeweights Studio Pull, verify and run it in the Allternit app on Desktop, web or phone.
135M params 272 MB 135M-lc-100k-rope-12B safetensors permissive Facts Params 135M Size 272 MB Formats safetensors Task text generation License Apache-2.0 permissive flip From: HuggingFaceTB <huggingface.co/HuggingFaceTB> Subject: 135M-lc-100k-rope-12B smollm 2.09 GB Biggie-SmoLlm-0.4B gguf permissive Facts Params not stated Size 2.09 GB Formats gguf Task text generation License Apache-2.0 permissive flip From: nisten <huggingface.co/nisten> Subject: Biggie-SmoLlm-0.4B smollm 4.29 GB Biggie-SmoLlm-0.4B-ONNX onnx permissive Facts Params not stated Size 4.29 GB Formats onnx Task text generation License unknown permissive flip From: <huggingface.co/onnx-community> Subject: Biggie-SmoLlm-0.4B-ONNX 1.8B params 1.04 GB SmolLM-1.7B-bnb-4bit safetensors permissive Facts Params 1.8B Size 1.04 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: <huggingface.co/unsloth> Subject: SmolLM-1.7B-bnb-4bit 1.7B params 3.43 GB SmolLM-1.7B-Instruct safetensors permissive Facts Params 1.7B Size 3.43 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: <huggingface.co/unsloth> Subject: SmolLM-1.7B-Instruct 138M params 115 MB SmolLM-135M-bnb-4bit safetensors permissive Facts Params 138M Size 115 MB Formats safetensors Task text generation License Apache-2.0 permissive flip From: <huggingface.co/unsloth> Subject: SmolLM-135M-bnb-4bit
mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.smollmSubject: 
onnx-community 
unsloth