alt.freeweights.smollm / SmolLM-135M-Instruct-4bit

From:

mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.smollmSubject:

SmolLM-135M-Instruct-4bit

Date: 2026-11-15Commit: 642e06aSigned: 2DC28CC7B26A283B ✓

Text generation model with 135M parameters. Safetensors weights, 79.2 MB in all. Published by mlx-community under Apache-2.0.

135M params

79.2MBSmolLM-135M-Instruct-4bitsafetensorspermissive

FactsParams135MSize79.2 MBFormatssafetensorsTasktext generationLicenseApache-2.0From sourcepermissive

$ fw get mlx-community/SmolLM-135M-Instruct-4bit
# manifest sha256 7b90bccec079… · 79.2 MB · 10 files
$ fw verify ./SmolLM-135M-Instruct-4bit mlx-community/SmolLM-135M-Instruct-4bit

From sourceHosted (signed)mlx-community/SmolLM-135M-Instruct-4bitLast check: 2026-11-15 02:45 UTC

Fine-tune in Studio Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Runs with

AIBrix BentoML CTranslate2 ExLlamaV2 ExLlamaV3 exo fastllm FlashInfer gpu-unlock KTransformers LitServe LMCache LMDeploy LocalAI mistral.rs MLC LLM Mooncake

SGLang Text Generation WebUI tinygrad

Transformers Triton Inference Server

vLLM XinferenceFine-tune with

Accelerate

Alignment Handbook

Axolotl Colossal-AI DeepSpeed EasyR1 FlashAttention H2O LLM Studio JAX Keras Liger Kernel LitGPT LLaMA-Factory Megatron-LM ms-swift

nanotron

OLMo-core OpenRLHF Oumi

PEFT PyTorch Lightning sd-scripts SimpleTuner TorchTitan torchtune Transformer Engine

TRL

Unsloth verlConvert withAQLM AutoRound Core ML Tools ExecuTorch GPTQModel

LLM Compressor mergekit Neural Compressor

Olive ONNX

Optimum Quanto

Optimum

safetensors TensorRT Model Optimizer torchaoEvaluate withAutoevals DeepEval

Evaluate HELM

LightEval lm-evaluation-harness OpenCompass Opik Ragas

simple-evals SWE-bench TruLens WeaveScan withAgentDojo AI Fairness 360 DeepTeam Detoxify Fairlearn garak Giskard Guardrails MCP Scanner ModelScan NeMo Guardrails picklescan promptfooWorks with

Agent Development Kit AG2 Google AI Edge Gallery Aider any-llm AnythingLLM BAML browser-use CAMEL

Hugging Face Chat UI Chatbox Cherry Studio Cline

Codex CLI Cognee CrewAI DeerFlow DSPy Enchanted Gemini CLI GitHub MCP Server goose GPT Researcher Gradio Graphiti Guidance Hollama Instructor Kilo Code Langflow LangGraph LiteLLM LlamaIndex LLM LocalAGI LoLLMs WebUI MCP Python SDK Mem0 MetaGPT NextChat

Ollama JavaScript

Ollama Python

OpenAI Agents SDK opencode OpenHands oterm Outlines Page Assist

Playwright MCP Portkey AI Gateway PrivateGPT Qwen Code RWKV Runner

Semantic Kernel

smolagents Strands Agents Vane XGrammar

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 79.2 MB
Weights: 75.8 MB (safetensors)
Parameters: 135M
Formats: safetensors
Task: text generation
License: Apache-2.0 (permissive)
Files: 10, each with a sha256
Publisher: mlx-community
Added: 2026-11-15
Section: alt.freeweights.smollm

Lineage

Original release from the publisher.

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 02:45 UTC	passed

Model card

From the publisher at commit 642e06a. Shown as plain text with links; images open at the publisher.

mlx-community/SmolLM-135M-Instruct-4bit#

The Model mlx-community/SmolLM-135M-Instruct-4bit was converted to MLX format from HuggingFaceTB/SmolLM-135M-Instruct using mlx-lm version 0.15.2.

Use with mlx#

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/SmolLM-135M-Instruct-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)

Files

10 files · 79.2 MBWeights 75.8 MB (safetensors). Sizes and sha256 from the signed manifest.

Hide all 10 files with their sha256

File	Size	sha256
.gitattributes	1.52 KB	11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361
README.md	638 B	c932a31b7de83869e2db8bb4622752ef350ded20a7212822a278506fd70a4465
config.json	803 B	4bc9881d39ef7fce3df804d194558e29bd974d965437dc1e6a8f9f7a0939b80d
merges.txt	466 KB	0b54e8aa4e53d5383e2e4bc635a56b43f9647f7b13832d5d9ecd8f82dac4f510
model.safetensors	75.8 MB	e91560ee24b13eee6ddeb14879d728a90780053d69057b15ff199ccadfcfe33b
model.safetensors.index.json	49.0 KB	2aa3391702d20c3c886cc6148d210c843bfb4dfde32b71fe859f1c744ce35dd3
special_tokens_map.json	655 B	2b7379f3ae813529281a5c602bc5a11c1d4e0a99107aaa597fe936c1e813ca52
tokenizer.json	2.10 MB	9ca9acddb6525a194ec8ac7a87f24fbba7232a9a15ffa1af0c1224fcd888e47c
tokenizer_config.json	3.59 KB	75668bda11eb0d5ece137b4eb3fb2ad679f847fd19846b726369a26d92f9f28e
vocab.json	801 KB	82b84012e3add4d01d12ba14442026e49b8cbbaead1f79ecf3d919784f82dc79

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
642e06afe3 pinned now	2026-11-15 02:45 UTC	10 files · 79.2 MB

Use it

$ fw get mlx-community/SmolLM-135M-Instruct-4bit
# manifest sha256 7b90bccec079… · 79.2 MB · 10 files
$ fw verify ./SmolLM-135M-Instruct-4bit mlx-community/SmolLM-135M-Instruct-4bit

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/SmolLM-135M-Instruct-4bit.json --dir ./SmolLM-135M-Instruct-4bit
$ python3 fw.py verify ./SmolLM-135M-Instruct-4bit ./mlx-community__SmolLM-135M-Instruct-4bit.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/SmolLM-135M-Instruct-4bit --revision 642e06afe3fab57fd6cc518637c471af0a569e1e --local-dir ./SmolLM-135M-Instruct-4bit

transformersLoad the weights in Python.

import os
os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("mlx-community/SmolLM-135M-Instruct-4bit", revision="642e06afe3fab57fd6cc518637c471af0a569e1e")
model = AutoModelForCausalLM.from_pretrained("mlx-community/SmolLM-135M-Instruct-4bit", revision="642e06afe3fab57fd6cc518637c471af0a569e1e", device_map="auto")

vLLMServe an OpenAI-compatible API.

$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve mlx-community/SmolLM-135M-Instruct-4bit --revision 642e06afe3fab57fd6cc518637c471af0a569e1e

Fine-tune in Studio

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: c932a31b7de83869e2db8bb4622752ef350ded20a7212822a278506fd70a4465
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From:

mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.smollmSubject: SmolLM-135M-Instruct-4bitDate: 2026-11-15Commit: 642e06aSigned: 2DC28CC7B26A283B ✓

Upstream: mlx-community/SmolLM-135M-Instruct-4bit
Pinned commit: 642e06afe3fab57fd6cc518637c471af0a569e1e
Manifest: SmolLM-135M-Instruct-4bit.json · .minisig
Manifest sha256: 7b90bccec079fc17a02b4e4e4f7cd786ce200f08be551c690176cafc1f1c33c7
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 02:45 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/mlx-community/SmolLM-135M-Instruct-4bit.json
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/SmolLM-135M-Instruct-4bit.json.minisig
$ minisign -Vm SmolLM-135M-Instruct-4bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/SmolLM-135M-Instruct-4bit

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. SmolLM-135M-Instruct-4bit.json. Provenance. Takedown history: none.

Source

huggingface.co/mlx-community/SmolLM-135M-Instruct-4bit

Related models

All of alt.freeweights.smollm →

From: HuggingFaceTB <huggingface.co/HuggingFaceTB>Subject: 135M-lc-100k-rope-12B

From: nisten <huggingface.co/nisten>Subject: Biggie-SmoLlm-0.4B

From:

onnx-community <huggingface.co/onnx-community>Subject: Biggie-SmoLlm-0.4B-ONNX

From:

unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-bnb-4bit

From:

unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-Instruct

From:

unsloth <huggingface.co/unsloth>Subject: SmolLM-135M-bnb-4bit