CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.smollm / SmolLM2-360M-Instruct-GGUF
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.smollmSubject:

SmolLM2-360M-Instruct-GGUF

Date: 2026-11-15Commit: 391ed11Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 2.49 GB in all. Published by unsloth under Apache-2.0.

smollm2.49GBSmolLM2-360M-Instruct-GGUFggufpermissive
FactsParamsnot statedSize2.49 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get unsloth/SmolLM2-360M-Instruct-GGUF
# manifest sha256 bdbd1864203d… · 2.49 GB · 9 files
$ fw verify ./SmolLM2-360M-Instruct-GGUF unsloth/SmolLM2-360M-Instruct-GGUF
From sourceHosted (signed)unsloth/SmolLM2-360M-Instruct-GGUFLast check: 2026-11-15 04:56 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of SmolLM2-360M-Instruct.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
2.49 GB
Weights
219 MB (smallest of 7 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
9, each with a sha256
Publisher
unsloth
Added
2026-11-15
Section
alt.freeweights.smollm
Lineage

Original release from the publisher.

Base model: HuggingFaceTB/SmolLM2-360M-Instruct

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:56 UTCpassed

Model card

From the publisher at commit 391ed11. Shown as plain text with links; images open at the publisher.

Finetune SmolLM2, Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!#

We have a free Google Colab Tesla T4 notebook for Llama 3.2 (3B) here: https://colab.research.google.com/drive/1Ys44kVvmeZtnICzWz0xgpRnrIOjZAuxp?usp=sharing

https://discord.gg/unsloth https://github.com/unslothai/unsloth

unsloth/SmolLM2-360M-Instruct-GGUF#

For more details on the model, please go to Hugging Face's original model card

✨ Finetune for Free#

All notebooks are beginner friendly! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.

Unsloth supportsFree NotebooksPerformanceMemory use
Llama-3.2 (3B)▶️ Start on Colab2.4x faster58% less
Llama-3.2 (11B vision)▶️ Start on Colab2.4x faster58% less
Llama-3.1 (8B)▶️ Start on Colab2.4x faster58% less
Phi-3.5 (mini)▶️ Start on Colab2x faster50% less
Gemma 2 (9B)▶️ Start on Colab2.4x faster58% less
Mistral (7B)▶️ Start on Colab2.2x faster62% less
DPO - Zephyr▶️ Start on Colab1.9x faster19% less

Special Thanks#

A huge thank you to the Hugging Face team for creating and releasing these models.

Model Summary#

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device.

The 1.7B variant demonstrates significant advances over its predecessor SmolLM1-1.7B, particularly in instruction following, knowledge, reasoning, and mathematics. It was trained on 11 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new mathematics and coding datasets that we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our own curated datasets. We then applied Direct Preference Optimization (DPO) using UltraFeedback.

The instruct model additionally supports tasks such as text rewriting, summarization and function calling thanks to datasets developed by Argilla such as Synth-APIGen-v0.1.

SmolLM2#

Image: image/png

Files

9 files · 2.49 GBWeights 219 MB (smallest of 7 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 9 files with their sha256
FileSizesha256
.gitattributes2.00 KBaaa6bd110ee9a366c900dc4dc7d862bae13d5bb613567359d96170877d750a73
README.md4.57 KB4a0a8e83b9c22c340aa73fd047428cc3aa89f16856dc0df2e5bf4555c05a95e8
SmolLM2-360M-Instruct-F16.gguf726 MBa41984d8bebc26ee81daf68d15077ad86aac2894ee5e9d3453b6895060df213e
SmolLM2-360M-Instruct-Q2_K.gguf219 MBbace2bc62750a676cb30e0d29fea1b3466d6089eee3e8094d5bab6916d427862
SmolLM2-360M-Instruct-Q3_K_M.gguf235 MBeb31394ff392eaca725fd9582eade3352adce2143704273846f0d194123fccf3
SmolLM2-360M-Instruct-Q4_K_M.gguf271 MB16c7f1667fea34bacad196a57b548effcb37614db4ab5677a20c8c7b823b9e63
SmolLM2-360M-Instruct-Q5_K_M.gguf290 MB0d3040f47b83cd279fc653877059829cbd6e17f972f82a03f686f7d5f3834440
SmolLM2-360M-Instruct-Q6_K.gguf367 MB228455ecf8de8093ec793c5f458b995e68d90d1a6b4864441f026719312d08ed
SmolLM2-360M-Instruct-Q8_0.gguf386 MBfcb111da119fa42ab856d491088a844b290579e9810bd0792252297d8c6cd7a8
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
391ed11137 pinned now2026-11-15 04:56 UTC9 files · 2.49 GB

Use it

$ fw get unsloth/SmolLM2-360M-Instruct-GGUF
# manifest sha256 bdbd1864203d… · 2.49 GB · 9 files
$ fw verify ./SmolLM2-360M-Instruct-GGUF unsloth/SmolLM2-360M-Instruct-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/SmolLM2-360M-Instruct-GGUF.json --dir ./SmolLM2-360M-Instruct-GGUF $ python3 fw.py verify ./SmolLM2-360M-Instruct-GGUF ./unsloth__SmolLM2-360M-Instruct-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/SmolLM2-360M-Instruct-GGUF --revision 391ed11137586e383b1be0fab9acf01d282c2e11 --local-dir ./SmolLM2-360M-Instruct-GGUF
llama.cppDownload one GGUF variant (SmolLM2-360M-Instruct-Q2_K, 219 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/SmolLM2-360M-Instruct-GGUF --include "SmolLM2-360M-Instruct-Q2_K*" --local-dir ./SmolLM2-360M-Instruct-GGUF $ llama-server -m ./SmolLM2-360M-Instruct-GGUF/SmolLM2-360M-Instruct-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./SmolLM2-360M-Instruct-GGUF/SmolLM2-360M-Instruct-Q2_K.gguf\n' > Modelfile $ ollama create smollm2-360m-instruct-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
4a0a8e83b9c22c340aa73fd047428cc3aa89f16856dc0df2e5bf4555c05a95e8
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.smollmSubject: SmolLM2-360M-Instruct-GGUFDate: 2026-11-15Commit: 391ed11Signed: 2DC28CC7B26A283B ✓
Upstream
unsloth/SmolLM2-360M-Instruct-GGUF
Pinned commit
391ed11137586e383b1be0fab9acf01d282c2e11
Manifest
SmolLM2-360M-Instruct-GGUF.json · .minisig
Manifest sha256
bdbd1864203d9cf1eb9389b62d62dd6d4ac8aa72f63017402247759c7a16eb86
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:56 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/SmolLM2-360M-Instruct-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/SmolLM2-360M-Instruct-GGUF.json.minisig $ minisign -Vm SmolLM2-360M-Instruct-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

HuggingFaceTB/SmolLM2-360M-Instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/SmolLM2-360M-Instruct-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. SmolLM2-360M-Instruct-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/unsloth/SmolLM2-360M-Instruct-GGUF

Related models

All of alt.freeweights.smollm →
From: HuggingFaceTB <huggingface.co/HuggingFaceTB>Subject: 135M-lc-100k-rope-12B
From: nisten <huggingface.co/nisten>Subject: Biggie-SmoLlm-0.4B
From: onnx-community <huggingface.co/onnx-community>Subject: Biggie-SmoLlm-0.4B-ONNX
From: unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-bnb-4bit
From: unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-Instruct
From: unsloth <huggingface.co/unsloth>Subject: SmolLM-135M-bnb-4bit