CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.smollm / SmolLM2-1.7B-Instruct-GGUF
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.smollmSubject:

SmolLM2-1.7B-Instruct-GGUF

Date: 2026-11-15Commit: e933f1cSigned: 2DC28CC7B26A283B ✓

Model. Gguf weights, 10.5 GB in all. Published by unsloth under Apache-2.0.

smollm10.5GBSmolLM2-1.7B-Instruct-GGUFggufpermissive
FactsParamsnot statedSize10.5 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get unsloth/SmolLM2-1.7B-Instruct-GGUF
# manifest sha256 304a69a72160… · 10.5 GB · 9 files
$ fw verify ./SmolLM2-1.7B-Instruct-GGUF unsloth/SmolLM2-1.7B-Instruct-GGUF
From sourceHosted (signed)unsloth/SmolLM2-1.7B-Instruct-GGUFLast check: 2026-11-15 04:59 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of SmolLM2-1.7B-Instruct.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
10.5 GB
Weights
675 MB (smallest of 7 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
9, each with a sha256
Publisher
unsloth
Added
2026-11-15
Section
alt.freeweights.smollm
Lineage

Original release from the publisher.

Base model: HuggingFaceTB/SmolLM2-1.7B-Instruct

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:59 UTCpassed

Model card

From the publisher at commit e933f1c. Shown as plain text with links; images open at the publisher.

Finetune SmolLM2, Llama 3.2, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!#

We have a free Google Colab Tesla T4 notebook for Llama 3.2 (3B) here: https://colab.research.google.com/drive/1Ys44kVvmeZtnICzWz0xgpRnrIOjZAuxp?usp=sharing

https://discord.gg/unsloth https://github.com/unslothai/unsloth

unsloth/SmolLM2-1.7B-Instruct-GGUF#

For more details on the model, please go to Hugging Face's original model card

✨ Finetune for Free#

All notebooks are beginner friendly! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.

Unsloth supportsFree NotebooksPerformanceMemory use
Llama-3.2 (3B)▶️ Start on Colab2.4x faster58% less
Llama-3.2 (11B vision)▶️ Start on Colab2.4x faster58% less
Llama-3.1 (8B)▶️ Start on Colab2.4x faster58% less
Phi-3.5 (mini)▶️ Start on Colab2x faster50% less
Gemma 2 (9B)▶️ Start on Colab2.4x faster58% less
Mistral (7B)▶️ Start on Colab2.2x faster62% less
DPO - Zephyr▶️ Start on Colab1.9x faster19% less

Special Thanks#

A huge thank you to the Hugging Face team for creating and releasing these models.

Model Summary#

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device.

The 1.7B variant demonstrates significant advances over its predecessor SmolLM1-1.7B, particularly in instruction following, knowledge, reasoning, and mathematics. It was trained on 11 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new mathematics and coding datasets that we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our own curated datasets. We then applied Direct Preference Optimization (DPO) using UltraFeedback.

The instruct model additionally supports tasks such as text rewriting, summarization and function calling thanks to datasets developed by Argilla such as Synth-APIGen-v0.1.

SmolLM2#

Image: image/png

Files

9 files · 10.5 GBWeights 675 MB (smallest of 7 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 9 files with their sha256
FileSizesha256
.gitattributes2.00 KB0b14c88f17c70c7cf47ce0af322b88995b6a0f2b65b29ecc993f209a181002ad
README.md4.57 KBb6bd40ba813b8d9a63a4845bae2405f1c4a2d5bd202960064d1e2e83d642b14f
SmolLM2-1.7B-Instruct-F16.gguf3.42 GB5f4020d9c59b329aaa082a690743e760411dfbb5c4ccd1ef49fb0fd20a6b6a7c
SmolLM2-1.7B-Instruct-Q2_K.gguf675 MB0bef8188930ae76e83e462eadd5a0878b55f14bf076ea140c1b47bc368fff47f
SmolLM2-1.7B-Instruct-Q3_K_M.gguf860 MBc11df3ad10008f80b80c8028b93c959448d1a7a2e5758ff4248eeab20941be51
SmolLM2-1.7B-Instruct-Q4_K_M.gguf1.06 GB61b6f90dd515fd3bffbd0f6ba716e87555dde77d9b0573a562c2c5e62afc4909
SmolLM2-1.7B-Instruct-Q5_K_M.gguf1.23 GB5c4b64bdc11ef0929857d946c43c8fe4e469542bbbafe7fb2589fb7eb3f8cdb2
SmolLM2-1.7B-Instruct-Q6_K.gguf1.41 GBc53b3d00ac5588a36ffda34e8d1997898af712e076b31026c1fbcd6ead7f79ef
SmolLM2-1.7B-Instruct-Q8_0.gguf1.82 GB0f3fb091804c48a561b42a4ca1be9ce2c353017187f74c48f52299cae790abe5
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
e933f1cdf7 pinned now2026-11-15 04:59 UTC9 files · 10.5 GB

Use it

$ fw get unsloth/SmolLM2-1.7B-Instruct-GGUF
# manifest sha256 304a69a72160… · 10.5 GB · 9 files
$ fw verify ./SmolLM2-1.7B-Instruct-GGUF unsloth/SmolLM2-1.7B-Instruct-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/SmolLM2-1.7B-Instruct-GGUF.json --dir ./SmolLM2-1.7B-Instruct-GGUF $ python3 fw.py verify ./SmolLM2-1.7B-Instruct-GGUF ./unsloth__SmolLM2-1.7B-Instruct-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/SmolLM2-1.7B-Instruct-GGUF --revision e933f1cdf73cc87cb67915bf5dd6ea81d36080ca --local-dir ./SmolLM2-1.7B-Instruct-GGUF
llama.cppDownload one GGUF variant (SmolLM2-1.7B-Instruct-Q2_K, 675 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/SmolLM2-1.7B-Instruct-GGUF --include "SmolLM2-1.7B-Instruct-Q2_K*" --local-dir ./SmolLM2-1.7B-Instruct-GGUF $ llama-server -m ./SmolLM2-1.7B-Instruct-GGUF/SmolLM2-1.7B-Instruct-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./SmolLM2-1.7B-Instruct-GGUF/SmolLM2-1.7B-Instruct-Q2_K.gguf\n' > Modelfile $ ollama create smollm2-1.7b-instruct-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
b6bd40ba813b8d9a63a4845bae2405f1c4a2d5bd202960064d1e2e83d642b14f
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.smollmSubject: SmolLM2-1.7B-Instruct-GGUFDate: 2026-11-15Commit: e933f1cSigned: 2DC28CC7B26A283B ✓
Upstream
unsloth/SmolLM2-1.7B-Instruct-GGUF
Pinned commit
e933f1cdf73cc87cb67915bf5dd6ea81d36080ca
Manifest
SmolLM2-1.7B-Instruct-GGUF.json · .minisig
Manifest sha256
304a69a7216082df4a1e92e12d4a40030a4da68a7579ddbdab043e80fd6a08ec
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:59 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/SmolLM2-1.7B-Instruct-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/SmolLM2-1.7B-Instruct-GGUF.json.minisig $ minisign -Vm SmolLM2-1.7B-Instruct-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

HuggingFaceTB/SmolLM2-1.7B-Instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/SmolLM2-1.7B-Instruct-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. SmolLM2-1.7B-Instruct-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/unsloth/SmolLM2-1.7B-Instruct-GGUF

Related models

All of alt.freeweights.smollm →
From: HuggingFaceTB <huggingface.co/HuggingFaceTB>Subject: 135M-lc-100k-rope-12B
From: nisten <huggingface.co/nisten>Subject: Biggie-SmoLlm-0.4B
From: onnx-community <huggingface.co/onnx-community>Subject: Biggie-SmoLlm-0.4B-ONNX
From: unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-bnb-4bit
From: unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-Instruct
From: unsloth <huggingface.co/unsloth>Subject: SmolLM-135M-bnb-4bit