alt.freeweights.smollm / SmolLM2-360M-Instruct-GGUF

From: HuggingFaceTB <huggingface.co/HuggingFaceTB>Newsgroups: alt.freeweights.smollmSubject:

SmolLM2-360M-Instruct-GGUF

Date: 2026-11-14Commit: 593b5a2Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 386 MB in all. Published by HuggingFaceTB under Apache-2.0.

smollm386MBSmolLM2-360M-Instruct-GGUFggufpermissive

FactsParamsnot statedSize386 MBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive

$ fw get HuggingFaceTB/SmolLM2-360M-Instruct-GGUF
# manifest sha256 3efc29524aa2… · 386 MB · 3 files
$ fw verify ./SmolLM2-360M-Instruct-GGUF HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

From sourceHosted (signed)HuggingFaceTB/SmolLM2-360M-Instruct-GGUFLast check: 2026-11-14 21:11 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of SmolLM2-360M-Instruct.

Works with

Run11 Convert1 Scan1

Runs with

Ranked by fit to this model (gguf), then by GitHub stars.

Ollama

llama.cpp LocalAI

BitNet llamafile KoboldCpp PocketPal AI llama-swap ik_llama.cpp RamaLama Maid

Convert with

ggml

Scan with

ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 386 MB
Weights: 386 MB (GGUF)
Parameters: not stated
Formats: gguf
Task: not tagged
License: Apache-2.0 (permissive)
Files: 3, each with a sha256
Publisher: HuggingFaceTB
Added: 2026-11-14
Section: alt.freeweights.smollm

Lineage

Original release from the publisher.

Base model: HuggingFaceTB/SmolLM2-360M-Instruct

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-14 21:11 UTC	passed

Model card

From the publisher at commit 593b5a2. Shown as plain text with links; images open at the publisher.

ngxson/SmolLM2-360M-Instruct-Q8_0-GGUF#

This model was converted to GGUF format from HuggingFaceTB/SmolLM2-360M-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Use with llama.cpp#

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.

CLI:#

llama-cli --hf-repo ngxson/SmolLM2-360M-Instruct-Q8_0-GGUF --hf-file smollm2-360m-instruct-q8_0.gguf -p "The meaning to life and the universe is"

Server:#

llama-server --hf-repo ngxson/SmolLM2-360M-Instruct-Q8_0-GGUF --hf-file smollm2-360m-instruct-q8_0.gguf -c 2048

Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggerganov/llama.cpp

Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL=1 flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).

cd llama.cpp && LLAMA_CURL=1 make

Step 3: Run inference through the main binary.

./llama-cli --hf-repo ngxson/SmolLM2-360M-Instruct-Q8_0-GGUF --hf-file smollm2-360m-instruct-q8_0.gguf -p "The meaning to life and the universe is"

./llama-server --hf-repo ngxson/SmolLM2-360M-Instruct-Q8_0-GGUF --hf-file smollm2-360m-instruct-q8_0.gguf -c 2048

Files

3 files · 386 MBWeights 386 MB (GGUF). Sizes and sha256 from the signed manifest.

Hide all 3 files with their sha256

File	Size	sha256
.gitattributes	1.59 KB	25ccb1be281e25537f207b8d7c317b443371a6882e7bbd3bc8fc8a7287f2580b
README.md	1.85 KB	5d65a9f761fb64443b565d247593aa3d4ec0f06633a0e16c0231625cdba6a7cd
smollm2-360m-instruct-q8_0.gguf	386 MB	48ab3034d0dd401fbc721eb1df3217902fee7dab9078992d66431f09b7750201

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
593b5a2e04 pinned now manifest updated, same commit	2026-11-14 21:11 UTC	3 files · 386 MB
593b5a2e04	2026-11-14 21:11 UTC	3 files · 386 MB

Use it

$ fw get HuggingFaceTB/SmolLM2-360M-Instruct-GGUF
# manifest sha256 3efc29524aa2… · 386 MB · 3 files
$ fw verify ./SmolLM2-360M-Instruct-GGUF HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/HuggingFaceTB/SmolLM2-360M-Instruct-GGUF.json --dir ./SmolLM2-360M-Instruct-GGUF
$ python3 fw.py verify ./SmolLM2-360M-Instruct-GGUF ./HuggingFaceTB__SmolLM2-360M-Instruct-GGUF.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download HuggingFaceTB/SmolLM2-360M-Instruct-GGUF --revision 593b5a2e04c8f3e4ee880263f93e0bd2901ad47f --local-dir ./SmolLM2-360M-Instruct-GGUF

llama.cppDownload one GGUF variant (smollm2-360m-instruct-q8_0, 386 MB), then serve it.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download HuggingFaceTB/SmolLM2-360M-Instruct-GGUF --include "smollm2-360m-instruct-q8_0*" --local-dir ./SmolLM2-360M-Instruct-GGUF
$ llama-server -m ./SmolLM2-360M-Instruct-GGUF/smollm2-360m-instruct-q8_0.gguf

OllamaMake an Ollama model from the downloaded file.

$ printf 'FROM ./SmolLM2-360M-Instruct-GGUF/smollm2-360m-instruct-q8_0.gguf\n' > Modelfile
$ ollama create smollm2-360m-instruct-gguf -f Modelfile

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-14
Text in: README.md
Text sha256: 5d65a9f761fb64443b565d247593aa3d4ec0f06633a0e16c0231625cdba6a7cd
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: HuggingFaceTB <huggingface.co/HuggingFaceTB>Newsgroups: alt.freeweights.smollmSubject: SmolLM2-360M-Instruct-GGUFDate: 2026-11-14Commit: 593b5a2Signed: 2DC28CC7B26A283B ✓

Upstream: HuggingFaceTB/SmolLM2-360M-Instruct-GGUF
Pinned commit: 593b5a2e04c8f3e4ee880263f93e0bd2901ad47f
Manifest: SmolLM2-360M-Instruct-GGUF.json · .minisig
Manifest sha256: 3efc29524aa24c95c82d8ee84be9f685e768e29f93bac6bcfd5d48a35aca7503
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-14 21:11 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/HuggingFaceTB/SmolLM2-360M-Instruct-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/HuggingFaceTB/SmolLM2-360M-Instruct-GGUF.json.minisig
$ minisign -Vm SmolLM2-360M-Instruct-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

HuggingFaceTB/SmolLM2-360M-Instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. SmolLM2-360M-Instruct-GGUF.json. Provenance. Takedown history: none.

Source

huggingface.co/HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

Related models

All of alt.freeweights.smollm →

From: HuggingFaceTB <huggingface.co/HuggingFaceTB>Subject: 135M-lc-100k-rope-12B

From: nisten <huggingface.co/nisten>Subject: Biggie-SmoLlm-0.4B

From:

onnx-community <huggingface.co/onnx-community>Subject: Biggie-SmoLlm-0.4B-ONNX

From:

unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-bnb-4bit

From:

unsloth <huggingface.co/unsloth>Subject: SmolLM-1.7B-Instruct

From:

unsloth <huggingface.co/unsloth>Subject: SmolLM-135M-bnb-4bit