CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-3.3-2b-base-GGUF
From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-3.3-2b-base-GGUF

Date: 2026-11-15Commit: 282fa97Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 27.9 GB in all. Published by ibm-granite under Apache-2.0.

granite27.9GBgranite-3.3-2b-base-GGUFggufpermissive
FactsParamsnot statedSize27.9 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get ibm-granite/granite-3.3-2b-base-GGUF
# manifest sha256 4bb23b3d703f… · 27.9 GB · 17 files
$ fw verify ./granite-3.3-2b-base-GGUF ibm-granite/granite-3.3-2b-base-GGUF
From sourceHosted (signed)ibm-granite/granite-3.3-2b-base-GGUFLast check: 2026-11-15 05:18 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-3.3-2b-base.

Works with

Run14Convert1Evaluate13Scan12Apps58

Convert with

ggml
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
27.9 GB
Weights
978 MB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
Apache-2.0 (permissive)
Files
17, each with a sha256
Publisher
ibm-granite
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-3.3-2b-base

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:18 UTCpassed

Model card

From the publisher at commit 282fa97. Shown as plain text with links; images open at the publisher.

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-2b-base

Files

17 files · 27.9 GBWeights 978 MB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 17 files with their sha256
FileSizesha256
.gitattributes2.52 KBcf9899da2526252e0cc7bf301b9e8dc2f700e593570dc68e5d831a95f858b95c
README.md451 Be42e11cec210f6b74bdb120755257a7432961f1e308a5691a8a18619024c5fb6
granite-3.3-2b-base-Q2_K.gguf978 MBd0fc8a4d0e4ee3b2f13083f4c51db3d4296e96ae318567e58782f8a94e224d70
granite-3.3-2b-base-Q3_K_L.gguf1.36 GBdd72d0c2023b0243db3557f64f9507f6cd5db2578b65c6a5963c0ecc7a38138b
granite-3.3-2b-base-Q3_K_M.gguf1.25 GBaca7badfbb3da69c842899da95e6b97f911c66232b1ac7eb95192b4fce4df9c6
granite-3.3-2b-base-Q3_K_S.gguf1.13 GB7ea4653a0764579838500fb16ba6a0d6474bb21313c26dfcee1ce978cb8dcf1a
granite-3.3-2b-base-Q4_0.gguf1.45 GBcbeaaf2b88d34b22d1948155beab01b75e7d893c0c5206317f7432da88fb4421
granite-3.3-2b-base-Q4_1.gguf1.61 GB52d462f69435bebb491fc744d915e7a97cd5f5e95e234be44dea6d0c2f3fda36
granite-3.3-2b-base-Q4_K_M.gguf1.55 GBf383e660bf1525bb7d16bdd3e765a186c85b96dd2cd4c3ad0b5d7a61f07cc8f5
granite-3.3-2b-base-Q4_K_S.gguf1.46 GB092ae3274c8303ca7d20483a52b237229211d007b39d8d20940112be24a3a535
granite-3.3-2b-base-Q5_0.gguf1.76 GB62f39c9c7f1576556e6189f9b8fb866b457a9a0511adf5cfe54afc0a3c500a6a
granite-3.3-2b-base-Q5_1.gguf1.91 GB566779bb96c434967d15a67350b73f1b1c2dc0e0eba2cd1304ff606a33b4cef0
granite-3.3-2b-base-Q5_K_M.gguf1.80 GB2a94b51c0ce22343546cfbe4aaa9c0200c3537b04aa91979a39d3bef3094f50b
granite-3.3-2b-base-Q5_K_S.gguf1.76 GB01faaec30bb9fa4330d35d0cdfe5040248afa5faadc335326a64372c4dce16f1
granite-3.3-2b-base-Q6_K.gguf2.08 GBe21f12bd86074c9591a8c897f455510958ae8739d174fa84c26447e8f61596ad
granite-3.3-2b-base-Q8_0.gguf2.69 GBd0e5f26d5a39ffd5bd3be5c77a179d9ca7938ea9ee46cd7aa366be521ef07d96
granite-3.3-2b-base-f16.gguf5.07 GB707a199e91cf9e413071156f014dfe43c4a9afc8e6f15c52ff1e01c46aba6656
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
282fa97b53 pinned now2026-11-15 05:18 UTC17 files · 27.9 GB

Use it

$ fw get ibm-granite/granite-3.3-2b-base-GGUF
# manifest sha256 4bb23b3d703f… · 27.9 GB · 17 files
$ fw verify ./granite-3.3-2b-base-GGUF ibm-granite/granite-3.3-2b-base-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-3.3-2b-base-GGUF.json --dir ./granite-3.3-2b-base-GGUF $ python3 fw.py verify ./granite-3.3-2b-base-GGUF ./ibm-granite__granite-3.3-2b-base-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-3.3-2b-base-GGUF --revision 282fa97b53c9fc281a6e023c2c0874cd1479b217 --local-dir ./granite-3.3-2b-base-GGUF
llama.cppDownload one GGUF variant (granite-3.3-2b-base-Q2_K, 978 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-3.3-2b-base-GGUF --include "granite-3.3-2b-base-Q2_K*" --local-dir ./granite-3.3-2b-base-GGUF $ llama-server -m ./granite-3.3-2b-base-GGUF/granite-3.3-2b-base-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./granite-3.3-2b-base-GGUF/granite-3.3-2b-base-Q2_K.gguf\n' > Modelfile $ ollama create granite-3.3-2b-base-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
e42e11cec210f6b74bdb120755257a7432961f1e308a5691a8a18619024c5fb6
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-3.3-2b-base-GGUFDate: 2026-11-15Commit: 282fa97Signed: 2DC28CC7B26A283B ✓
Upstream
ibm-granite/granite-3.3-2b-base-GGUF
Pinned commit
282fa97b53c9fc281a6e023c2c0874cd1479b217
Manifest
granite-3.3-2b-base-GGUF.json · .minisig
Manifest sha256
4bb23b3d703f0cb3393babd4c7cd8e521c8ca577b6ec7831fbd509e47e291b03
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:18 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-3.3-2b-base-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-3.3-2b-base-GGUF.json.minisig $ minisign -Vm granite-3.3-2b-base-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-3.3-2b-base · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-3.3-2b-base-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-3.3-2b-base-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ibm-granite/granite-3.3-2b-base-GGUF

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3