CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-3.3-8b-base-GGUF
From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-3.3-8b-base-GGUF

Date: 2026-11-15Commit: da0bb28Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 89.4 GB in all. Published by ibm-granite under Apache-2.0.

granite89.4GBgranite-3.3-8b-base-GGUFggufpermissive
FactsParamsnot statedSize89.4 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get ibm-granite/granite-3.3-8b-base-GGUF
# manifest sha256 04eab86e88b1… · 89.4 GB · 17 files
$ fw verify ./granite-3.3-8b-base-GGUF ibm-granite/granite-3.3-8b-base-GGUF
From sourceHosted (signed)ibm-granite/granite-3.3-8b-base-GGUFLast check: 2026-11-15 05:15 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-3.3-8b-base.

Works with

Run14Convert1Evaluate13Scan12Apps58

Convert with

ggml
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
89.4 GB
Weights
3.10 GB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
Apache-2.0 (permissive)
Files
17, each with a sha256
Publisher
ibm-granite
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-3.3-8b-base

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:15 UTCpassed

Model card

From the publisher at commit da0bb28. Shown as plain text with links; images open at the publisher.

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-8b-base

Files

17 files · 89.4 GBWeights 3.10 GB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 17 files with their sha256
FileSizesha256
.gitattributes2.52 KBcdb233fda73ac82a557eae8e66e97328a98b9b5ab8ce3b4898cf28be62d605ae
README.md451 B335d95cd703ce73a279a6ffa7f1c51d8020dec7469ab20fdbf9068fc8a499d40
granite-3.3-8b-base-Q2_K.gguf3.10 GB58a7db3853d1a508022eb559b0a6899ced333da7e6db9b9ef5aa014c66f2949b
granite-3.3-8b-base-Q3_K_L.gguf4.35 GBf6c18abad63280d148d1c0d9eaff04d85b15e317ae68ebb8e7917c405c2fca55
granite-3.3-8b-base-Q3_K_M.gguf4.00 GB9f371361f431ec33d8c7a1f477fa60511670ceba1800a16b76aee047707d4674
granite-3.3-8b-base-Q3_K_S.gguf3.59 GBbf318dce67328319e5151dc95426b0b2df49995df1d7eb2469ae820ae6e1a951
granite-3.3-8b-base-Q4_0.gguf4.65 GB7f2466022209f81f54c25fbd8ba9b6c71cfb576b8fd203b9d9fe510b73aeccfe
granite-3.3-8b-base-Q4_1.gguf5.15 GB1906c6c1a1f18e1cdc2aa2ecf9c09afc455573131d3612b655c73f612d9d4c9a
granite-3.3-8b-base-Q4_K_M.gguf4.94 GB90488cbf6e024b6559a1f3a083432e3369206e665afb7a3affd7bf6670905b26
granite-3.3-8b-base-Q4_K_S.gguf4.69 GB222d996d8121dafd2b7268e0811ac439b0c831f531f88471341ff85b8544470e
granite-3.3-8b-base-Q5_0.gguf5.65 GB0fb30d73716973586e19d403e5715b7a4fec93472605589f0e0bf08b68040e92
granite-3.3-8b-base-Q5_1.gguf6.15 GB8c9204d0ba8e696a1d8a5ecb6bf2d1a4c778d31d835ad9de06dd6561df2ada49
granite-3.3-8b-base-Q5_K_M.gguf5.80 GBe85fd323212c3def00d11c1c1f1010f5b914a8693ff2ea2d5463f45ce128af66
granite-3.3-8b-base-Q5_K_S.gguf5.65 GB6462342b730ca93d64fe4bbc2ff7bd37ee599c74a28aa12bbfbde1245d7860b7
granite-3.3-8b-base-Q6_K.gguf6.71 GB745de52401eccc0c801c3075f5e10c97305834cabb80f6bac5fbfd541f90f77a
granite-3.3-8b-base-Q8_0.gguf8.68 GBe2719a1264de9cb7544c9fea65d29d5a75e39020c1a5eb27487772230bb377f9
granite-3.3-8b-base-f16.gguf16.3 GBcf8efcf79b8122d208009fa666b809ada639ce3f1222fe5e378062c3e056fa61
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
da0bb287b8 pinned now2026-11-15 05:15 UTC17 files · 89.4 GB

Use it

$ fw get ibm-granite/granite-3.3-8b-base-GGUF
# manifest sha256 04eab86e88b1… · 89.4 GB · 17 files
$ fw verify ./granite-3.3-8b-base-GGUF ibm-granite/granite-3.3-8b-base-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-3.3-8b-base-GGUF.json --dir ./granite-3.3-8b-base-GGUF $ python3 fw.py verify ./granite-3.3-8b-base-GGUF ./ibm-granite__granite-3.3-8b-base-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-3.3-8b-base-GGUF --revision da0bb287b8b5153f4eca84e7a4c1953f7cbfb03a --local-dir ./granite-3.3-8b-base-GGUF
llama.cppDownload one GGUF variant (granite-3.3-8b-base-Q2_K, 3.10 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-3.3-8b-base-GGUF --include "granite-3.3-8b-base-Q2_K*" --local-dir ./granite-3.3-8b-base-GGUF $ llama-server -m ./granite-3.3-8b-base-GGUF/granite-3.3-8b-base-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./granite-3.3-8b-base-GGUF/granite-3.3-8b-base-Q2_K.gguf\n' > Modelfile $ ollama create granite-3.3-8b-base-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
335d95cd703ce73a279a6ffa7f1c51d8020dec7469ab20fdbf9068fc8a499d40
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-3.3-8b-base-GGUFDate: 2026-11-15Commit: da0bb28Signed: 2DC28CC7B26A283B ✓
Upstream
ibm-granite/granite-3.3-8b-base-GGUF
Pinned commit
da0bb287b8b5153f4eca84e7a4c1953f7cbfb03a
Manifest
granite-3.3-8b-base-GGUF.json · .minisig
Manifest sha256
04eab86e88b14b8db789f1da5068c86a65099cc1bb72dae8a9be8f61880076da
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:15 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-3.3-8b-base-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-3.3-8b-base-GGUF.json.minisig $ minisign -Vm granite-3.3-8b-base-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-3.3-8b-base · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-3.3-8b-base-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-3.3-8b-base-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ibm-granite/granite-3.3-8b-base-GGUF

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3