CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-4.0-h-small-base-GGUF
From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-4.0-h-small-base-GGUF

Date: 2026-11-15Commit: d613b92Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 351 GB in all. Published by ibm-granite under Apache-2.0.

granite351GBgranite-4.0-h-small-base-GGUFggufpermissive
FactsParamsnot statedSize351 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get ibm-granite/granite-4.0-h-small-base-GGUF
# manifest sha256 8dab8fca9a52… · 351 GB · 17 files
$ fw verify ./granite-4.0-h-small-base-GGUF ibm-granite/granite-4.0-h-small-base-GGUF
From sourceHosted (signed)ibm-granite/granite-4.0-h-small-base-GGUFLast check: 2026-11-15 05:16 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-4.0-h-small-base.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
351 GB
Weights
11.8 GB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
17, each with a sha256
Publisher
ibm-granite
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-4.0-h-small-base

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:16 UTCpassed

Model card

From the publisher at commit d613b92. Shown as plain text with links; images open at the publisher.
Granite 4.0 H-Small Base (GGUF)#

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.0-h-small-base

Files

17 files · 351 GBWeights 11.8 GB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 17 files with their sha256
FileSizesha256
.gitattributes2.60 KBbf61e14c23e893ebd870722db26aaa23aaf100f37b1e79f4c4308f4b8020d028
README.md452 B34b38cca5cc63571bbb02712792252fe662b009486112638aa3351eb406e5af7
granite-4.0-h-small-base-Q2_K.gguf11.8 GBf2585abda0699aae47912fe51abcb5e06b890ebae3f7e25497519abbeb1ec712
granite-4.0-h-small-base-Q3_K_L.gguf16.5 GB261aa80cfa85771f7c127ec5293bca6887b5178b38d917f5399c3c1af848ed40
granite-4.0-h-small-base-Q3_K_M.gguf15.4 GB72b4385b585cb3f755e8ef09e1d079ada950d617dd2f7bc541dcd9300146c737
granite-4.0-h-small-base-Q3_K_S.gguf14.1 GB180fa63d081baeb35b11ab899d9dade63410201d1bd270fcdfb5e03a9bcc190f
granite-4.0-h-small-base-Q4_0.gguf18.3 GB8c41938a4385257481354cc603503faa07f6c9bcc43fb3bd7f8776152336ee57
granite-4.0-h-small-base-Q4_1.gguf20.3 GBb10c97d92381cc10e0d2b41e613338652632e17d6df0a146dd63caf72e8228c9
granite-4.0-h-small-base-Q4_K_M.gguf19.5 GB03958c12dfc12c5d565c9637c80361cbeeb31d2f66e3f33bc09ca0603f3d01c7
granite-4.0-h-small-base-Q4_K_S.gguf18.4 GBbc1a4638e529fca23773d6e076e1f35645c45c53b9ac88d8e81e4a61abdebf83
granite-4.0-h-small-base-Q5_0.gguf22.2 GBcd557059759a2fb6fa1009ce7aa0e13a949e9c634df5f3dde04b89c0ae8aa20e
granite-4.0-h-small-base-Q5_1.gguf24.2 GB1b6822ece4039ba9dfc0a85c3d5679282d8957c159d1c2f44b8550bae5a03117
granite-4.0-h-small-base-Q5_K_M.gguf22.9 GBbe524d46821f8a736148d11997c6a5c7967b96dd4eabf5b8ab82d61a6bf687c9
granite-4.0-h-small-base-Q5_K_S.gguf22.2 GBa9b114b2de714e4e71807819ccd54569ad51ed988251bdaff90ebef324ef6cf9
granite-4.0-h-small-base-Q6_K.gguf26.5 GB60f832fa5cb043a102e65c1e465c25ef0f707b1315fbfe699b204cbcc0413f1a
granite-4.0-h-small-base-Q8_0.gguf34.3 GBa8903e18953a5257703d2e87599dcd00be743862d92e6c4e0ad5bb39a396c24d
granite-4.0-h-small-base-f16.gguf64.4 GB0df858f7076593eb81f7f4393476eda34a8211f6257ed4403dfe591d06aa6676
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
d613b92b37 pinned now2026-11-15 05:16 UTC17 files · 351 GB

Use it

$ fw get ibm-granite/granite-4.0-h-small-base-GGUF
# manifest sha256 8dab8fca9a52… · 351 GB · 17 files
$ fw verify ./granite-4.0-h-small-base-GGUF ibm-granite/granite-4.0-h-small-base-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-small-base-GGUF.json --dir ./granite-4.0-h-small-base-GGUF $ python3 fw.py verify ./granite-4.0-h-small-base-GGUF ./ibm-granite__granite-4.0-h-small-base-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-small-base-GGUF --revision d613b92b3764b8142d1a4f64017fb457505dbc66 --local-dir ./granite-4.0-h-small-base-GGUF
llama.cppDownload one GGUF variant (granite-4.0-h-small-base-Q2_K, 11.8 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-small-base-GGUF --include "granite-4.0-h-small-base-Q2_K*" --local-dir ./granite-4.0-h-small-base-GGUF $ llama-server -m ./granite-4.0-h-small-base-GGUF/granite-4.0-h-small-base-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./granite-4.0-h-small-base-GGUF/granite-4.0-h-small-base-Q2_K.gguf\n' > Modelfile $ ollama create granite-4.0-h-small-base-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
34b38cca5cc63571bbb02712792252fe662b009486112638aa3351eb406e5af7
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-4.0-h-small-base-GGUFDate: 2026-11-15Commit: d613b92Signed: 2DC28CC7B26A283B ✓
Upstream
ibm-granite/granite-4.0-h-small-base-GGUF
Pinned commit
d613b92b3764b8142d1a4f64017fb457505dbc66
Manifest
granite-4.0-h-small-base-GGUF.json · .minisig
Manifest sha256
8dab8fca9a5271aebbfba4a04d11d31b27cbce6241e078f7fc794077f383a3de
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:16 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-small-base-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-small-base-GGUF.json.minisig $ minisign -Vm granite-4.0-h-small-base-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-4.0-h-small-base · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-small-base-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-4.0-h-small-base-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ibm-granite/granite-4.0-h-small-base-GGUF

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3