alt.freeweights.granite / granite-4.0-h-1b-GGUF

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-4.0-h-1b-GGUF

Date: 2026-11-15Commit: c2cb197Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 16.3 GB in all. Published by ibm-granite under Apache-2.0.

granite16.3GBgranite-4.0-h-1b-GGUFggufpermissive

FactsParamsnot statedSize16.3 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive

$ fw get ibm-granite/granite-4.0-h-1b-GGUF
# manifest sha256 03564a80551a… · 16.3 GB · 17 files
$ fw verify ./granite-4.0-h-1b-GGUF ibm-granite/granite-4.0-h-1b-GGUF

From sourceHosted (signed)ibm-granite/granite-4.0-h-1b-GGUFLast check: 2026-11-15 04:51 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-4.0-h-1b.

Works with

Run11 Convert1 Scan1

Runs with

Ranked by fit to this model (gguf), then by GitHub stars.

Ollama

llama.cpp LocalAI

BitNet llamafile KoboldCpp PocketPal AI llama-swap ik_llama.cpp RamaLama Maid

Convert with

ggml

Scan with

ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 16.3 GB
Weights: 589 MB (smallest of 15 GGUF variants)
Parameters: not stated
Formats: gguf
Task: not tagged
License: Apache-2.0 (permissive)
Files: 17, each with a sha256
Publisher: ibm-granite
Added: 2026-11-15
Section: alt.freeweights.granite

Lineage

Original release from the publisher.

Base model: ibm-granite/granite-4.0-h-1b

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 04:51 UTC	passed

Model card

From the publisher at commit c2cb197. Shown as plain text with links; images open at the publisher.

Granite 4.0 h-1b (GGUF)#

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.0-h-1b

Files

17 files · 16.3 GBWeights 589 MB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.

Hide all 17 files with their sha256

File	Size	sha256
.gitattributes	2.54 KB	59f54439335d8e280129f3233cdc16b84abdeed5ac036778e24f2328e41e0edd
README.md	426 B	2fcc439ac0b22a699dcb235d5da44bc69b92617175e9d8e446b4bcdb08a7372d
granite-4.0-h-1b-Q2_K.gguf	589 MB	8717f20e4c7da7d4a9d5c25bdffaa2e532b72b886f4117987a303807ca79facb
granite-4.0-h-1b-Q3_K_L.gguf	763 MB	b7c86952a8f78a6c7660e0ce544869936994195cd394266d7201f91114e448d9
granite-4.0-h-1b-Q3_K_M.gguf	732 MB	f6bf85acdd97a573bb69a42f7b0277d12c5c5d7178cb7d45edd6ef76e32beac3
granite-4.0-h-1b-Q3_K_S.gguf	695 MB	e7c2ae4e3ad3fab66706dec2b86c5a258d13162f56d4ac4eb2759102111fc880
granite-4.0-h-1b-Q4_0.gguf	868 MB	23b20864c9544bd98ac6d5b8c53dec61992cc7add09fdd5f6b77472a4679a148
granite-4.0-h-1b-Q4_1.gguf	950 MB	599365d991def4b3f76bfa1ddfe850e4297bf1bb16f5501d3baa8548d927c7a1
granite-4.0-h-1b-Q4_K_M.gguf	901 MB	da3d737121a96f3c9a316685212376257a7f167b74380855666dd488d6af3bcb
granite-4.0-h-1b-Q4_K_S.gguf	873 MB	bedc788e1bafd1f45d2033fb4bfe55c7a402afee6a964c61316411a27e4eca88
granite-4.0-h-1b-Q5_0.gguf	1.03 GB	fe4d32d0bd9383160d5e2c78aaed7ad378d5dc97bcba165e968e7c6a5a18e7d8
granite-4.0-h-1b-Q5_1.gguf	1.11 GB	c71f986d1c90f15cba248c76ff2baff1b53a7b0602aa204ab51dc486e78b3b35
granite-4.0-h-1b-Q5_K_M.gguf	1.05 GB	016a6e46b88fee09f55860253f2c1a263372624bd57060dad6c3f344c89941ba
granite-4.0-h-1b-Q5_K_S.gguf	1.03 GB	95d64a64b67fbdc9c6653cc5e7d143eb0d954dd6f4de25abb42d60b84b5705b4
granite-4.0-h-1b-Q6_K.gguf	1.21 GB	93ef6ecaa8b5006153a3518d346a760f38a81607cfbf57c3a8140a0cac72b175
granite-4.0-h-1b-Q8_0.gguf	1.56 GB	f29248184ca766350e56e6d161c2a637ad302a6d595e15d4a62cd58327a0ac0e
granite-4.0-h-1b-bf16.gguf	2.93 GB	263ecc8dbe190d61b03639a3e71eec1ba6c70445e8488ce46cfe52d61786eb96

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
c2cb1972f5 pinned now	2026-11-15 04:51 UTC	17 files · 16.3 GB

Use it

$ fw get ibm-granite/granite-4.0-h-1b-GGUF
# manifest sha256 03564a80551a… · 16.3 GB · 17 files
$ fw verify ./granite-4.0-h-1b-GGUF ibm-granite/granite-4.0-h-1b-GGUF

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-1b-GGUF.json --dir ./granite-4.0-h-1b-GGUF
$ python3 fw.py verify ./granite-4.0-h-1b-GGUF ./ibm-granite__granite-4.0-h-1b-GGUF.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-1b-GGUF --revision c2cb1972f511add21f3bae244990b8ff3a3ffb23 --local-dir ./granite-4.0-h-1b-GGUF

llama.cppDownload one GGUF variant (granite-4.0-h-1b-Q2_K, 589 MB), then serve it.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-1b-GGUF --include "granite-4.0-h-1b-Q2_K*" --local-dir ./granite-4.0-h-1b-GGUF
$ llama-server -m ./granite-4.0-h-1b-GGUF/granite-4.0-h-1b-Q2_K.gguf

OllamaMake an Ollama model from the downloaded file.

$ printf 'FROM ./granite-4.0-h-1b-GGUF/granite-4.0-h-1b-Q2_K.gguf\n' > Modelfile
$ ollama create granite-4.0-h-1b-gguf -f Modelfile

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: 2fcc439ac0b22a699dcb235d5da44bc69b92617175e9d8e446b4bcdb08a7372d
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-4.0-h-1b-GGUFDate: 2026-11-15Commit: c2cb197Signed: 2DC28CC7B26A283B ✓

Upstream: ibm-granite/granite-4.0-h-1b-GGUF
Pinned commit: c2cb1972f511add21f3bae244990b8ff3a3ffb23
Manifest: granite-4.0-h-1b-GGUF.json · .minisig
Manifest sha256: 03564a80551a60de7d36c55f926b167403ce8c41ea15ee8ed67efad4f3f77f88
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 04:51 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-1b-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-1b-GGUF.json.minisig
$ minisign -Vm granite-4.0-h-1b-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-4.0-h-1b · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-1b-GGUF

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. granite-4.0-h-1b-GGUF.json. Provenance. Takedown history: none.

Source

huggingface.co/ibm-granite/granite-4.0-h-1b-GGUF

Related models

All of alt.freeweights.granite →

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3