alt.freeweights.granite / granite-4.2-8b-GGUF

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-4.2-8b-GGUF

Date: 2026-11-15Commit: 93f3f6aSigned: 2DC28CC7B26A283B ✓

Model. Gguf weights, 96.7 GB in all. Published by ibm-granite under Apache-2.0.

granite96.7GBgranite-4.2-8b-GGUFggufpermissive

FactsParamsnot statedSize96.7 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive

$ fw get ibm-granite/granite-4.2-8b-GGUF
# manifest sha256 2291513a993d… · 96.7 GB · 19 files
$ fw verify ./granite-4.2-8b-GGUF ibm-granite/granite-4.2-8b-GGUF

From sourceHosted (signed)ibm-granite/granite-4.2-8b-GGUFLast check: 2026-11-15 04:35 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-4.2-8b.

Works with

Run11 Convert1 Scan1

Runs with

Ranked by fit to this model (gguf), then by GitHub stars.

Ollama

llama.cpp LocalAI

BitNet llamafile KoboldCpp PocketPal AI llama-swap ik_llama.cpp RamaLama Maid

Convert with

ggml

Scan with

ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 96.7 GB
Weights: 3.41 GB (smallest of 15 GGUF variants)
Parameters: not stated
Formats: gguf
Task: not tagged
License: Apache-2.0 (permissive)
Files: 19, each with a sha256
Publisher: ibm-granite
Added: 2026-11-15
Section: alt.freeweights.granite

Lineage

Original release from the publisher.

Base model: ibm-granite/granite-4.2-8b

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 04:35 UTC	passed

Model card

From the publisher at commit 93f3f6a. Shown as plain text with links; images open at the publisher.

granite-4.2-8b (GGUF)#

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.2-8b

Files

19 files · 96.7 GBWeights 3.41 GB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.

Hide all 19 files with their sha256

File	Size	sha256
.gitattributes	2.45 KB	40c59fe9e41ccb3dd9b9c2909f05cc3e3f9bce4d697290c133144d0422a7a1bd
README.md	472 B	1f43efacac28527c2392735115a1f14f9bc736bedc6f7982f41513e81041899f
granite-4.2-8b-Q2_K.gguf	3.41 GB	dbaf5bba1dff2e37fb4e9563ae322001f2228d37d2080e55796fef6c8b81ef1f
granite-4.2-8b-Q3_K_L.gguf	4.70 GB	6230bceb89841b65d0455019f134a47fb6f4316dbc1f909747ec4329518220eb
granite-4.2-8b-Q3_K_M.gguf	4.35 GB	921fd8b015a34420607300831cf70ed306581b9bf33742ae804e42b894a2ca9a
granite-4.2-8b-Q3_K_S.gguf	3.94 GB	7b9849e1d501e7d85a6a7ef1c9acc23733c5bb1b63ecf0bac1c48bbdb6b5500c
granite-4.2-8b-Q4_0.gguf	5.06 GB	82af51c80f8c2913430aa020f97bd3d4708c5fc49c5bfbff09ac012f3c2132d2
granite-4.2-8b-Q4_1.gguf	5.58 GB	02c58f69dcd7a5f75ce2dbb22da706872c859fe6fa4b321d33f22dab19180463
granite-4.2-8b-Q4_K_M.gguf	5.35 GB	16a9369d0805f80b7377d25d87f937a90c05dc04ad79173a52001e42c9aab311
granite-4.2-8b-Q4_K_S.gguf	5.09 GB	6b2438a9177be0883b27722dadd5271c8e18806e068a7fc30a42c481c000c092
granite-4.2-8b-Q5_0.gguf	6.10 GB	49efb3a7a5bd51c92d72f5d3f858ab5f2a00cbf05f853909d443da1e53725bf5
granite-4.2-8b-Q5_1.gguf	6.63 GB	76f9e24373c2848c207f669ceac1755f8b851606c4de7d4f22c0dfac0a7a8d2b
granite-4.2-8b-Q5_K_M.gguf	6.25 GB	074ac7ee98b1703674657a65051caebe188d543656e0ad71eb1f6bb3ae063407
granite-4.2-8b-Q5_K_S.gguf	6.10 GB	fd9866f3fdd5b3fd8a0a7942ede9f7e96f53a02e13b9ad77f295b8e08446b0dd
granite-4.2-8b-Q6_K.gguf	7.22 GB	5ad3d67f6fe09a448031029bead7f6a088697ca2787c0c5640bf964c59df1a21
granite-4.2-8b-Q8_0.gguf	9.35 GB	fb66ad5750680c77c76b9dc095961375f14fc88ba15fd5fc084ef6e6701bad77
granite-4.2-8b-bf16.gguf	17.6 GB	d82690e0dc827f2c43effeb3d489f572afbe2541fa8b4895b0d958ce473925a6
granite_thinking_parser.py	4.65 KB	cd5eef99f559f33dc402e0475174a97dcb43724d7e810149c702e9bbc473048a
model.sig	12.0 KB	5f65d729f2d70c9976b3e58177ef96c0477168d1f8cf9b5751e56c102ca074f7

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
93f3f6a893 pinned now	2026-11-15 04:35 UTC	19 files · 96.7 GB

Use it

$ fw get ibm-granite/granite-4.2-8b-GGUF
# manifest sha256 2291513a993d… · 96.7 GB · 19 files
$ fw verify ./granite-4.2-8b-GGUF ibm-granite/granite-4.2-8b-GGUF

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-4.2-8b-GGUF.json --dir ./granite-4.2-8b-GGUF
$ python3 fw.py verify ./granite-4.2-8b-GGUF ./ibm-granite__granite-4.2-8b-GGUF.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.2-8b-GGUF --revision 93f3f6a8938ee922b784cf4e5b4203cd3428df8f --local-dir ./granite-4.2-8b-GGUF

llama.cppDownload one GGUF variant (granite-4.2-8b-Q2_K, 3.41 GB), then serve it.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.2-8b-GGUF --include "granite-4.2-8b-Q2_K*" --local-dir ./granite-4.2-8b-GGUF
$ llama-server -m ./granite-4.2-8b-GGUF/granite-4.2-8b-Q2_K.gguf

OllamaMake an Ollama model from the downloaded file.

$ printf 'FROM ./granite-4.2-8b-GGUF/granite-4.2-8b-Q2_K.gguf\n' > Modelfile
$ ollama create granite-4.2-8b-gguf -f Modelfile

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: 1f43efacac28527c2392735115a1f14f9bc736bedc6f7982f41513e81041899f
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-4.2-8b-GGUFDate: 2026-11-15Commit: 93f3f6aSigned: 2DC28CC7B26A283B ✓

Upstream: ibm-granite/granite-4.2-8b-GGUF
Pinned commit: 93f3f6a8938ee922b784cf4e5b4203cd3428df8f
Manifest: granite-4.2-8b-GGUF.json · .minisig
Manifest sha256: 2291513a993d604660fe3b5efca9a8862942473895a46ffbd76fd7088839f481
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 04:35 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.2-8b-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.2-8b-GGUF.json.minisig
$ minisign -Vm granite-4.2-8b-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-4.2-8b · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.2-8b-GGUF

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. granite-4.2-8b-GGUF.json. Provenance. Takedown history: none.

Source

huggingface.co/ibm-granite/granite-4.2-8b-GGUF

Related models

All of alt.freeweights.granite →

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3