alt.freeweights.granite / granite-4.1-8b-GGUF

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-4.1-8b-GGUF

Date: 2026-11-15Commit: 865b82cSigned: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 96.7 GB in all. Published by ibm-granite under Apache-2.0.

granite96.7GBgranite-4.1-8b-GGUFggufpermissive

FactsParamsnot statedSize96.7 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive

$ fw get ibm-granite/granite-4.1-8b-GGUF
# manifest sha256 4fb19b72fa51… · 96.7 GB · 17 files
$ fw verify ./granite-4.1-8b-GGUF ibm-granite/granite-4.1-8b-GGUF

From sourceHosted (signed)ibm-granite/granite-4.1-8b-GGUFLast check: 2026-11-15 04:44 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-4.1-8b.

Works with

Run14 Convert1 Evaluate13 Scan12 Apps58

Runs with

Ranked by fit to this model (gguf), then by GitHub stars.

Text Generation WebUI mistral.rs

Ollama

llama.cpp LocalAI

BitNet llamafile gpu-unlock KoboldCpp PocketPal AI llama-swap ik_llama.cpp

Show all 14

RamaLama Maid

Convert with

ggml

Evaluate with

Opik DeepEval Ragas lm-evaluation-harness OpenCompass SWE-bench

simple-evals TruLens HELM

LightEval

Evaluate Weave

Show all 13

Autoevals

Scan with

promptfoo garak Guardrails NeMo Guardrails Giskard DeepTeam AI Fairness 360 Fairlearn Detoxify MCP Scanner AgentDojo ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 96.7 GB
Weights: 3.41 GB (smallest of 15 GGUF variants)
Parameters: not stated
Formats: gguf
Task: text generation
License: Apache-2.0 (permissive)
Files: 17, each with a sha256
Publisher: ibm-granite
Added: 2026-11-15
Section: alt.freeweights.granite

Lineage

Original release from the publisher.

Base model: ibm-granite/granite-4.1-8b

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 04:44 UTC	passed

Model card

From the publisher at commit 865b82c. Shown as plain text with links; images open at the publisher.

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite .safetensors model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.1-8b

Files

17 files · 96.7 GBWeights 3.41 GB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.

Hide all 17 files with their sha256

File	Size	sha256
.gitattributes	2.45 KB	18f6434e54586249edd31dee6aa8e8faf5b6bbf3efeb41422eae7d547a709c68
README.md	450 B	d99c056777ab8674109560e835806dfed204524dabf401975e2d9321213ddff2
granite-4.1-8b-Q2_K.gguf	3.41 GB	f83a0bfe6b97ca3db3413ec9f1653b601c0b6c4862156bb40ef1e759648a1016
granite-4.1-8b-Q3_K_L.gguf	4.70 GB	171d552107223103f539e3909c968e2e98c1c708523cde72c4cf3613513ab724
granite-4.1-8b-Q3_K_M.gguf	4.35 GB	b099e58ec0a71a368fa68f08f1ea66c0f0e96fe13d621482f8456bbf4c213ad9
granite-4.1-8b-Q3_K_S.gguf	3.94 GB	243bcb7592226b21e7bb6f2e6899e46a32d1eed10c28d47c42811cafe055cae3
granite-4.1-8b-Q4_0.gguf	5.06 GB	5adf9b6b78921093bd4a805e1060f85d7f744c3eafc14d1ca449364d1e721a1a
granite-4.1-8b-Q4_1.gguf	5.58 GB	6d1d6a42817cd3ae551a69875227621baa8d83a4d4c928ba557d219efffd01f3
granite-4.1-8b-Q4_K_M.gguf	5.35 GB	ed902ac9eb6adce5a90c6a08c8ea201b50e23fdc5976d1cd0362006afac5309e
granite-4.1-8b-Q4_K_S.gguf	5.09 GB	bf64b9df6e3f976c883e7cf1601037542a024e8093d46ee2d90671c2d70db2e6
granite-4.1-8b-Q5_0.gguf	6.10 GB	42245fd240d29ec4f316528d2aeaa5f11dc7ab9241fca32582aee3b5adb13511
granite-4.1-8b-Q5_1.gguf	6.63 GB	9b062684a4dd23185e770c8de12b58beeb6d21fb7964f48b65c1c9d79670de6e
granite-4.1-8b-Q5_K_M.gguf	6.25 GB	353a49390e56b9035d8211868c03ed7beae125b914c57668c818d590d43edaca
granite-4.1-8b-Q5_K_S.gguf	6.10 GB	97df9d20aa0654867ed41427b0cd83d1403c7f65c3f87a28263a84fb2ed111db
granite-4.1-8b-Q6_K.gguf	7.22 GB	4ec0f43cdcce8bd9600e2d271b2f38cfca2cd01b4727416ecdd2320335917923
granite-4.1-8b-Q8_0.gguf	9.35 GB	4709c90f07b04af4deae8bf0eb06225fb257b5a86072ac09b87d3351242f6ba1
granite-4.1-8b-bf16.gguf	17.6 GB	b8c2d256fdd771e82e7dd3861ec51a6a6282976932d8d419d46ab1968a0cd3bf

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
865b82c2e7 pinned now	2026-11-15 04:44 UTC	17 files · 96.7 GB

Use it

$ fw get ibm-granite/granite-4.1-8b-GGUF
# manifest sha256 4fb19b72fa51… · 96.7 GB · 17 files
$ fw verify ./granite-4.1-8b-GGUF ibm-granite/granite-4.1-8b-GGUF

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-4.1-8b-GGUF.json --dir ./granite-4.1-8b-GGUF
$ python3 fw.py verify ./granite-4.1-8b-GGUF ./ibm-granite__granite-4.1-8b-GGUF.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.1-8b-GGUF --revision 865b82c2e7970d82e3731278c88c57ae7138359c --local-dir ./granite-4.1-8b-GGUF

llama.cppDownload one GGUF variant (granite-4.1-8b-Q2_K, 3.41 GB), then serve it.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.1-8b-GGUF --include "granite-4.1-8b-Q2_K*" --local-dir ./granite-4.1-8b-GGUF
$ llama-server -m ./granite-4.1-8b-GGUF/granite-4.1-8b-Q2_K.gguf

OllamaMake an Ollama model from the downloaded file.

$ printf 'FROM ./granite-4.1-8b-GGUF/granite-4.1-8b-Q2_K.gguf\n' > Modelfile
$ ollama create granite-4.1-8b-gguf -f Modelfile

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: d99c056777ab8674109560e835806dfed204524dabf401975e2d9321213ddff2
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-4.1-8b-GGUFDate: 2026-11-15Commit: 865b82cSigned: 2DC28CC7B26A283B ✓

Upstream: ibm-granite/granite-4.1-8b-GGUF
Pinned commit: 865b82c2e7970d82e3731278c88c57ae7138359c
Manifest: granite-4.1-8b-GGUF.json · .minisig
Manifest sha256: 4fb19b72fa5187d3f48f129a1513b8756293cdbd862acb6fb8e3801ac3b886f1
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 04:44 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.1-8b-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.1-8b-GGUF.json.minisig
$ minisign -Vm granite-4.1-8b-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-4.1-8b · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.1-8b-GGUF

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. granite-4.1-8b-GGUF.json. Provenance. Takedown history: none.

Source

huggingface.co/ibm-granite/granite-4.1-8b-GGUF

Related models

All of alt.freeweights.granite →

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3