CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-4.1-30b-GGUF
From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-4.1-30b-GGUF

Date: 2026-11-15Commit: 26a44ffSigned: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 315 GB in all. Published by ibm-granite under Apache-2.0.

granite315GBgranite-4.1-30b-GGUFggufpermissive
FactsParamsnot statedSize315 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get ibm-granite/granite-4.1-30b-GGUF
# manifest sha256 21fe1245da35… · 315 GB · 21 files
$ fw verify ./granite-4.1-30b-GGUF ibm-granite/granite-4.1-30b-GGUF
From sourceHosted (signed)ibm-granite/granite-4.1-30b-GGUFLast check: 2026-11-15 05:05 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-4.1-30b.

Works with

Run14Convert1Evaluate13Scan12Apps58

Convert with

ggml
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
315 GB
Weights
10.7 GB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
Apache-2.0 (permissive)
Files
21, each with a sha256
Publisher
ibm-granite
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-4.1-30b

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:05 UTCpassed

Model card

From the publisher at commit 26a44ff. Shown as plain text with links; images open at the publisher.

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite .safetensors model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.1-30b

Merging the .bf16 model#

The bf16 model had to be split into multiple files to accommodate single file size restrictions using the llama-gguf-split tool, with its default --split settings, which can be built from the ggml-org/llama.cpp project.

Use the following command to merge the split files which points to the first file in the sequence:

llama-gguf-split --merge granite-4.1-30b-bf16-00001-of-00005.gguf granite-4.1-30b-bf16.gguf

The remaining split filenames are inferred by the tool based upon the 00001-of-0000x naming convention.

Files

21 files · 315 GBWeights 10.7 GB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 21 files with their sha256
FileSizesha256
.gitattributes2.79 KBa0b4244e454d86b666c4bbcbb7b255a5a79d9b3afe51d4525482c65ab00dcef7
README.md1.07 KBb0ac8584ec9bec7502af1c8f93b256468835156709dcc79d417ad157a316b6ca
granite-4.1-30b-Q2_K.gguf10.7 GB81fca9861ca64ad59630abe131699403fbc8b4710f998c1be4b3ef99c9cc101c
granite-4.1-30b-Q3_K_L.gguf15.1 GBbb38ec12c092a13f6511952977c5c750df6f8e2c809b2ce2e8b0814a2ebba300
granite-4.1-30b-Q3_K_M.gguf14.0 GBdc70d78a721ea39c14c42d44539904e6211e8f6a1fd20902ae7160946df7bccd
granite-4.1-30b-Q3_K_S.gguf12.6 GBa807f6ea95a69a2e159978299fcbb310c14307cbaaa2a64cbb18b7fc7a087df3
granite-4.1-30b-Q4_0.gguf16.3 GB03796ec23dc280304a32e7db5e82e13225786e5ae7c2441cef0ada4afa2dc8a6
granite-4.1-30b-Q4_1.gguf18.1 GBc354f0c53be963ce5fbf6009d360b9ec8707b9daf825387f23f5c945b95d1799
granite-4.1-30b-Q4_K_M.gguf17.5 GBb33e4376e3581d11236ea53ced6b38399f6e91c0a391488486dc0827972f23f6
granite-4.1-30b-Q4_K_S.gguf16.5 GBc53f0adb8c7479ed73e8445aeb7f23494bd109ae248cb74af0ae482eb6d53b59
granite-4.1-30b-Q5_0.gguf19.9 GB7e7b9b8bd24bcff3015fcfb125d910303d8ad3e017aee086fd6d286e7cd8e480
granite-4.1-30b-Q5_1.gguf21.7 GB1c6d6df1d5063fbd6021c26955ebd2d42a30b12fcf1e2addac64fd5458400bf6
granite-4.1-30b-Q5_K_M.gguf20.5 GB90011962485021b2836e7476c1697f57e4ba041898e8a81dd4123cbe1b8d2340
granite-4.1-30b-Q5_K_S.gguf19.9 GB042ed3eb174a7fca1f8304f7501f64495cadcc36cd8fd474079d83f9c2e856eb
granite-4.1-30b-Q6_K.gguf23.7 GB182f89335e9b891b799230f496af5bd1f1dfff97e79bab424776b2d65766b53b
granite-4.1-30b-Q8_0.gguf30.7 GB2f772a60949ab40144bca249a5a38f7fa530d6b6649c14b8b6395c4cd64ef396
granite-4.1-30b-bf16-00001-of-00005.gguf13.3 GB7f18308307d43cfbfd27cc77522781b55b34067291c13a8fc6044bdad78b0e11
granite-4.1-30b-bf16-00002-of-00005.gguf13.0 GBd52920fb850451336032283497d708a9c1e070b3da594518d94bc34b862f6ac7
granite-4.1-30b-bf16-00003-of-00005.gguf12.7 GB36d078bf53a5a8fddd7c0873fdd1584c187444ff539fb45e7e48e6ffe3b59ef7
granite-4.1-30b-bf16-00004-of-00005.gguf12.5 GBb38733f6dd2a49a051193316890cfb66fede7a7b202355bab37627563dee7e61
granite-4.1-30b-bf16-00005-of-00005.gguf6.27 GBf7a0ac5b3b9930c03b4cbe80be384b6a207c5bb3b49ae736d662eb6adeb92191
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
26a44ffe99 pinned now2026-11-15 05:05 UTC21 files · 315 GB

Use it

$ fw get ibm-granite/granite-4.1-30b-GGUF
# manifest sha256 21fe1245da35… · 315 GB · 21 files
$ fw verify ./granite-4.1-30b-GGUF ibm-granite/granite-4.1-30b-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-4.1-30b-GGUF.json --dir ./granite-4.1-30b-GGUF $ python3 fw.py verify ./granite-4.1-30b-GGUF ./ibm-granite__granite-4.1-30b-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.1-30b-GGUF --revision 26a44ffe9923eea39af3ad811b56c9b0071e4347 --local-dir ./granite-4.1-30b-GGUF
llama.cppDownload one GGUF variant (granite-4.1-30b-Q2_K, 10.7 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.1-30b-GGUF --include "granite-4.1-30b-Q2_K*" --local-dir ./granite-4.1-30b-GGUF $ llama-server -m ./granite-4.1-30b-GGUF/granite-4.1-30b-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./granite-4.1-30b-GGUF/granite-4.1-30b-Q2_K.gguf\n' > Modelfile $ ollama create granite-4.1-30b-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
b0ac8584ec9bec7502af1c8f93b256468835156709dcc79d417ad157a316b6ca
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-4.1-30b-GGUFDate: 2026-11-15Commit: 26a44ffSigned: 2DC28CC7B26A283B ✓
Upstream
ibm-granite/granite-4.1-30b-GGUF
Pinned commit
26a44ffe9923eea39af3ad811b56c9b0071e4347
Manifest
granite-4.1-30b-GGUF.json · .minisig
Manifest sha256
21fe1245da35484d8f0867aaabf955eee5b49b1f256ee2f8d1122e6c9700e73b
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:05 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.1-30b-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.1-30b-GGUF.json.minisig $ minisign -Vm granite-4.1-30b-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-4.1-30b · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.1-30b-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-4.1-30b-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ibm-granite/granite-4.1-30b-GGUF

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3