CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-speech-5.0-2b-GGUF
From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-speech-5.0-2b-GGUF

Date: 2026-11-15Commit: 945b458Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 21.7 GB in all. Published by ibm-granite under Apache-2.0.

granite21.7GBgranite-speech-5.0-2b-GGUFggufpermissive
FactsParamsnot statedSize21.7 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get ibm-granite/granite-speech-5.0-2b-GGUF
# manifest sha256 c46c3abcf48d… · 21.7 GB · 19 files
$ fw verify ./granite-speech-5.0-2b-GGUF ibm-granite/granite-speech-5.0-2b-GGUF
From sourceHosted (signed)ibm-granite/granite-speech-5.0-2b-GGUFLast check: 2026-11-15 04:50 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-speech-5.0-2b.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
21.7 GB
Weights
769 MB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
19, each with a sha256
Publisher
ibm-granite
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-speech-5.0-2b

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:50 UTCpassed

Model card

From the publisher at commit 945b458. Shown as plain text with links; images open at the publisher.
granite-speech-5.0-2b (GGUF)#

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-speech-5.0-2b

Files

19 files · 21.7 GBWeights 769 MB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 19 files with their sha256
FileSizesha256
.gitattributes2.61 KBe679bc656e6d08621929b7d0663cdaa8939a7bc221b65d1a9fa15283b9d2d3a1
README.md493 Bd87ea5905074573e46681b7a4dd3292806cbda8da52eeb785d600e3eaae8cfde
granite-speech-5.0-2b-Q2_K.gguf769 MB6f1a1ac05300a789d7c8a8800cf54f08fc6e43ea01381a3f6b0a428aa7ac442a
granite-speech-5.0-2b-Q3_K_L.gguf1.01 GB8f237b5377be747bdb9381223ee29d732b907466f3d7e01d1848ca490d31b7d2
granite-speech-5.0-2b-Q3_K_M.gguf949 MB2fc7f91f0debb1977b81e5a4c4679b7224fac232f7c1696b96ce98cb04680daf
granite-speech-5.0-2b-Q3_K_S.gguf874 MB23fd635922c31c17bf930bb27a682329b57aa9c2b5cfb8f03a9cad4e2c12645e
granite-speech-5.0-2b-Q4_0.gguf1.09 GBd3b8deaaba5fed41ef7522a6efb43aabeed48bf7c0e7c48beb2b3008d2ca1753
granite-speech-5.0-2b-Q4_1.gguf1.19 GB38eb36740eb0f9df88de809c2d205c1b74e3e65c8940844757337d8dd77d68e5
granite-speech-5.0-2b-Q4_K_M.gguf1.14 GBf5dc61477e08af62377b1d37b7b535e91667326fedefb9cee82f871f3f03df85
granite-speech-5.0-2b-Q4_K_S.gguf1.10 GBd3a420b8500876e41ee1e6e646dd652cf18438bc47804f18282d95a7f2f35cce
granite-speech-5.0-2b-Q5_0.gguf1.29 GBe4606589240f55c3e17edecb17e4caad89bda745f8f9b6b87b0d87cec3db8b86
granite-speech-5.0-2b-Q5_1.gguf1.40 GBa20bd2287648360cb01f5995345bbaee91e95785d07d61b07ba14217c420bf1a
granite-speech-5.0-2b-Q5_K_M.gguf1.32 GBa0b9ed6a35f0c4ac8101d56c9d72421851fcb782893c41436925648af693e93d
granite-speech-5.0-2b-Q5_K_S.gguf1.29 GB497b685b183b15aa88e65b0407566be59a391a6559bd724078058bf358de1235
granite-speech-5.0-2b-Q6_K.gguf1.51 GB893cba7e1c924418cd60df934ee8a0750b01488543130cfb26e902928fcf7a4e
granite-speech-5.0-2b-Q8_0.gguf1.96 GB4972786fa455b71ee1f020e8ae1b147ca6cd2b1e5b0818048011d7f1da242790
granite-speech-5.0-2b-bf16.gguf3.68 GBf7c80814b7527b89dfcaa5d2ee9cc967ccdab2115159b73531f62d3544290432
mmproj-model-f16.gguf1.16 GBc0d108e1a3cf345b22c411245fc2762319f1c6b6e56bb15bdffe748c9342ca7d
model.sig9.59 KB0e9cb81d7b5a6d164d2b58f71a4a2cdc2e959088896c702896d6ac19cc4f94a0
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
945b4581e2 pinned now2026-11-15 04:50 UTC19 files · 21.7 GB

Use it

$ fw get ibm-granite/granite-speech-5.0-2b-GGUF
# manifest sha256 c46c3abcf48d… · 21.7 GB · 19 files
$ fw verify ./granite-speech-5.0-2b-GGUF ibm-granite/granite-speech-5.0-2b-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-speech-5.0-2b-GGUF.json --dir ./granite-speech-5.0-2b-GGUF $ python3 fw.py verify ./granite-speech-5.0-2b-GGUF ./ibm-granite__granite-speech-5.0-2b-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-speech-5.0-2b-GGUF --revision 945b4581e2b40cd9a3121de265fd8e387bdf782d --local-dir ./granite-speech-5.0-2b-GGUF
llama.cppDownload one GGUF variant (granite-speech-5.0-2b-Q2_K, 769 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-speech-5.0-2b-GGUF --include "granite-speech-5.0-2b-Q2_K*" --local-dir ./granite-speech-5.0-2b-GGUF $ llama-server -m ./granite-speech-5.0-2b-GGUF/granite-speech-5.0-2b-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./granite-speech-5.0-2b-GGUF/granite-speech-5.0-2b-Q2_K.gguf\n' > Modelfile $ ollama create granite-speech-5.0-2b-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
d87ea5905074573e46681b7a4dd3292806cbda8da52eeb785d600e3eaae8cfde
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-speech-5.0-2b-GGUFDate: 2026-11-15Commit: 945b458Signed: 2DC28CC7B26A283B ✓
Upstream
ibm-granite/granite-speech-5.0-2b-GGUF
Pinned commit
945b4581e2b40cd9a3121de265fd8e387bdf782d
Manifest
granite-speech-5.0-2b-GGUF.json · .minisig
Manifest sha256
c46c3abcf48d48094829fae69d6d980878d653a82ed838b2e818cc755e57b889
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:50 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-speech-5.0-2b-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-speech-5.0-2b-GGUF.json.minisig $ minisign -Vm granite-speech-5.0-2b-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-speech-5.0-2b · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-speech-5.0-2b-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-speech-5.0-2b-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ibm-granite/granite-speech-5.0-2b-GGUF

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3