CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-4.0-h-350m-GGUF
From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-4.0-h-350m-GGUF

Date: 2026-11-15Commit: a864f82Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 3.96 GB in all. Published by ibm-granite under Apache-2.0.

granite3.96GBgranite-4.0-h-350m-GGUFggufpermissive
FactsParamsnot statedSize3.96 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get ibm-granite/granite-4.0-h-350m-GGUF
# manifest sha256 a1aa84ab2100… · 3.96 GB · 17 files
$ fw verify ./granite-4.0-h-350m-GGUF ibm-granite/granite-4.0-h-350m-GGUF
From sourceHosted (signed)ibm-granite/granite-4.0-h-350m-GGUFLast check: 2026-11-15 04:51 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-4.0-h-350m.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
3.96 GB
Weights
160 MB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
17, each with a sha256
Publisher
ibm-granite
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-4.0-h-350m

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:51 UTCpassed

Model card

From the publisher at commit a864f82. Shown as plain text with links; images open at the publisher.
Granite 4.0 h-350m (GGUF)#

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.0-h-350m

Files

17 files · 3.96 GBWeights 160 MB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 17 files with their sha256
FileSizesha256
.gitattributes2.57 KB3696291ab7e27d3c273dd572c4ef68a11fc955f1497f997533694c0a1ad0aa16
README.md432 B75d68af87cd83b86e5d6f3a53e78ae06af20323db8cfdddc248d3f9ea34de0c5
granite-4.0-h-350m-Q2_K.gguf160 MBaf33267715e43998a3734ef3f49637472dfe3ed3ad8024530b4fa4e9dab878aa
granite-4.0-h-350m-Q3_K_L.gguf195 MB39e86aaf3d0bfcac554976a1a682b4e0c382357d1c0666358c6066f282e424b3
granite-4.0-h-350m-Q3_K_M.gguf189 MB9014e2708160642d1e9e3afee13000e14902ae81f51bd20763c177adecc86455
granite-4.0-h-350m-Q3_K_S.gguf181 MBa19eab86597a91144c85f73f5af1148e192d10dfd85070dc0284d8986566eed3
granite-4.0-h-350m-Q4_0.gguf216 MB7adb3d5765ad12b83b1c08a90746d8925af718545b4a36287e8dac8f83b72ab6
granite-4.0-h-350m-Q4_1.gguf233 MB74f48ffef489413f97bc68846964364292eda9bd3b7323657669fdf28d235a69
granite-4.0-h-350m-Q4_K_M.gguf223 MB0a8d6a7373602fadfba274a640ba784b86cc6847f1c67f1b0a90fa2ec266b7fb
granite-4.0-h-350m-Q4_K_S.gguf217 MB0b7c991535c44f0648d65432ca97ec359e7bf1117cd5c3f27357b65151bc58c0
granite-4.0-h-350m-Q5_0.gguf249 MB4bdf06090b4cb9596528480741a8bcc97af1c3d97913122b7b0ac736c118a9de
granite-4.0-h-350m-Q5_1.gguf265 MBe12a353f0f254eb79261e40e87d2030092a7dad3c74873adce5b66fa4c1edcbb
granite-4.0-h-350m-Q5_K_M.gguf252 MB3daabf26b0b9e14bd95dfd0eb8b1b3e463530c5c349b3ccdbe7b45a895d936d4
granite-4.0-h-350m-Q5_K_S.gguf249 MB934169e5f550648fd8e27667f44d0b8c567b7ded84c7a71915f53173b666a8b0
granite-4.0-h-350m-Q6_K.gguf284 MBdc6509305c03b143f419f9eae7cc6bbeffa67c9e82b5a5ed661ba2aa517d3860
granite-4.0-h-350m-Q8_0.gguf366 MBc7d9873640dc303b6773dcc44e72e5bdf533e1c95ca8421e6191fbff5c94c942
granite-4.0-h-350m-bf16.gguf685 MB2f7bf038df12c415ccfc450e0f55dd48208142ed3ec61ecbd229282fc753ddd1
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
a864f823cc pinned now2026-11-15 04:51 UTC17 files · 3.96 GB

Use it

$ fw get ibm-granite/granite-4.0-h-350m-GGUF
# manifest sha256 a1aa84ab2100… · 3.96 GB · 17 files
$ fw verify ./granite-4.0-h-350m-GGUF ibm-granite/granite-4.0-h-350m-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-350m-GGUF.json --dir ./granite-4.0-h-350m-GGUF $ python3 fw.py verify ./granite-4.0-h-350m-GGUF ./ibm-granite__granite-4.0-h-350m-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-350m-GGUF --revision a864f823cce6e6048b5752e2816fe7a23987d790 --local-dir ./granite-4.0-h-350m-GGUF
llama.cppDownload one GGUF variant (granite-4.0-h-350m-Q2_K, 160 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-350m-GGUF --include "granite-4.0-h-350m-Q2_K*" --local-dir ./granite-4.0-h-350m-GGUF $ llama-server -m ./granite-4.0-h-350m-GGUF/granite-4.0-h-350m-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./granite-4.0-h-350m-GGUF/granite-4.0-h-350m-Q2_K.gguf\n' > Modelfile $ ollama create granite-4.0-h-350m-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
75d68af87cd83b86e5d6f3a53e78ae06af20323db8cfdddc248d3f9ea34de0c5
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-4.0-h-350m-GGUFDate: 2026-11-15Commit: a864f82Signed: 2DC28CC7B26A283B ✓
Upstream
ibm-granite/granite-4.0-h-350m-GGUF
Pinned commit
a864f823cce6e6048b5752e2816fe7a23987d790
Manifest
granite-4.0-h-350m-GGUF.json · .minisig
Manifest sha256
a1aa84ab2100c937c53b72ad2508d64abf35f664514ff01c9138b9b7072162fb
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:51 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-350m-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-350m-GGUF.json.minisig $ minisign -Vm granite-4.0-h-350m-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-4.0-h-350m · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-350m-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-4.0-h-350m-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ibm-granite/granite-4.0-h-350m-GGUF

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3