alt.freeweights.granite / granite-4.0-h-350m-base-GGUF

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-4.0-h-350m-base-GGUF

Date: 2026-11-15Commit: dd750a6Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 3.96 GB in all. Published by ibm-granite under Apache-2.0.

granite3.96GBgranite-4.0-h-350m-base-GGUFggufpermissive

FactsParamsnot statedSize3.96 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive

$ fw get ibm-granite/granite-4.0-h-350m-base-GGUF
# manifest sha256 362d1d5a70f7… · 3.96 GB · 17 files
$ fw verify ./granite-4.0-h-350m-base-GGUF ibm-granite/granite-4.0-h-350m-base-GGUF

From sourceHosted (signed)ibm-granite/granite-4.0-h-350m-base-GGUFLast check: 2026-11-15 05:12 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-4.0-h-350m-base.

Works with

Run11 Convert1 Scan1

Runs with

Ranked by fit to this model (gguf), then by GitHub stars.

Ollama

llama.cpp LocalAI

BitNet llamafile KoboldCpp PocketPal AI llama-swap ik_llama.cpp RamaLama Maid

Convert with

ggml

Scan with

ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 3.96 GB
Weights: 160 MB (smallest of 15 GGUF variants)
Parameters: not stated
Formats: gguf
Task: not tagged
License: Apache-2.0 (permissive)
Files: 17, each with a sha256
Publisher: ibm-granite
Added: 2026-11-15
Section: alt.freeweights.granite

Lineage

Original release from the publisher.

Base model: ibm-granite/granite-4.0-h-350m-base

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 05:12 UTC	passed

Model card

From the publisher at commit dd750a6. Shown as plain text with links; images open at the publisher.

Granite 4.0 h-350m-base (GGUF)#

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.0-h-350m-base

Files

17 files · 3.96 GBWeights 160 MB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.

Hide all 17 files with their sha256

File	Size	sha256
.gitattributes	2.65 KB	517c8ecb7b5d5b682c37e294e654bbeb2db7de04f660071d7ead7827975fc6ae
README.md	447 B	e1625408a150d321034c4b429bec6e00c4d8809f1151ac008560438b3772b34f
granite-4.0-h-350m-base-Q2_K.gguf	160 MB	eae681d19c76ce830c6231108091b5328240956ba23195b0a0d9b8bedab64657
granite-4.0-h-350m-base-Q3_K_L.gguf	195 MB	091ed200c4768fac6b22ff3610533588e7f4dd5f5a06e0cc4d834631e4992125
granite-4.0-h-350m-base-Q3_K_M.gguf	189 MB	26c299f86cf2083c182a812278be72e6c623e1ea2d7d92e756518f46a47bb376
granite-4.0-h-350m-base-Q3_K_S.gguf	181 MB	40d66a78566da45a978a253b2116106dc041be4173b9dc2d45adb528f9cec3e8
granite-4.0-h-350m-base-Q4_0.gguf	216 MB	d27bb8897a6580c0af54bca11d654c66ab1ddb7386ba82a374088402efb7cc42
granite-4.0-h-350m-base-Q4_1.gguf	232 MB	dcfa8dcab1f58f23d7ef256995c8b5ac81c3c00f1df307b8b89bbef2c90197b8
granite-4.0-h-350m-base-Q4_K_M.gguf	223 MB	b5c29b02fb14da1d84f48654aa27f087a5296446b0e5c62654b3ed1c4f3561cd
granite-4.0-h-350m-base-Q4_K_S.gguf	217 MB	fe0b87f282202d3a069a470236c5f2106c02c8dda141710a4bb9a7936d0fd60d
granite-4.0-h-350m-base-Q5_0.gguf	249 MB	dcdc89ca31fc5f1fc765b15a0d355fe695d31766aadeca9953542ad707371947
granite-4.0-h-350m-base-Q5_1.gguf	265 MB	3c359199a50ed1803cfdea33e4b4b913a9dade09ffa205de75458ff35aeec933
granite-4.0-h-350m-base-Q5_K_M.gguf	252 MB	3007ebb10b74cc198f468a9575990f942f9f29cf2260d194d76916cf379f71ec
granite-4.0-h-350m-base-Q5_K_S.gguf	249 MB	5b7abbc3a0da4eb0463c29b940f5a20ea7beb131e24ef16a0c9c223deb064327
granite-4.0-h-350m-base-Q6_K.gguf	284 MB	67712460d51f31fc0a0e682d3ce0853afd65af09f82223f7097986630a73607f
granite-4.0-h-350m-base-Q8_0.gguf	366 MB	a536a03137ef70c7f6c00d3dd9d062ba4a15210ee9fff8b238d3124fd053e7af
granite-4.0-h-350m-base-bf16.gguf	685 MB	f3ee51f05c1ffff539ee35f31b6586f6d204c601122674ac1728ca9d1b6fc093

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
dd750a6178 pinned now	2026-11-15 05:12 UTC	17 files · 3.96 GB

Use it

$ fw get ibm-granite/granite-4.0-h-350m-base-GGUF
# manifest sha256 362d1d5a70f7… · 3.96 GB · 17 files
$ fw verify ./granite-4.0-h-350m-base-GGUF ibm-granite/granite-4.0-h-350m-base-GGUF

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-350m-base-GGUF.json --dir ./granite-4.0-h-350m-base-GGUF
$ python3 fw.py verify ./granite-4.0-h-350m-base-GGUF ./ibm-granite__granite-4.0-h-350m-base-GGUF.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-350m-base-GGUF --revision dd750a6178cecdef5154f87fd8e9d71821df7c5d --local-dir ./granite-4.0-h-350m-base-GGUF

llama.cppDownload one GGUF variant (granite-4.0-h-350m-base-Q2_K, 160 MB), then serve it.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-350m-base-GGUF --include "granite-4.0-h-350m-base-Q2_K*" --local-dir ./granite-4.0-h-350m-base-GGUF
$ llama-server -m ./granite-4.0-h-350m-base-GGUF/granite-4.0-h-350m-base-Q2_K.gguf

OllamaMake an Ollama model from the downloaded file.

$ printf 'FROM ./granite-4.0-h-350m-base-GGUF/granite-4.0-h-350m-base-Q2_K.gguf\n' > Modelfile
$ ollama create granite-4.0-h-350m-base-gguf -f Modelfile

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: e1625408a150d321034c4b429bec6e00c4d8809f1151ac008560438b3772b34f
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-4.0-h-350m-base-GGUFDate: 2026-11-15Commit: dd750a6Signed: 2DC28CC7B26A283B ✓

Upstream: ibm-granite/granite-4.0-h-350m-base-GGUF
Pinned commit: dd750a6178cecdef5154f87fd8e9d71821df7c5d
Manifest: granite-4.0-h-350m-base-GGUF.json · .minisig
Manifest sha256: 362d1d5a70f74b3f7529bb9372b16cdc8b4f4a90c2af179cfdae89971f0ffd1a
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 05:12 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-350m-base-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-4.0-h-350m-base-GGUF.json.minisig
$ minisign -Vm granite-4.0-h-350m-base-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-4.0-h-350m-base · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-4.0-h-350m-base-GGUF

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. granite-4.0-h-350m-base-GGUF.json. Provenance. Takedown history: none.

Source

huggingface.co/ibm-granite/granite-4.0-h-350m-base-GGUF

Related models

All of alt.freeweights.granite →

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2

From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3