CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-switch-4.1-30b-GGUF
From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject:

granite-switch-4.1-30b-GGUF

Date: 2026-11-15Commit: 3ba16c4Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 367 GB in all. Published by ibm-granite under Apache-2.0.

granite367GBgranite-switch-4.1-30b-GGUFggufpermissive
FactsParamsnot statedSize367 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get ibm-granite/granite-switch-4.1-30b-GGUF
# manifest sha256 9694e8993b7c… · 367 GB · 35 files
$ fw verify ./granite-switch-4.1-30b-GGUF ibm-granite/granite-switch-4.1-30b-GGUF
From sourceHosted (signed)ibm-granite/granite-switch-4.1-30b-GGUFLast check: 2026-11-15 04:56 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-switch-4.1-30b.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
367 GB
Weights
14.4 GB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
35, each with a sha256
Publisher
ibm-granite
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-switch-4.1-30b

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:56 UTCpassed

Model card

From the publisher at commit 3ba16c4. Shown as plain text with links; images open at the publisher.
granite-switch-4.1-30b (GGUF)#

Note. This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-switch-4.1-30b

Build Information#
  • llama.cpp build tag: b11798
  • Transformers version: 5.20.2

Files

35 files · 367 GBWeights 14.4 GB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 35 files with their sha256
FileSizesha256
.gitattributes2.67 KBff46582ca7fab7eb41f15c541e0e8a746269f3dc87e22abbbb4df446889655d3
README.md539 B96d3a5722ce077fa699cc818acabed6f7a98e8b52c12a04c3770d9cf56182465
granite-switch-4.1-30b-Q2_K.gguf14.4 GBa75db60e93618567e40e608aafafe9e8b565a86852e0bea1de43a0d0ded4448a
granite-switch-4.1-30b-Q2_K.sig5.69 KB68020dfc484507f171a4e3dae2d80de74ca2152127da5e2f0d8930772b542ebc
granite-switch-4.1-30b-Q3_K_L.gguf18.8 GBd154162f067479bc333f724583084a3a8143e29968717e5910f03c66e9869b70
granite-switch-4.1-30b-Q3_K_L.sig5.70 KB56e28a3cdfea4a80d049539f9d36a6a72547fae380f949121a93af7d6c750a2e
granite-switch-4.1-30b-Q3_K_M.gguf17.5 GBbdd78e7c41dca13a4ea98694ba73f5a563ef79acc206a74dde90d9ece94ef778
granite-switch-4.1-30b-Q3_K_M.sig5.70 KB0a60ee97195615f7268f6975796cf00f9c6a410a9ed0c48f11281622f0fe63ad
granite-switch-4.1-30b-Q3_K_S.gguf15.9 GB978ced9c7e3e43188afff13059acb440e56bbb58390adaec0abad71bac632aa2
granite-switch-4.1-30b-Q3_K_S.sig5.70 KB63c4a573422c512beb0b9e15da3701a78cd8a13b7acda88707d9d822138b6f94
granite-switch-4.1-30b-Q4_0.gguf19.7 GB012ac06f18f4b843077a4b64235c531f15ab29774ae1d6cc3d61bb655525ce63
granite-switch-4.1-30b-Q4_0.sig5.69 KB3530fc9fa2031e462e085222e23dc5d6fa1799cee838ec3376af1ea00e83986b
granite-switch-4.1-30b-Q4_1.gguf21.5 GB47bcd43c37d690424ec0ea54898644ae5b878ae0f0e153bdd14fe8befe379d1e
granite-switch-4.1-30b-Q4_1.sig5.69 KB691db0df56061e60d3031f49983e8828211f4a993bd4f6ebdc3aab75f653578d
granite-switch-4.1-30b-Q4_K_M.gguf21.0 GBebb9020a88a04997eaeba993b996ebcba33b443f4d7247ab942a1bf8f7975f23
granite-switch-4.1-30b-Q4_K_M.sig5.70 KB1217e7cadd84153550bd03909d0efa1d3a3eee8becacdda33351ccdb3f0e9390
granite-switch-4.1-30b-Q4_K_S.gguf19.9 GB86fcb80c7edf9f211405721fb9bace1047bea11d0b1c70f43856e805e16fc4f0
granite-switch-4.1-30b-Q4_K_S.sig5.70 KB3015726f220f35e8721359e219b80e24b7f8ad881b0d8565d3a809d6e04e8d92
granite-switch-4.1-30b-Q5_0.gguf23.3 GB13c061d54d70fe339f256ec5f292cea59adaf02cc1653d9737828aab2366f627
granite-switch-4.1-30b-Q5_0.sig5.69 KBb3b32309b8ffaf08ff67c98cb5c6be3b0311df47346ab1bd1b958798434d9ea1
granite-switch-4.1-30b-Q5_1.gguf25.1 GB72c6968b2c456966a9e3e7c07e288dc64bf5b96cebc414e4d44e483d939959cb
granite-switch-4.1-30b-Q5_1.sig5.69 KBd2e9c5963ed16ab92388b0013c10a92ac38551aaa165d8face11e00faf15ac8d
granite-switch-4.1-30b-Q5_K_M.gguf24.0 GB01fac7d4ca79327108738eeb726e7f240490eb11800cb46f2fe94154d0eeaf66
granite-switch-4.1-30b-Q5_K_M.sig5.70 KBa94fe0dbb2169596a04c976df5a2055e417489e67ab7c81302eab963bdfbdaad
granite-switch-4.1-30b-Q5_K_S.gguf23.3 GB5703fb3114a3b6c6af918edb1287655aa4668dc576387a1c1f54e389be7da54f
granite-switch-4.1-30b-Q5_K_S.sig5.70 KB1bf8c906be478056048b8f24babf824ddecbad5c364632ba522f750719fbb89d
granite-switch-4.1-30b-Q6_K.gguf27.1 GB71ab75255d7578d790b4e53b584f46dc28b6eba55b21054854df1822a4b71e8e
granite-switch-4.1-30b-Q6_K.sig5.69 KBa63a92a0c2aacf73601377d4ac40692dff715eea698c13430ddc0fc087f699a6
granite-switch-4.1-30b-Q8_0.gguf34.0 GB8397d60e0ce65d94dbc78eb7b89b825c967632163fa2760a627d67cf0dbc4ec8
granite-switch-4.1-30b-Q8_0.sig5.69 KB97d759928580f7ef69a1db3a66dc6416aea938f6cb959e9b23ae2bd0665feede
granite-switch-4.1-30b-bf16-00001-of-00002.gguf44.8 GBaf17e1324ccedd9c90c48bd375317a26f13fa8f4baceab6ae40b07217ff9f93b
granite-switch-4.1-30b-bf16-00002-of-00002.gguf16.3 GB93f4491feceaec974132529c0f123813a9e1254e1d96eb2dec7291e4603f4afe
granite-switch-4.1-30b-bf16-metadata.properties701 B9764b602606129f9b311c1a3b401495d8e0544b7e014b0157176d08d64df680d
granite-switch-4.1-30b-bf16.sig5.98 KB00d51e7f08a2c20903d695277b0d70f5ba9a9aea6120555cc89f355a4fbe4e2a
model.sig9.93 KBa5f358f6b6c6d61cdd26112c38ff716ff07be9c44d815b5f4c4ff9ac4c0d9220
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
3ba16c482c pinned now2026-11-15 04:56 UTC35 files · 367 GB

Use it

$ fw get ibm-granite/granite-switch-4.1-30b-GGUF
# manifest sha256 9694e8993b7c… · 367 GB · 35 files
$ fw verify ./granite-switch-4.1-30b-GGUF ibm-granite/granite-switch-4.1-30b-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-switch-4.1-30b-GGUF.json --dir ./granite-switch-4.1-30b-GGUF $ python3 fw.py verify ./granite-switch-4.1-30b-GGUF ./ibm-granite__granite-switch-4.1-30b-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-switch-4.1-30b-GGUF --revision 3ba16c482c2f671663ad034eafa26bcd9a74e1b3 --local-dir ./granite-switch-4.1-30b-GGUF
llama.cppDownload one GGUF variant (granite-switch-4.1-30b-Q2_K, 14.4 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-switch-4.1-30b-GGUF --include "granite-switch-4.1-30b-Q2_K*" --local-dir ./granite-switch-4.1-30b-GGUF $ llama-server -m ./granite-switch-4.1-30b-GGUF/granite-switch-4.1-30b-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./granite-switch-4.1-30b-GGUF/granite-switch-4.1-30b-Q2_K.gguf\n' > Modelfile $ ollama create granite-switch-4.1-30b-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
96d3a5722ce077fa699cc818acabed6f7a98e8b52c12a04c3770d9cf56182465
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ibm-granite <huggingface.co/ibm-granite>Newsgroups: alt.freeweights.graniteSubject: granite-switch-4.1-30b-GGUFDate: 2026-11-15Commit: 3ba16c4Signed: 2DC28CC7B26A283B ✓
Upstream
ibm-granite/granite-switch-4.1-30b-GGUF
Pinned commit
3ba16c482c2f671663ad034eafa26bcd9a74e1b3
Manifest
granite-switch-4.1-30b-GGUF.json · .minisig
Manifest sha256
9694e8993b7c6bc161ebcc432ae44e74987ee71ca7dd4b084d3d437c89838d1c
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:56 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-switch-4.1-30b-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-switch-4.1-30b-GGUF.json.minisig $ minisign -Vm granite-switch-4.1-30b-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-switch-4.1-30b · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ibm-granite/granite-switch-4.1-30b-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-switch-4.1-30b-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ibm-granite/granite-switch-4.1-30b-GGUF

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3