From: ibm-granite <huggingface.co/ibm-granite> Newsgroups: alt.freeweights.graniteSubject: granite-8b-code-instruct-4k-GGUF Date: 2026-11-15Commit: 7f03f9fSigned: 2DC28CC7B26A283B ✓ Text generation model. Gguf weights, 4.88 GB in all. Published by ibm-granite under Apache-2.0.
granite 4.88 GB granite-8b-code-instruct-4k-GGUF gguf permissive
Facts Params not stated Size 4.88 GB Formats gguf Task text generation License Apache-2.0 permissive
fw
$ fw get ibm-granite/granite-8b-code-instruct-4k-GGUF
# manifest sha256 056b4d2d45fb… · 4.88 GB · 3 files
$ fw verify ./granite-8b-code-instruct-4k-GGUF ibm-granite/granite-8b-code-instruct-4k-GGUFHosted (signed) ibm-granite/granite-8b-code-instruct-4k-GGUF Last check: 2026-11-15 04:50 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of granite-8b-code-base-4k .
Works with
Runs with Ranked by fit to this model (gguf), then by GitHub stars.
Show all 14
Overview
Size 4.88 GB
Weights 4.88 GB (GGUF)
Parameters not stated
Formats gguf
Task text generation
License Apache-2.0 (permissive)
Files 3, each with a sha256
Publisher ibm-granite
Added 2026-11-15
Section alt.freeweights.granite Lineage
Original release from the publisher.
Base model: ibm-granite/granite-8b-code-base-4k
Where these bytes come from
Publisher at the pinned commit →You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
Badge Host Last check Result huggingface.co 2026-11-15 04:50 UTC passed
Model card From the publisher at commit
7f03f9f . Shown as plain text with links; images open at the publisher.
⚠️ DEPRECATION WARNING ⚠️#
⚠️ NOT RECOMMENDED FOR USE IN NEW PROJECTS ⚠️#
New applications/projects should use the latest mainline Granite language model family, whose code capabilities supercede this model. This model is being made available strictly for historical/scientific purposes. Please see our Granite Collections for the latest Granite releases.
Image: image/png
ibm-granite/granite-8b-code-instruct-4k-GGUF#
This is the Q4_K_M converted version of the original ibm-granite/granite-8b-code-instruct-4koriginal model card for more details.
Use with llama.cpp#
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
# install
make
# run generation
./main -m granite-8b-code-instruct-4k-GGUF/granite-8b-code-instruct.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --colorFiles 3 files · 4.88 GB Weights 4.88 GB (GGUF). Sizes and sha256 from the signed manifest.
Hide all 3 files with their sha256 File Size sha256 .gitattributes 1.59 KB 515174303a95a9ef4116672fea596a5569c842a17d5a0b13f1d4f85406fcb771 README.md 5.58 KB c9545f5fd88eb2cb4f6b52c8a7733f2e0a6151dce934a9dacf7e321a869cf9e3 granite-8b-code-instruct.Q4_K_M.gguf 4.88 GB bc8804cb43c4e1e82e2188658569b147587f83a89640600a64d5f7d7de2565b4
Versions Each time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commit Date Contents 7f03f9f5db pinned now 2026-11-15 04:50 UTC 3 files · 4.88 GB
Use it fw
$ fw get ibm-granite/granite-8b-code-instruct-4k-GGUF
# manifest sha256 056b4d2d45fb… · 4.88 GB · 3 files
$ fw verify ./granite-8b-code-instruct-4k-GGUF ibm-granite/granite-8b-code-instruct-4k-GGUFfw.py Checks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ibm-granite/granite-8b-code-instruct-4k-GGUF.json --dir ./granite-8b-code-instruct-4k-GGUF
$ python3 fw.py verify ./granite-8b-code-instruct-4k-GGUF ./ibm-granite__granite-8b-code-instruct-4k-GGUF.jsonhf The Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download ibm-granite/granite-8b-code-instruct-4k-GGUF --revision 7f03f9f5dba8c4be26491d14c2fca861aa0c4ec1 --local-dir ./granite-8b-code-instruct-4k-GGUFllama.cpp Download one GGUF variant (granite-8b-code-instruct.Q4_K_M, 4.88 GB), then serve it.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download ibm-granite/granite-8b-code-instruct-4k-GGUF --include "granite-8b-code-instruct.Q4_K_M*" --local-dir ./granite-8b-code-instruct-4k-GGUF
$ llama-server -m ./granite-8b-code-instruct-4k-GGUF/granite-8b-code-instruct.Q4_K_M.ggufOllama Make an Ollama model from the downloaded file.
$ printf 'FROM ./granite-8b-code-instruct-4k-GGUF/granite-8b-code-instruct.Q4_K_M.gguf\n' > Modelfile
$ ollama create granite-8b-code-instruct-4k-gguf -f ModelfileLicense Name Apache License 2.0 Id Apache-2.0 Class Permissive Redistribution yes Listing Hosted (signed) Decided License as declared by the publisher. No person read it. 2026-11-15 Text in README.md Text sha256 c9545f5fd88eb2cb4f6b52c8a7733f2e0a6151dce934a9dacf7e321a869cf9e3 Terms gate No extra terms beyond the license. Read the license text
Licenses are checked against the license table . A custom license passes only after a person reads it.
Provenance From: ibm-granite <huggingface.co/ibm-granite> Newsgroups: alt.freeweights.graniteSubject: granite-8b-code-instruct-4k-GGUF Date: 2026-11-15Commit: 7f03f9fSigned: 2DC28CC7B26A283B ✓
How to verify
$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-8b-code-instruct-4k-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/ibm-granite/granite-8b-code-instruct-4k-GGUF.json.minisig
$ minisign -Vm granite-8b-code-instruct-4k-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tab A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree No model in the catalog names this one as its parent.
Get it
$ HF_ENDPOINT =https://freeweights.allternit.com hf download ibm-granite/granite-8b-code-instruct-4k-GGUFOpen in Freeweights Studio Pull, verify and run it in the Allternit app on Desktop, web or phone.
6.8B params 27.4 GB GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1 safetensors permissive Facts Params 6.8B Size 27.4 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: ibm-granite <huggingface.co/ibm-granite> Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1 6.8B params 27.4 GB GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2 safetensors permissive Facts Params 6.8B Size 27.4 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: ibm-granite <huggingface.co/ibm-granite> Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2 6.8B params 27.4 GB GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3 safetensors permissive Facts Params 6.8B Size 27.4 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: ibm-granite <huggingface.co/ibm-granite> Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3 6.8B params 27.4 GB GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1 safetensors permissive Facts Params 6.8B Size 27.4 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: ibm-granite <huggingface.co/ibm-granite> Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1 6.8B params 27.4 GB GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2 safetensors permissive Facts Params 6.8B Size 27.4 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: ibm-granite <huggingface.co/ibm-granite> Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2 6.8B params 27.4 GB GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3 safetensors permissive Facts Params 6.8B Size 27.4 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: ibm-granite <huggingface.co/ibm-granite> Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3
