CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.granite / granite-3.0-2b-instruct
From: onnx-community <huggingface.co/onnx-community>Newsgroups: alt.freeweights.graniteSubject:

granite-3.0-2b-instruct

Date: 2026-11-15Commit: 866e8f6Signed: 2DC28CC7B26A283B ✓

Text generation model. Onnx weights, 28.1 GB in all. Published by onnx-community under Apache-2.0.

granite28.1GBgranite-3.0-2b-instructonnxpermissive
FactsParamsnot statedSize28.1 GBFormatsonnxTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get onnx-community/granite-3.0-2b-instruct
# manifest sha256 b9b98506c93a… · 28.1 GB · 24 files
$ fw verify ./granite-3.0-2b-instruct onnx-community/granite-3.0-2b-instruct
From sourceHosted (signed)onnx-community/granite-3.0-2b-instructLast check: 2026-11-15 05:22 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of granite-3.0-2b-instruct.

Works with

Run5Convert3Evaluate13Scan12Apps58

Runs with

Ranked by fit to this model (onnx), then by GitHub stars.

Transformers.jsONNX Runtime GenAIUltralyticsgpu-unlockOpenVINO

Convert with

ONNXOptimumOlive
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
28.1 GB
Weights
1.57 GB (smallest of 8 ONNX variants)
Parameters
not stated
Formats
onnx
Task
text generation
License
Apache-2.0 (permissive)
Files
24, each with a sha256
Publisher
onnx-community
Added
2026-11-15
Section
alt.freeweights.granite
Lineage

Original release from the publisher.

Base model: ibm-granite/granite-3.0-2b-instruct

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:22 UTCpassed

Model card

From the publisher at commit 866e8f6. Shown as plain text with links; images open at the publisher.

https://huggingface.co/ibm-granite/granite-3.0-2b-instruct with ONNX weights to be compatible with Transformers.js.

Usage (Transformers.js)#

If you haven't already, you can install the Transformers.js JavaScript library from NPM using:

npm i @huggingface/transformers

Example: Text generation with onnx-community/granite-3.0-2b-instruct.

import { pipeline } from "@huggingface/transformers";

// Create a text generation pipeline
const generator = await pipeline(
  "text-generation",
  "onnx-community/granite-3.0-2b-instruct",
  { dtype: "q4" },
);

// Define the list of messages
const messages = [
  { role: "system", content: "You are a helpful assistant." },
  { role: "user", content: "Tell me a joke." },
];

// Generate a response
const output = await generator(messages, { max_new_tokens: 128 });
console.log(output[0].generated_text.at(-1).content);

Example output

Why don't scientists trust atoms?

Because they make up everything!

Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Files

24 files · 28.1 GBWeights 1.57 GB (smallest of 8 ONNX variants). Sizes and sha256 from the signed manifest.
Show all 24 files with their sha256
FileSizesha256
.gitattributes1.83 KBbb6718982fa5e79d18350fea1e912c41018d6041e764aec8b5bc0b87c918bf44
README.md1.59 KB2ead1ef658ade68aa45fd9f57dfae36775c228fc8ac18ab9cb0bf5a0cb0e626f
added_tokens.json87 B081bdeaf76fc5463cc2e20fbadf17ad9eb569bb5343b120cc64b98840754f96c
config.json1.04 KBf72e2aa0deb503cf2bc82aec7ab77052b44d134dab86b96412f535d110fb94a9
generation_config.json137 Bcb482de67fcafdef681b085a24ce8004d906f8990c849be2c75b3c4a5a4f7804
merges.txt442 KB303127a244b0078878156c17229f36d11b7a3a3f8e47b7cfdbb304ff46be5030
onnx/model.onnx1.31 MBede3a6e81719dfd1fbf12cc4b222c5064f1a552151285dbae3c37e79df015491
onnx/model.onnx_data10.1 GB6aa9ea1742d533301c3f677e50cdd184b385c8628f4497df111a5ecb3e0414b1
onnx/model_bnb4.onnx1.77 GB60e34c2abedc239e6342ed2eda166dbe4c56f45e1f132dc74ba83d4db33d5e4c
onnx/model_fp16.onnx1.33 MB466c4e4433a60f08a0b1fe1a25ed97028accbf0dadf488379a5569e2b96c5593
onnx/model_fp16.onnx_data5.07 GB2bbd259cd19bdeef32a42e796e8039f71b08ace7845594f9d1ba83d07af011db
onnx/model_int8.onnx6.33 MB43d343fc00f0ec01ae7cfffa7b7eb0aa6f3e4914f6d98f4db3cd689865cd3efa
onnx/model_int8.onnx_data2.53 GB1bda69b8319cbd986ea21ebbc054bd7ef43c53931773539f03149eb384e8ea9d
onnx/model_q4.onnx1.93 GB536013af8c57377f6b426999ca91829ccf4a3dc9e18562bd77cbff29e953b200
onnx/model_q4f16.onnx1.57 GBc6bc3be1474d09924af2566d60e4b882b479843e06cdb5a35089b347ddc78646
onnx/model_quantized.onnx6.33 MBbb68bbfeef0fb246abcab79525e950228de1928907ed9e891bc457690a453e32
onnx/model_quantized.onnx_data2.53 GB1bda69b8319cbd986ea21ebbc054bd7ef43c53931773539f03149eb384e8ea9d
onnx/model_uint8.onnx6.33 MBcc3e3b96f52312f19cae9d6dbae4bb91b060bce5dcf95e066cbfe88c42b5f6fb
onnx/model_uint8.onnx_data2.53 GB3acacf018c43db23d407dccc4104b5061aa64f6d49f51bea3ba487ec94d41b29
quantize_config.json283 Be88beb3a98997ba54ba68adb41f91f3572fb0457a4d7c5cb943d3b9e78644fff
special_tokens_map.json701 B596d752bf46f5cace1f6826b52ed7d913347a4eea0ecce8ab2f869471ca40369
tokenizer.json3.48 MBed944c0b3d71e2d651a5ba0f8e7b350faff30031c8e3353de70b12b9c1bf5654
tokenizer_config.json6.26 KB4ce7709e6a73663aa0d9782967d2c53eaaae809f4b66d7cf7e578aea7218d355
vocab.json777 KB80ab859339a2525fdfbda14bc39df02dffb824aefdaf86426217bbb146d17e01
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
866e8f6898 pinned now2026-11-15 05:22 UTC24 files · 28.1 GB

Use it

$ fw get onnx-community/granite-3.0-2b-instruct
# manifest sha256 b9b98506c93a… · 28.1 GB · 24 files
$ fw verify ./granite-3.0-2b-instruct onnx-community/granite-3.0-2b-instruct
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/onnx-community/granite-3.0-2b-instruct.json --dir ./granite-3.0-2b-instruct $ python3 fw.py verify ./granite-3.0-2b-instruct ./onnx-community__granite-3.0-2b-instruct.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download onnx-community/granite-3.0-2b-instruct --revision 866e8f6898560676ec315f05143765391c2e50b7 --local-dir ./granite-3.0-2b-instruct
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
Inherited from the base model ibm-granite/granite-3.0-2b-instruct: the strictest license along the lineage applies. 2026-11-15
Text in
README.md
Text sha256
2ead1ef658ade68aa45fd9f57dfae36775c228fc8ac18ab9cb0bf5a0cb0e626f
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: onnx-community <huggingface.co/onnx-community>Newsgroups: alt.freeweights.graniteSubject: granite-3.0-2b-instructDate: 2026-11-15Commit: 866e8f6Signed: 2DC28CC7B26A283B ✓
Upstream
onnx-community/granite-3.0-2b-instruct
Pinned commit
866e8f6898560676ec315f05143765391c2e50b7
Manifest
granite-3.0-2b-instruct.json · .minisig
Manifest sha256
b9b98506c93a6a344a42291efc517f5268f921eb26d4406bc62db9af8541b376
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:22 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/onnx-community/granite-3.0-2b-instruct.json $ curl -O https://freeweights.allternit.com/manifests/onnx-community/granite-3.0-2b-instruct.json.minisig $ minisign -Vm granite-3.0-2b-instruct.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

ibm-granite/granite-3.0-2b-instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download onnx-community/granite-3.0-2b-instruct
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. granite-3.0-2b-instruct.json. Provenance. Takedown history: none.
Source
huggingface.co/onnx-community/granite-3.0-2b-instruct

Related models

All of alt.freeweights.granite →
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
From: ibm-granite <huggingface.co/ibm-granite>Subject: GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3