CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.text / Bonsai-8B-unpacked
From: prism-ml <huggingface.co/prism-ml>Newsgroups: alt.freeweights.textSubject:

Bonsai-8B-unpacked

Date: 2026-11-15Commit: 376f381Signed: 2DC28CC7B26A283B ✓

Model with 8.2B parameters. Safetensors weights, 16.4 GB in all. Published by prism-ml under Apache-2.0.

8.2B params16.4GBBonsai-8B-unpackedsafetensorspermissive
FactsParams8.2BSize16.4 GBFormatssafetensorsTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get prism-ml/Bonsai-8B-unpacked
# manifest sha256 8fa892bfefbd… · 16.4 GB · 18 files
$ fw verify ./Bonsai-8B-unpacked prism-ml/Bonsai-8B-unpacked
From sourceHosted (signed)prism-ml/Bonsai-8B-unpackedLast check: 2026-11-15 02:39 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run8Fine-tune7Convert8Scan2

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

TransformersLocalAItinygradTriton Inference ServerBentoMLCTranslate2ExLlamaV2LitServe
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
16.4 GB
Weights
16.4 GB (safetensors)
Parameters
8.2B
Formats
safetensors
Task
not tagged
License
Apache-2.0 (permissive)
Files
18, each with a sha256
Publisher
prism-ml
Added
2026-11-15
Section
alt.freeweights.text
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 02:39 UTCpassed

Model card

From the publisher at commit 376f381. Shown as plain text with links; images open at the publisher.

Bonsai-8B — Unpacked FP16 Safetensors#

FP16 safetensors (HuggingFace format) of the 1-bit Bonsai-8B model. This repo exists for users who want to run Bonsai with stock HuggingFace tooling or frameworks that don't yet support 1-bit weights natively. The 1-bit kernels are currently in our forks of MLX and llama.cpp — once they land upstream, this unpacked version will no longer be needed.

We strongly recommend using the native 1-bit models instead. The 1-bit format is where all the benefits of Bonsai come from — up to 14x memory reduction, 6x faster inference, and 5x lower energy per token. This unpacked FP16 version is full-size and does not provide any of those advantages.

For the optimized 1-bit release models (recommended):

Files

18 files · 16.4 GBWeights 16.4 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 18 files with their sha256
FileSizesha256
.gitattributes1.57 KB34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
LICENSE10.2 KB69849221bfb90053de2134ef5e6d540287b4b98062326492f1f96f5da685524b
NOTICE.txt412 B7334e66ce48a4ee267ee936c7d2a4f16bd865c766c60ba56b9e04526fae33e0b
README.md1.13 KB688f37748408b92ae2ebc9f8b85bb440efe8426feaaad02a06f865cc1026bfad
added_tokens.json707 Bc0284b582e14987fbd3d5a2cb2bd139084371ed9acbae488829a1c900833c680
chat_template.jinja4.06 KB30a75d10e60b57e2f260420163dd59720dacf9f63b9a8de070d65dd80a7b30f7
config.json3.06 KBa78641619bed9a35ea647c2323d1be6df537b8250adcd0a19a90566270ff2636
generation_config.json313 Bac5fa673967419cfbe771573f2b84ada1c5569c09f737713985037f6993e118c
merges.txt1.67 MB8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5
model-00001-of-00004.safetensors4.93 GB3c8d9e4e660396f64a194c57aaa6942101d302d86d05f7ec0fa58dd20a2cedeb
model-00002-of-00004.safetensors4.93 GB8b97d9973407bc0bce5964f94440d743c795c8d81cfbb1fee06bdd86e3335874
model-00003-of-00004.safetensors4.03 GB13549d6dd8f6aecd5eece34997fbced1c9d912741cecb928fbefed216603447b
model-00004-of-00004.safetensors2.48 GB375e3a690016678b6c524d77a94556962e042ccafb16fdce93576cafac6481b6
model.safetensors.index.json31.3 KBe6f563f9563be969c29371eeac817abc3adf763e1868c015c83ae4fce5fb84ab
special_tokens_map.json613 B76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
tokenizer.json11.4 MBaeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4
tokenizer_config.json5.40 KB443bfa629eb16387a12edbf92a76f6a6f10b2af3b53d87ba1550adfcf45f7fa0
vocab.json2.78 MBca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
376f381570 pinned now2026-11-15 02:39 UTC18 files · 16.4 GB

Use it

$ fw get prism-ml/Bonsai-8B-unpacked
# manifest sha256 8fa892bfefbd… · 16.4 GB · 18 files
$ fw verify ./Bonsai-8B-unpacked prism-ml/Bonsai-8B-unpacked
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/prism-ml/Bonsai-8B-unpacked.json --dir ./Bonsai-8B-unpacked $ python3 fw.py verify ./Bonsai-8B-unpacked ./prism-ml__Bonsai-8B-unpacked.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download prism-ml/Bonsai-8B-unpacked --revision 376f381570d6115bc03f82adcfa4af0c7672ae54 --local-dir ./Bonsai-8B-unpacked
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
LICENSE
Text sha256
69849221bfb90053de2134ef5e6d540287b4b98062326492f1f96f5da685524b
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: prism-ml <huggingface.co/prism-ml>Newsgroups: alt.freeweights.textSubject: Bonsai-8B-unpackedDate: 2026-11-15Commit: 376f381Signed: 2DC28CC7B26A283B ✓
Upstream
prism-ml/Bonsai-8B-unpacked
Pinned commit
376f381570d6115bc03f82adcfa4af0c7672ae54
Manifest
Bonsai-8B-unpacked.json · .minisig
Manifest sha256
8fa892bfefbd7072366e591d1ecbaabe96ae0278d7e31989edfa2dac11da020c
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 02:39 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/prism-ml/Bonsai-8B-unpacked.json $ curl -O https://freeweights.allternit.com/manifests/prism-ml/Bonsai-8B-unpacked.json.minisig $ minisign -Vm Bonsai-8B-unpacked.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

2 models in the catalog name this one as their parent.

Quantizations
2
Quantizations 2
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download prism-ml/Bonsai-8B-unpacked
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Bonsai-8B-unpacked.json. Provenance. Takedown history: none.
Source
huggingface.co/prism-ml/Bonsai-8B-unpacked

Variants

2 quantized or adapter builds of Bonsai-8B-unpacked. Each has its own license check and page.

SubjectSizeParamsLicenseDate
prism-ml_Bonsai-8B-unpacked-GGUFHosted (signed) From: bartowski in alt.freeweights.text133 GB—Permissive2026-11-15Bonsai-8B-ONNXHosted (signed) From: onnx-community in alt.freeweights.text75.8 GB—Permissive2026-11-15

Related models

All of alt.freeweights.text →
From: laion <huggingface.co/laion>Subject: a2-rl-e2egit_large-50-32B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_mix_h2_language_proportional-65-8B