CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.llama / Bunny-Llama-3-8B-V-gguf
From: BAAI <huggingface.co/BAAI>Newsgroups: alt.freeweights.llamaSubject:

Bunny-Llama-3-8B-V-gguf

Date: 2026-11-15Commit: 6110f41Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 21.9 GB in all. Published by BAAI under Apache-2.0.

llama21.9GBBunny-Llama-3-8B-V-ggufggufpermissive
FactsParamsnot statedSize21.9 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get BAAI/Bunny-Llama-3-8B-V-gguf
# manifest sha256 e8de9f2f15a3… · 21.9 GB · 11 files
$ fw verify ./Bunny-Llama-3-8B-V-gguf BAAI/Bunny-Llama-3-8B-V-gguf
From sourceHosted (signed)BAAI/Bunny-Llama-3-8B-V-ggufLast check: 2026-11-15 04:16 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
21.9 GB
Weights
4.92 GB (smallest of 2 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
11, each with a sha256
Publisher
BAAI
Added
2026-11-15
Section
alt.freeweights.llama
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:16 UTCpassed

Model card

From the publisher at commit 6110f41. Shown as plain text with links; images open at the publisher.

Model Card#

Image: Logo

📖 Technical report | 🏠 Code | 🐰 Demo

This is GGUF format of Bunny-Llama-3-8B-V.

Bunny is a family of lightweight but powerful multimodal models. It offers multiple plug-and-play vision encoders, like EVA-CLIP, SigLIP and language backbones, including Llama-3-8B, Phi-1.5, StableLM-2, Qwen1.5, MiniCPM and Phi-2. To compensate for the decrease in model size, we construct more informative training data by curated selection from a broader data source.

We provide Bunny-Llama-3-8B-V, which is built upon SigLIP and Llama-3-8B-Instruct. More details about this model can be found in GitHub.

Image: comparison

Quickstart#

Chat by llama.cpp#

# sample images can be found in images folder

# fp16
./llava-cli -m ggml-model-f16.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -e \
    -p "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: <image>\nWhy is the image funny? ASSISTANT:" \
    --temp 0.0

# int4
./llava-cli -m ggml-model-Q4_K_M.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -e \
    -p "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: <image>\nWhy is the image funny? ASSISTANT:" \
    --temp 0.0

Chat by ollama#

# sample images can be found in images folder

# fp16
ollama create Bunny-Llama-3-8B-V-fp16 -f ./ollama-f16
ollama run Bunny-Llama-3-8B-V-fp16 'example_2.png
Why is the image funny?'

# int4
ollama create Bunny-Llama-3-8B-V-int4 -f ./ollama-Q4_K_M
ollama run Bunny-Llama-3-8B-V-int4 'example_2.png
Why is the image funny?'

Files

11 files · 21.9 GBWeights 4.92 GB (smallest of 2 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 11 files with their sha256
FileSizesha256
.gitattributes1.56 KBe08cf896faa882fdfbf869edf3ac5e9cfaa850c0ff3b79cf4a29e394bbe2572a
README.md2.28 KBefe4d1ae35531279b3656386eb9fdee5073691a3f431685d9e7c94f1d9042849
comparison.png749 KB55740c123887f43f98d52f29de3b31e45699251e1590c98facae30cf3ff6ef4d
ggml-model-Q4_K_M.gguf4.92 GB88f0a61f947dbf129943328be7262ae82e3a582a0c75e53544b07f70355a7c30
ggml-model-f16.gguf16.1 GBe9ff2d9f6e36a2c117fce8311d97e50db6abc11fcac591c08203db11cba0df0b
icon.png812 KB3e291453e6d163cd244bbffa176aa07a13ee38a260d0a004d5e153b119cd18bb
images/example_1.png245 KB58c5c9898c5359bcf53797711e3d954c8ef529e141cb012ffc433376933839e7
images/example_2.png74.6 KBd25e79a65b225aedffdc864cfa037f2384d146e4e87a101af25ebe930660eee1
mmproj-model-f16.gguf878 MB96d033387a91e56cf97fa5d60e02c0128ce07c8fa83aaaefb74ec40541615ea5
ollama-Q4_K_M330 Bb5f8e8bd8ea658185bbdb803f62c6d8e4a9cedd0696d6cfb9debb5245ddaf779
ollama-f16328 Ba95f68c791e54f5b4e66eac162063a686d45a8510f1db4316b9c2b42811f3dc7
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
6110f41154 pinned now2026-11-15 04:16 UTC11 files · 21.9 GB

Use it

$ fw get BAAI/Bunny-Llama-3-8B-V-gguf
# manifest sha256 e8de9f2f15a3… · 21.9 GB · 11 files
$ fw verify ./Bunny-Llama-3-8B-V-gguf BAAI/Bunny-Llama-3-8B-V-gguf
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/BAAI/Bunny-Llama-3-8B-V-gguf.json --dir ./Bunny-Llama-3-8B-V-gguf $ python3 fw.py verify ./Bunny-Llama-3-8B-V-gguf ./BAAI__Bunny-Llama-3-8B-V-gguf.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download BAAI/Bunny-Llama-3-8B-V-gguf --revision 6110f411544f61008d51b188968755a560d996da --local-dir ./Bunny-Llama-3-8B-V-gguf
llama.cppDownload one GGUF variant (ggml-model-Q4_K_M, 4.92 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download BAAI/Bunny-Llama-3-8B-V-gguf --include "ggml-model-Q4_K_M*" --local-dir ./Bunny-Llama-3-8B-V-gguf $ llama-server -m ./Bunny-Llama-3-8B-V-gguf/ggml-model-Q4_K_M.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Bunny-Llama-3-8B-V-gguf/ggml-model-Q4_K_M.gguf\n' > Modelfile $ ollama create bunny-llama-3-8b-v-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
efe4d1ae35531279b3656386eb9fdee5073691a3f431685d9e7c94f1d9042849
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: BAAI <huggingface.co/BAAI>Newsgroups: alt.freeweights.llamaSubject: Bunny-Llama-3-8B-V-ggufDate: 2026-11-15Commit: 6110f41Signed: 2DC28CC7B26A283B ✓
Upstream
BAAI/Bunny-Llama-3-8B-V-gguf
Pinned commit
6110f411544f61008d51b188968755a560d996da
Manifest
Bunny-Llama-3-8B-V-gguf.json · .minisig
Manifest sha256
e8de9f2f15a34ccbdf10be3deb20d23ce68fa8ce532ff3f4f7f0fa4364ba0cfe
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:16 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/BAAI/Bunny-Llama-3-8B-V-gguf.json $ curl -O https://freeweights.allternit.com/manifests/BAAI/Bunny-Llama-3-8B-V-gguf.json.minisig $ minisign -Vm Bunny-Llama-3-8B-V-gguf.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download BAAI/Bunny-Llama-3-8B-V-gguf
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Bunny-Llama-3-8B-V-gguf.json. Provenance. Takedown history: none.
Source
huggingface.co/BAAI/Bunny-Llama-3-8B-V-gguf

Related models

All of alt.freeweights.llama →
From: BAAI <huggingface.co/BAAI>Subject: Bunny-Llama-3-8B-V
From: BAAI <huggingface.co/BAAI>Subject: Bunny-v1_1-Llama-3-8B-V
From: unsloth <huggingface.co/unsloth>Subject: codellama-7b
From: unsloth <huggingface.co/unsloth>Subject: codellama-7b-bnb-4bit
From: BAAI <huggingface.co/BAAI>Subject: Infinity-Instruct-3M-0613-Llama3-70B
From: BAAI <huggingface.co/BAAI>Subject: Infinity-Instruct-3M-0625-Llama3-70B