CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.minicpm / MiniCPM-o-2_6-int4
From: openbmb <huggingface.co/openbmb>Newsgroups: alt.freeweights.minicpmSubject:

MiniCPM-o-2_6-int4

Date: 2026-11-15Commit: 0dac4baSigned: 2DC28CC7B26A283B ✓

Any to any model with 8.7B parameters. Safetensors weights, 7.65 GB in all. Published by openbmb under Apache-2.0.

8.7B params7.65GBMiniCPM-o-2_6-int4safetensorspermissive
FactsParams8.7BSize7.65 GBFormatssafetensorsTaskany to anyLicenseApache-2.0From sourcepermissive
$ fw get openbmb/MiniCPM-o-2_6-int4
# manifest sha256 2046c1cd4be8… · 7.65 GB · 30 files
$ fw verify ./MiniCPM-o-2_6-int4 openbmb/MiniCPM-o-2_6-int4
From sourceHosted (signed)openbmb/MiniCPM-o-2_6-int4Last check: 2026-11-15 05:17 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of MiniCPM-o-2_6.

Works with

Run8Fine-tune7Convert8Scan2

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

TransformersLocalAItinygradTriton Inference ServerBentoMLCTranslate2ExLlamaV2LitServe
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
7.65 GB
Weights
7.57 GB (safetensors)
Parameters
8.7B
Formats
safetensors
Task
any to any
License
Apache-2.0 (permissive)
Files
30, each with a sha256
Publisher
openbmb
Added
2026-11-15
Section
alt.freeweights.minicpm
Lineage

Original release from the publisher.

Base model: openbmb/MiniCPM-o-2_6

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:17 UTCpassed

Model card

From the publisher at commit 0dac4ba. Shown as plain text with links; images open at the publisher.

A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone#

GitHub | MiniCPM Wiki(Chinese) | Online Demo | Technical Blog | Join Us

MiniCPM-o 2.6 int4#

This is the int4 quantized version of MiniCPM-o 2.6. Running with int4 version would use lower GPU memory (about 9GB).

Prepare code and install AutoGPTQ#

We are submitting PR to officially support minicpm-o 2.6 inference

git clone https://github.com/RanchiZhao/AutoGPTQ.git && cd AutoGPTQ
git checkout minicpmo

# install AutoGPTQ
pip install -vvv --no-build-isolation -e .
Usage of MiniCPM-o-2_6-int4#

Change the model initialization part to AutoGPTQForCausalLM.from_quantized

import torch
from transformers import AutoModel, AutoTokenizer
from auto_gptq import AutoGPTQForCausalLM

model = AutoGPTQForCausalLM.from_quantized(
    'openbmb/MiniCPM-o-2_6-int4',
    torch_dtype=torch.bfloat16,
    device="cuda:0",
    trust_remote_code=True,
    disable_exllama=True,
    disable_exllamav2=True
)
tokenizer = AutoTokenizer.from_pretrained(
    'openbmb/MiniCPM-o-2_6-int4',
    trust_remote_code=True
)

model.init_tts()

Usage reference MiniCPM-o-2_6#usage

Files

30 files · 7.65 GBWeights 7.57 GB (safetensors). Sizes and sha256 from the signed manifest.
Show all 30 files with their sha256
FileSizesha256
.gitattributes1.63 KB84afb4e3d31b86fd61541bb54ecd3ea4ba95ad4ae857573d81ddea988bf8028e
README.md2.10 KBc52e6c5ed188d687c9b57ae35023495f123e949e9717b7816444a83a36947ccf
added_tokens.json1.41 KBb58f7cc542e5c53df171a9e85bbaafa2f6f371e8e3ce617ac7e4b1e029eb660d
assets/Skiing.mp48.53 MB479ace116d6ac92487ad90f415b3ef817cd019bba4521043ef0d5faaa1a8415d
assets/Vocos.pt54.4 MB09a670eda1c08b740013679c7a90ebb7f1a97646ea7673069a6838e6b51d6c58
assets/audio_understanding.mp3321 KBd5f8f39d78ea82fba5a95250f6558b767cbd34f13f1716112e23b94646fe316c
assets/chattts_tokenizer/special_tokens_map.json7.85 KBbd0ac9d9bb1657996b5c5fbcaa7d80f8de530d01a283da97f89deae5b1b8d011
assets/chattts_tokenizer/tokenizer.json449 KB843838a64e121e23e774cc75874c6fe862198d9f7dd43747914633a8fd89c20e
assets/chattts_tokenizer/tokenizer_config.json11.0 KB43e9d658b554fa5ee8d8e1d763349323bfef1ed7a89c0794220ab8861387d421
assets/demo.wav1.45 MBd0b347d8ed0b2314c0d175fbdac79f6f3f91a6402bd7492ac5c860646a2ba309
assets/mimick.wav384 KBdbb0860cb4dd7c7003b6f0406299fc7c0febc5c6a990e1c670d29b763e84e7ed
assets/qa.wav115 KBccb54b52f2329018e2c862715f98c4e964d0b3b67e497a79195eb01476e7d795
config.json3.79 KB6b126bd590987009358195a6c9658b8876099b6f3c214cb5fd0e8379584443d6
configuration_minicpm.py7.55 KBb6fe4224dabce0389aaa6ecf9c05849a81935b7a56a8585e581aac11262e70cd
gitattributes1.68 KB341cd7102b90d5c7c1d1e5dc4028f680036b7b1a2dde0547d6001bdd3e4ec307
image_processing_minicpmv.py16.7 KBbe645337bd25811ae1f86e3aaa21fa5b555719870f5612004b4a67357148fe1f
merges.txt1.67 MB8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5
model.safetensors7.57 GB5fa6377ca7a817502eecd7bfa9f4342d61ea47263236acbe4f236e94362eba84
modeling_minicpmo.py140 KB706c968bc8f8d43652c555c7088b3869a35b4f973491227ed1481a5896160783
modeling_navit_siglip.py42.1 KBf0a3e2fb52824ae06e30973c9e92abfdb441d0585674fa0cfc779bca4820c223
preprocessor_config.json714 B2d9b0069b9bc2804df682fb29c12a2c193cfdf4fd87966e5364ba6e4d38de20c
processing_minicpmo.py20.0 KB1c580f748216ca55b4d72182267e0687a494fe6e61415e6f827c9a139c9a4522
quantize_config.json286 B1bdbb8fa55c914d5f7ff01c6059808b3967707c1805655c8e6128739a73bc63f
resampler.py35.6 KB998c180518dbf8249659bf253cf885e95e7c5289a8b497f651c2a5ef69d47942
special_tokens_map.json5.35 KB0526a61b2569cb82e44fc2220a9781865e2bdcdc7ba186071a0a809d5514c4c9
tokenization_minicpmo_fast.py3.04 KB6b9393bab49d4843fbf7ffdced7d58ebbfc5269c3876721a4e9f6090021d990b
tokenizer.json7.04 MBe035c20fe6e2600ac2e92c828b859062e68d09d2ba93d83c8b851772fd978666
tokenizer_config.json14.1 KB8816dde110010310ceeaa1412a1f532744cd96efd3e97d473dd031861aa98dd5
utils.py7.24 KBb94f26ab37e99541a461eacf6009d8ddca70dfe446b8ed6b48db698b7564b27b
vocab.json2.78 MBca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
0dac4ba024 pinned now2026-11-15 05:17 UTC30 files · 7.65 GB

Use it

$ fw get openbmb/MiniCPM-o-2_6-int4
# manifest sha256 2046c1cd4be8… · 7.65 GB · 30 files
$ fw verify ./MiniCPM-o-2_6-int4 openbmb/MiniCPM-o-2_6-int4
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/openbmb/MiniCPM-o-2_6-int4.json --dir ./MiniCPM-o-2_6-int4 $ python3 fw.py verify ./MiniCPM-o-2_6-int4 ./openbmb__MiniCPM-o-2_6-int4.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download openbmb/MiniCPM-o-2_6-int4 --revision 0dac4ba024fef378b225a964d15a5a62d3394c47 --local-dir ./MiniCPM-o-2_6-int4
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
c52e6c5ed188d687c9b57ae35023495f123e949e9717b7816444a83a36947ccf
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: openbmb <huggingface.co/openbmb>Newsgroups: alt.freeweights.minicpmSubject: MiniCPM-o-2_6-int4Date: 2026-11-15Commit: 0dac4baSigned: 2DC28CC7B26A283B ✓
Upstream
openbmb/MiniCPM-o-2_6-int4
Pinned commit
0dac4ba024fef378b225a964d15a5a62d3394c47
Manifest
MiniCPM-o-2_6-int4.json · .minisig
Manifest sha256
2046c1cd4be859f069787564159312856a30784e10794e29f9fdb95ac265909c
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:17 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/openbmb/MiniCPM-o-2_6-int4.json $ curl -O https://freeweights.allternit.com/manifests/openbmb/MiniCPM-o-2_6-int4.json.minisig $ minisign -Vm MiniCPM-o-2_6-int4.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

openbmb/MiniCPM-o-2_6 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download openbmb/MiniCPM-o-2_6-int4
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. MiniCPM-o-2_6-int4.json. Provenance. Takedown history: none.
Source
huggingface.co/openbmb/MiniCPM-o-2_6-int4

Related models

All of alt.freeweights.minicpm →
From: openbmb <huggingface.co/openbmb>Subject: AgentCPM-Explore-GGUF
From: openbmb <huggingface.co/openbmb>Subject: AgentCPM-Report
From: openbmb <huggingface.co/openbmb>Subject: AgentCPM-Report-GGUF
From: openbmb <huggingface.co/openbmb>Subject: BitCPM-CANN-0.5B-gguf
From: openbmb <huggingface.co/openbmb>Subject: BitCPM-CANN-1B-gguf
From: openbmb <huggingface.co/openbmb>Subject: BitCPM-CANN-3B-gguf