alt.freeweights.qwen / olmOCR-7B-0825-FP8

From:

allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.qwenSubject:

olmOCR-7B-0825-FP8

Date: 2026-11-15Commit: 7721778Signed: 2DC28CC7B26A283B ✓

Image text to text model with 8.3B parameters. Safetensors weights, 10.1 GB in all. Published by allenai under Apache-2.0.

8.3B params

10.1GBolmOCR-7B-0825-FP8safetensorspermissive

FactsParams8.3BSize10.1 GBFormatssafetensorsTaskimage text to textLicenseApache-2.0From sourcepermissive

$ fw get allenai/olmOCR-7B-0825-FP8
# manifest sha256 1b6bbf190308… · 10.1 GB · 18 files
$ fw verify ./olmOCR-7B-0825-FP8 allenai/olmOCR-7B-0825-FP8

From sourceHosted (signed)allenai/olmOCR-7B-0825-FP8Last check: 2026-11-15 04:36 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Qwen2.5-VL-7B-Instruct.

Works with

Run23 Fine-tune29 Convert15 Evaluate13 Scan13 Apps62

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

vLLM exo Text Generation WebUI

SGLang MLC LLM KTransformers LMCache Xinference LMDeploy mistral.rs Mooncake FlashInfer

Show all 23

AIBrix fastllm ExLlamaV3

Transformers LocalAI tinygrad Triton Inference Server BentoML CTranslate2 ExLlamaV2 LitServe

Convert with

mergekit TensorRT Model Optimizer

LLM Compressor Neural Compressor AutoRound AQLM GPTQModel ONNX Core ML Tools ExecuTorch

Show all 15

Evaluate with

Opik DeepEval Ragas lm-evaluation-harness OpenCompass SWE-bench

simple-evals TruLens HELM

LightEval

Evaluate Weave

Show all 13

Autoevals

Scan with

promptfoo garak Guardrails NeMo Guardrails Giskard DeepTeam AI Fairness 360 Fairlearn Detoxify MCP Scanner AgentDojo ModelScan

Show all 13

picklescan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 10.1 GB
Weights: 10.1 GB (safetensors)
Parameters: 8.3B
Formats: safetensors
Task: image text to text
License: Apache-2.0 (permissive)
Files: 18, each with a sha256
Publisher: allenai
Added: 2026-11-15
Section: alt.freeweights.qwen

Lineage

Original release from the publisher.

Base model: Qwen/Qwen2.5-VL-7B-Instruct

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 04:36 UTC	passed

Model card

From the publisher at commit 7721778. Shown as plain text with links; images open at the publisher.

Image: olmOCR Logo

olmOCR-7B-0825-FP8#

Quantized to FP8 Version of olmOCR-7B-0825, using llmcompressor.

This is a release of the olmOCR model that's fine tuned from Qwen2.5-VL-7B-Instruct using the olmOCR-mix-0225 dataset.

Quick links:

📃 Paper
🤗 Dataset
🛠️ Code
🎮 Demo

The best way to use this model is via the olmOCR toolkit. The toolkit comes with an efficient inference setup via sglang that can handle millions of documents at scale.

Usage#

This model expects as input a single document image, rendered such that the longest dimension is 1288 pixels.

The prompt must then contain the additional metadata from the document, and the easiest way to generate this is to use the methods provided by the olmOCR toolkit.

License and use#

olmOCR is licensed under the Apache 2.0 license. olmOCR is intended for research and educational use. For more information, please see our Responsible Use Guidelines.

Files

18 files · 10.1 GBWeights 10.1 GB (safetensors). Sizes and sha256 from the signed manifest.

Hide all 18 files with their sha256

File	Size	sha256
.gitattributes	1.57 KB	34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
README.md	1.70 KB	0dbd87844d926cbf76b5f579249406d77465c0a5b49783c4c006935f4d97c27f
added_tokens.json	605 B	58b54bbe36fc752f79a24a271ef66a0a0830054b4dfad94bde757d851968060b
chat_template.jinja	1.02 KB	a0bc6f6fc7a29a80017a433e8f03a1cc1236e838a944a2d034295a60c4f2fddb
chat_template.json	1.05 KB	ad60d90252ed0b0705ba14e2d0ad0fec0beac1ea955642b54059b36052d8bc96
config.json	10.6 KB	2fd4680356d3563a5e0e29cda05d3242dddd34a2b514130ad63109e28bdf680e
generation_config.json	260 B	549bd3dd57183a0aab12c3cb40dd25644fb0f600e379541a1bfeaa745a703bec
merges.txt	1.67 MB	8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5
model-00001-of-00003.safetensors	4.94 GB	81133037de0566849a803b3893a1cfaf432e18e3d301554c38f235b0cfded432
model-00002-of-00003.safetensors	4.03 GB	d7357ad46726dd786dacd18e1863fb3a443db9ed891a29e26ab2f5b818604dcc
model-00003-of-00003.safetensors	1.09 GB	c35046872d25a2d065d1fb4061f77039f42e9bb221d51d85aedc545fecb92009
model.safetensors.index.json	74.7 KB	6a24709aed665925a729983436f76295cbd4c7f4c89a5b507389389d45fb76c9
preprocessor_config.json	350 B	f2058c716eef96ccaed1cc1e2d0c08306b62586d535b28d9d08e691b2fab7ca0
recipe.yaml	164 B	fbee2c4f579e19ef68f8932819075e3116f58e794c75ce0842f79002de3a6133
special_tokens_map.json	613 B	76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
tokenizer.json	11.4 MB	9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
tokenizer_config.json	4.69 KB	0a04a9d7d4a62b28482bdfe726c122756de85714fb64166ace92ae75b8f57614
vocab.json	2.78 MB	ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
772177833f pinned now	2026-11-15 04:36 UTC	18 files · 10.1 GB

Use it

$ fw get allenai/olmOCR-7B-0825-FP8
# manifest sha256 1b6bbf190308… · 10.1 GB · 18 files
$ fw verify ./olmOCR-7B-0825-FP8 allenai/olmOCR-7B-0825-FP8

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/olmOCR-7B-0825-FP8.json --dir ./olmOCR-7B-0825-FP8
$ python3 fw.py verify ./olmOCR-7B-0825-FP8 ./allenai__olmOCR-7B-0825-FP8.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/olmOCR-7B-0825-FP8 --revision 772177833fc165927c3c5350553847b69e0346a4 --local-dir ./olmOCR-7B-0825-FP8

transformersLoad the weights in Python.

import os
os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com"
from transformers import AutoModelForImageTextToText, AutoProcessor
processor = AutoProcessor.from_pretrained("allenai/olmOCR-7B-0825-FP8", revision="772177833fc165927c3c5350553847b69e0346a4")
model = AutoModelForImageTextToText.from_pretrained("allenai/olmOCR-7B-0825-FP8", revision="772177833fc165927c3c5350553847b69e0346a4", device_map="auto")

vLLMServe an OpenAI-compatible API.

$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve allenai/olmOCR-7B-0825-FP8 --revision 772177833fc165927c3c5350553847b69e0346a4

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: 0dbd87844d926cbf76b5f579249406d77465c0a5b49783c4c006935f4d97c27f
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From:

allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.qwenSubject: olmOCR-7B-0825-FP8Date: 2026-11-15Commit: 7721778Signed: 2DC28CC7B26A283B ✓

Upstream: allenai/olmOCR-7B-0825-FP8
Pinned commit: 772177833fc165927c3c5350553847b69e0346a4
Manifest: olmOCR-7B-0825-FP8.json · .minisig
Manifest sha256: 1b6bbf19030849ec54eb09755671c2e986b42ec6a133ef6f893c77759845033e
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 04:36 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/olmOCR-7B-0825-FP8.json
$ curl -O https://freeweights.allternit.com/manifests/allenai/olmOCR-7B-0825-FP8.json.minisig
$ minisign -Vm olmOCR-7B-0825-FP8.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

Qwen/Qwen2.5-VL-7B-Instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/olmOCR-7B-0825-FP8

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. olmOCR-7B-0825-FP8.json. Provenance. Takedown history: none.

Source

huggingface.co/allenai/olmOCR-7B-0825-FP8

Related models

All of alt.freeweights.qwen →

From:

BAAI <huggingface.co/BAAI>Subject: Aquila-VL-2B-llava-qwen

From: Perciqa <huggingface.co/Perciqa>Subject: Aurora-Code-1

From:

BAAI <huggingface.co/BAAI>Subject: bge-reasoner-embed-qwen3-8b-0923

From: amazon <huggingface.co/amazon>Subject: BMOJOF-primed-HQwen3-8B-Instruct

From: nbeerbower <huggingface.co/nbeerbower>Subject: Bubba-Qwen3.6-27B-LoRA

From: bartowski <huggingface.co/bartowski>Subject: bytkim_Qwen3.8-27B-pi-GGUF

olmOCR-7B-0825-FP8

Works with

Runs with

Fine-tune with

Convert with

Evaluate with

Scan with

Works with

Overview

Model card

olmOCR-7B-0825-FP8#

Usage#

License and use#

Files

Use it

License

Provenance

How to verify

Model tree

Related models