CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.olmo / SAGE-MM-Qwen3-VL-4B-SFT
From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject:

SAGE-MM-Qwen3-VL-4B-SFT

Date: 2026-11-15Commit: 313692aSigned: 2DC28CC7B26A283B ✓

Video text to text model with 4.4B parameters. Safetensors weights, 9.67 GB in all. Published by allenai under Apache-2.0.

4.4B params9.67GBSAGE-MM-Qwen3-VL-4B-SFTsafetensorspermissive
FactsParams4.4BSize9.67 GBFormatssafetensorsTaskvideo text to textLicenseApache-2.0From sourcepermissive
$ fw get allenai/SAGE-MM-Qwen3-VL-4B-SFT
# manifest sha256 399e41881175… · 9.67 GB · 17 files
$ fw verify ./SAGE-MM-Qwen3-VL-4B-SFT allenai/SAGE-MM-Qwen3-VL-4B-SFT
From sourceHosted (signed)allenai/SAGE-MM-Qwen3-VL-4B-SFTLast check: 2026-11-15 04:15 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Fine-tune of Qwen3-VL-4B-Instruct.

Works with

Run8Fine-tune7Convert8Scan2

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

TransformersLocalAItinygradTriton Inference ServerBentoMLCTranslate2ExLlamaV2LitServe
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
9.67 GB
Weights
9.65 GB (safetensors)
Parameters
4.4B
Formats
safetensors
Task
video text to text
License
Apache-2.0 (permissive)
Files
17, each with a sha256
Publisher
allenai
Added
2026-11-15
Section
alt.freeweights.olmo
Lineage

Original release from the publisher.

Base model: Qwen/Qwen3-VL-4B-Instruct

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:15 UTCpassed

Model card

From the publisher at commit 313692a. Shown as plain text with links; images open at the publisher.

Image: SAGE Teaser

System Capabilities#

SAGE-MM operates as the core decision-maker within the SAGE system. It functions in two distinct stages:

  1. Stage-1 (Context VLM): The model analyzes initial sampled frames and metadata to determine if the query can be answered immediately ("single-turn") or if it requires tool usage ("multi-turn").
  2. Stage-2 (Iterative Reasoner): If tools are needed, the model enters a loop where it calls tools, analyzes their output, and updates its context until a final answer is derived.
Supported Tools#

The model is trained to generate JSON-formatted actions to invoke the following tools:

  • web-search: Search the internet for external knowledge (e.g., sports standings, cast lists).
  • transcribe-speech: Perform ASR on specific timestamped segments of the video.
  • ground-event: Locate start/end timestamps for specific visual events.
  • extract-video-parts: Extract high-resolution frames or subclips from specific timestamps.
  • analyze: Perform detailed visual analysis on extracted media.

Usage#

Note: SAGE-MM outputs JSON action strings. It requires a runtime environment (provided in our GitHub repo) to parse these strings, execute the tools, and feed the observation back to the model.

License#

This model is licensed under Apache 2.0. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines.

Files

17 files · 9.67 GBWeights 9.65 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 17 files with their sha256
FileSizesha256
.gitattributes1.57 KB34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
README.md1.95 KB105b73b48fa2dfb8b1ac85a7f7280cde5870fd622adfd1d2cac5b09356d1f5cf
added_tokens.json707 Bc0284b582e14987fbd3d5a2cb2bd139084371ed9acbae488829a1c900833c680
chat_template.jinja5.29 KB3636d0f0bd6bef02654cdffdc447b79cb2cef8ab02cc75267345946291a489e4
config.json1.62 KBff3caa3adcd5a47378db41d858b93d5f7e6241216ad97756e66ee99ba3bed6f5
generation_config.json199 Ba0acd9cf47909f86b54951dbf2cfd2af3b0b36178211926760a3a27edb49378d
merges.txt1.67 MB8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5
model-00001-of-00002.safetensors4.99 GBc238f390cbc42c551ce12cf2d47c8a333ed5b52e7d3788b1ebefbf37078a4277
model-00002-of-00002.safetensors4.66 GB489a6ca1abda8f47004074eade4496ca5e3473d3d42d36e2c07c03bbf8fb66d3
model.safetensors.index.json64.8 KB7cb8b19d73f397586c8e836212f45b06879459161a3f0d964c87e75df669d70c
preprocessor_config.json782 B93585062a80db5e8ca038efc7726a3e6411d9db948472d81d63c6303993be8c5
special_tokens_map.json613 B76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
tokenizer.json11.4 MBf54b55fa0c3aba0c91ce09ea79ae4e62da24e2a1a630f96c4bae34aba25e234a
tokenizer_config.json5.45 KB81ec7bb9530159b326c0bef1d0b6c33d392090524014ea3f0123a3c1eb9c2af5
training_args.bin8.14 KB9a6a20c9d6d3296f1b2b570fe47d77b357380412ee3d348621ca433698810c1c
video_preprocessor_config.json817 B59c5c9eb52182eb14c06ffb10ca9effd29adce5f238a95de23ca14a38dbd2cb1
vocab.json2.78 MBca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
313692ad27 pinned now2026-11-15 04:15 UTC17 files · 9.67 GB

Use it

$ fw get allenai/SAGE-MM-Qwen3-VL-4B-SFT
# manifest sha256 399e41881175… · 9.67 GB · 17 files
$ fw verify ./SAGE-MM-Qwen3-VL-4B-SFT allenai/SAGE-MM-Qwen3-VL-4B-SFT
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/SAGE-MM-Qwen3-VL-4B-SFT.json --dir ./SAGE-MM-Qwen3-VL-4B-SFT $ python3 fw.py verify ./SAGE-MM-Qwen3-VL-4B-SFT ./allenai__SAGE-MM-Qwen3-VL-4B-SFT.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/SAGE-MM-Qwen3-VL-4B-SFT --revision 313692ad27f1eab7784b0e586416269209e6ca43 --local-dir ./SAGE-MM-Qwen3-VL-4B-SFT
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
105b73b48fa2dfb8b1ac85a7f7280cde5870fd622adfd1d2cac5b09356d1f5cf
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject: SAGE-MM-Qwen3-VL-4B-SFTDate: 2026-11-15Commit: 313692aSigned: 2DC28CC7B26A283B ✓
Upstream
allenai/SAGE-MM-Qwen3-VL-4B-SFT
Pinned commit
313692ad27f1eab7784b0e586416269209e6ca43
Manifest
SAGE-MM-Qwen3-VL-4B-SFT.json · .minisig
Manifest sha256
399e41881175c69855a844e769dd9d8f70ec787a094c102faf38610aa4768bd7
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:15 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/SAGE-MM-Qwen3-VL-4B-SFT.json $ curl -O https://freeweights.allternit.com/manifests/allenai/SAGE-MM-Qwen3-VL-4B-SFT.json.minisig $ minisign -Vm SAGE-MM-Qwen3-VL-4B-SFT.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

Qwen/Qwen3-VL-4B-Instruct · this model is a finetune of it

1 model in the catalog name this one as their parent.

Fine-tunes
1
Fine-tunes 1
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/SAGE-MM-Qwen3-VL-4B-SFT
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. SAGE-MM-Qwen3-VL-4B-SFT.json. Provenance. Takedown history: none.
Source
huggingface.co/allenai/SAGE-MM-Qwen3-VL-4B-SFT

Related models

All of alt.freeweights.olmo →
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF