CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.olmo / OLMo-2-1124-13B-Instruct-GGUF
From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject:

OLMo-2-1124-13B-Instruct-GGUF

Date: 2026-11-15Commit: 02bfa6dSigned: 2DC28CC7B26A283B ✓

Model. Gguf weights, 132 GB in all. Published by allenai under Apache-2.0.

olmo132GBOLMo-2-1124-13B-Instruct-GGUFggufpermissive
FactsParamsnot statedSize132 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get allenai/OLMo-2-1124-13B-Instruct-GGUF
# manifest sha256 e6aafe3f740f… · 132 GB · 15 files
$ fw verify ./OLMo-2-1124-13B-Instruct-GGUF allenai/OLMo-2-1124-13B-Instruct-GGUF
From sourceHosted (signed)allenai/OLMo-2-1124-13B-Instruct-GGUFLast check: 2026-11-15 05:14 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of OLMo-2-1124-13B-Instruct.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
132 GB
Weights
5.26 GB (smallest of 13 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
15, each with a sha256
Publisher
allenai
Added
2026-11-15
Section
alt.freeweights.olmo
Lineage

Original release from the publisher.

Base model: allenai/OLMo-2-1124-13B-Instruct

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:14 UTCpassed

Model card

From the publisher at commit 02bfa6d. Shown as plain text with links; images open at the publisher.

GGUF version of https://huggingface.co/allenai/OLMo-2-1124-13B-Instruct

Files

15 files · 132 GBWeights 5.26 GB (smallest of 13 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 15 files with their sha256
FileSizesha256
.gitattributes2.46 KBcc20e9759494db1519d80e96255db74c6c98ccb9c67621f3d4287cd9e842701e
README.md147 B540eb39fcbaef1b436a99a30c72b5b185f8baf0fcc53650dc0e5926e62c90eac
olmo-2-1124-13B-instruct-F16.gguf27.4 GB8b4d03a3d6c76e3565d6bfe86415a3593c2dd39c3a01c281a8d96772230e7e85
olmo-2-1124-13B-instruct-Q2_K.gguf5.26 GB26f861eed0eb4812bb3b20a0b2a4c1a89f05655ad9e554856ff8b40b41bd4c6f
olmo-2-1124-13B-instruct-Q3_K_L.gguf7.37 GB2e11def15146485844e4c7519ed8d9bea75b278bd8d4e38235e73aef992809c6
olmo-2-1124-13B-instruct-Q3_K_M.gguf6.78 GB74055c44bce85a99111e6444e8f34267e3a0926616535bfe59c1363c233faaa4
olmo-2-1124-13B-instruct-Q3_K_S.gguf6.10 GB66c464d5a70349dc7f2e724080a30f6e027a5f708ca16ec08c4e7c5fec9577ec
olmo-2-1124-13B-instruct-Q4_0.gguf7.85 GBcb2225fdac4d436f6dcf2c5473d0468994491635fe889eb7c556dec92c959d75
olmo-2-1124-13B-instruct-Q4_K_M.gguf8.35 GBa74b6af24a669ce89c41e3b5348e6b72b7d0fe7fa6a53a31c1f65ba71c377f29
olmo-2-1124-13B-instruct-Q4_K_S.gguf7.91 GB2d2cf5174b7cd424a6c7c00adafe8ada568db0a318992083bd96cb8a1f6a566b
olmo-2-1124-13B-instruct-Q5_0.gguf9.50 GBc09fcbc13c00b492991df04fefda1961ad4146e88b31d5f7590bb3b22a4a229b
olmo-2-1124-13B-instruct-Q5_K_M.gguf9.76 GBb6f5a1f7ac2484ac4b2ee47ddb689d94d9738bdebac6a2e26461028ffa72ea06
olmo-2-1124-13B-instruct-Q5_K_S.gguf9.50 GBc652eb5311da7920c9a79c06139e5db462aa857c2ba553668dd49e9786604beb
olmo-2-1124-13B-instruct-Q6_K.gguf11.3 GB7bd93b4a3537f7b414ab8d80def6d4a3fd63dab43dba7e7706067833a33ff7a1
olmo-2-1124-13B-instruct-Q8_0.gguf14.6 GB125bfb27fdd8f946878599ee92b150efd7ba072e6d5d6662e404f3827a73158d
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
02bfa6da69 pinned now2026-11-15 05:14 UTC15 files · 132 GB

Use it

$ fw get allenai/OLMo-2-1124-13B-Instruct-GGUF
# manifest sha256 e6aafe3f740f… · 132 GB · 15 files
$ fw verify ./OLMo-2-1124-13B-Instruct-GGUF allenai/OLMo-2-1124-13B-Instruct-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/OLMo-2-1124-13B-Instruct-GGUF.json --dir ./OLMo-2-1124-13B-Instruct-GGUF $ python3 fw.py verify ./OLMo-2-1124-13B-Instruct-GGUF ./allenai__OLMo-2-1124-13B-Instruct-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMo-2-1124-13B-Instruct-GGUF --revision 02bfa6da698648c2472c57727cd0098049fe3ec8 --local-dir ./OLMo-2-1124-13B-Instruct-GGUF
llama.cppDownload one GGUF variant (olmo-2-1124-13B-instruct-Q2_K, 5.26 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMo-2-1124-13B-Instruct-GGUF --include "olmo-2-1124-13B-instruct-Q2_K*" --local-dir ./OLMo-2-1124-13B-Instruct-GGUF $ llama-server -m ./OLMo-2-1124-13B-Instruct-GGUF/olmo-2-1124-13B-instruct-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./OLMo-2-1124-13B-Instruct-GGUF/olmo-2-1124-13B-instruct-Q2_K.gguf\n' > Modelfile $ ollama create olmo-2-1124-13b-instruct-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
540eb39fcbaef1b436a99a30c72b5b185f8baf0fcc53650dc0e5926e62c90eac
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject: OLMo-2-1124-13B-Instruct-GGUFDate: 2026-11-15Commit: 02bfa6dSigned: 2DC28CC7B26A283B ✓
Upstream
allenai/OLMo-2-1124-13B-Instruct-GGUF
Pinned commit
02bfa6da698648c2472c57727cd0098049fe3ec8
Manifest
OLMo-2-1124-13B-Instruct-GGUF.json · .minisig
Manifest sha256
e6aafe3f740fa6b06d3f64705dd6e0469655bb73d9fbe777f5899476bed36f17
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:14 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/OLMo-2-1124-13B-Instruct-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/allenai/OLMo-2-1124-13B-Instruct-GGUF.json.minisig $ minisign -Vm OLMo-2-1124-13B-Instruct-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

allenai/OLMo-2-1124-13B-Instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMo-2-1124-13B-Instruct-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. OLMo-2-1124-13B-Instruct-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/allenai/OLMo-2-1124-13B-Instruct-GGUF

Related models

All of alt.freeweights.olmo →
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF