CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.olmo / OLMoE-1B-7B-0125-GGUF
From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject:

OLMoE-1B-7B-0125-GGUF

Date: 2026-11-15Commit: b8453f3Signed: 2DC28CC7B26A283B ✓

Model. Gguf weights, 66.0 GB in all. Published by allenai under Apache-2.0.

olmo66.0GBOLMoE-1B-7B-0125-GGUFggufpermissive
FactsParamsnot statedSize66.0 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get allenai/OLMoE-1B-7B-0125-GGUF
# manifest sha256 25364f803293… · 66.0 GB · 15 files
$ fw verify ./OLMoE-1B-7B-0125-GGUF allenai/OLMoE-1B-7B-0125-GGUF
From sourceHosted (signed)allenai/OLMoE-1B-7B-0125-GGUFLast check: 2026-11-15 05:06 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of OLMoE-1B-7B-0125.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
66.0 GB
Weights
2.56 GB (smallest of 13 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
15, each with a sha256
Publisher
allenai
Added
2026-11-15
Section
alt.freeweights.olmo
Lineage

Original release from the publisher.

Base model: allenai/OLMoE-1B-7B-0125

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:06 UTCpassed

Model card

From the publisher at commit b8453f3. Shown as plain text with links; images open at the publisher.

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0125

Files

15 files · 66.0 GBWeights 2.56 GB (smallest of 13 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 15 files with their sha256
FileSizesha256
.gitattributes2.40 KB7f73ef2f4aa3b0006ce96c72ff172e8849d9a3ab163ebb47004fa679ef70f59d
OLMoE-1B-7B-0125-F16.gguf13.8 GB10885b8aa256085897a0940f9303e83e57c741e52574fb1ff69fc76220236902
OLMoE-1B-7B-0125-Q2_K.gguf2.56 GBd11373172c0ce8ac342386fdbfb4a8b36a023cd5c0a47bc845e4dc7c8930670f
OLMoE-1B-7B-0125-Q3_K_L.gguf3.61 GB6ffbd4dc99ebba8f316cb05f171138b329c2a7bd0b0ffe56db68350de6ce2768
OLMoE-1B-7B-0125-Q3_K_M.gguf3.34 GB773236c3a4c6918f34986cbfa6bf4202e6460b3a499b032739513ce0ca0e4780
OLMoE-1B-7B-0125-Q3_K_S.gguf3.02 GB98104a70456be24914a422c3a6888fc188373f76dc85a4940379652ceada8841
OLMoE-1B-7B-0125-Q4_0.gguf3.93 GBe978a0df7f6be87a6866450befff7124b665decf2083f75ba4af7f17468f146e
OLMoE-1B-7B-0125-Q4_K_M.gguf4.21 GB0d2041079673f86d305b3f26f6744446f2f2236b51b49a7115fb6ed503748bd4
OLMoE-1B-7B-0125-Q4_K_S.gguf3.96 GBe5490ed9fdc01cd6ca4ffe76a945b8dd50459b80c95ea625525b50cd771d3e1c
OLMoE-1B-7B-0125-Q5_0.gguf4.78 GBe6dcaa92a2b650bd56926d18408d21980b8214df59dcb8245175b5b4df032ba0
OLMoE-1B-7B-0125-Q5_K_M.gguf4.93 GBeaf3a1685f676c1fe6289231c2db0008adfdffc74c9ae8370903c9b1a452ba3e
OLMoE-1B-7B-0125-Q5_K_S.gguf4.78 GBfc0fb7ec80661a33cdf8acccf628c292f55fa0123c45cc451c06f8803fb94916
OLMoE-1B-7B-0125-Q6_K.gguf5.68 GB0629493ae8430a9ae5dbdda116f8016c558897e4d4965be55093a761487098ef
OLMoE-1B-7B-0125-Q8_0.gguf7.36 GB5a82c080fb821ed5afac78768377260f984e19decf3fc49befafe61d7a9d44ad
README.md110 B8bc4809af205e214df0a1c6f4ccc3fc8f17c59a1831260f8d99ff21493372fa9
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
b8453f3c06 pinned now2026-11-15 05:06 UTC15 files · 66.0 GB

Use it

$ fw get allenai/OLMoE-1B-7B-0125-GGUF
# manifest sha256 25364f803293… · 66.0 GB · 15 files
$ fw verify ./OLMoE-1B-7B-0125-GGUF allenai/OLMoE-1B-7B-0125-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0125-GGUF.json --dir ./OLMoE-1B-7B-0125-GGUF $ python3 fw.py verify ./OLMoE-1B-7B-0125-GGUF ./allenai__OLMoE-1B-7B-0125-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0125-GGUF --revision b8453f3c06477f3efc002ff89f2c3c149ffbeec1 --local-dir ./OLMoE-1B-7B-0125-GGUF
llama.cppDownload one GGUF variant (OLMoE-1B-7B-0125-Q2_K, 2.56 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0125-GGUF --include "OLMoE-1B-7B-0125-Q2_K*" --local-dir ./OLMoE-1B-7B-0125-GGUF $ llama-server -m ./OLMoE-1B-7B-0125-GGUF/OLMoE-1B-7B-0125-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./OLMoE-1B-7B-0125-GGUF/OLMoE-1B-7B-0125-Q2_K.gguf\n' > Modelfile $ ollama create olmoe-1b-7b-0125-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
Inherited from the base model allenai/OLMoE-1B-7B-0125: the strictest license along the lineage applies. 2026-11-15
Text in
README.md
Text sha256
8bc4809af205e214df0a1c6f4ccc3fc8f17c59a1831260f8d99ff21493372fa9
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject: OLMoE-1B-7B-0125-GGUFDate: 2026-11-15Commit: b8453f3Signed: 2DC28CC7B26A283B ✓
Upstream
allenai/OLMoE-1B-7B-0125-GGUF
Pinned commit
b8453f3c06477f3efc002ff89f2c3c149ffbeec1
Manifest
OLMoE-1B-7B-0125-GGUF.json · .minisig
Manifest sha256
25364f803293f2c23ce2901d52503eda3c282088da028f62bba54d50ec660b63
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:06 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0125-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0125-GGUF.json.minisig $ minisign -Vm OLMoE-1B-7B-0125-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

allenai/OLMoE-1B-7B-0125 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0125-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. OLMoE-1B-7B-0125-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/allenai/OLMoE-1B-7B-0125-GGUF

Related models

All of alt.freeweights.olmo →
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF