CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.olmo / OLMoE-1B-7B-0924-GGUF
From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject:

OLMoE-1B-7B-0924-GGUF

Date: 2026-11-15Commit: 70df85eSigned: 2DC28CC7B26A283B ✓

Model. Gguf weights, 66.0 GB in all. Published by allenai under Apache-2.0.

olmo66.0GBOLMoE-1B-7B-0924-GGUFggufpermissive
FactsParamsnot statedSize66.0 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get allenai/OLMoE-1B-7B-0924-GGUF
# manifest sha256 41df130c608d… · 66.0 GB · 15 files
$ fw verify ./OLMoE-1B-7B-0924-GGUF allenai/OLMoE-1B-7B-0924-GGUF
From sourceHosted (signed)allenai/OLMoE-1B-7B-0924-GGUFLast check: 2026-11-15 05:03 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of OLMoE-1B-7B-0924.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
66.0 GB
Weights
2.56 GB (smallest of 13 GGUF variants)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
15, each with a sha256
Publisher
allenai
Added
2026-11-15
Section
alt.freeweights.olmo
Lineage

Original release from the publisher.

Base model: allenai/OLMoE-1B-7B-0924

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:03 UTCpassed

Model card

From the publisher at commit 70df85e. Shown as plain text with links; images open at the publisher.

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924

@misc{muennighoff2024olmoeopenmixtureofexpertslanguage,
      title={OLMoE: Open Mixture-of-Experts Language Models}, 
      author={Niklas Muennighoff and Luca Soldaini and Dirk Groeneveld and Kyle Lo and Jacob Morrison and Sewon Min and Weijia Shi and Pete Walsh and Oyvind Tafjord and Nathan Lambert and Yuling Gu and Shane Arora and Akshita Bhagia and Dustin Schwenk and David Wadden and Alexander Wettig and Binyuan Hui and Tim Dettmers and Douwe Kiela and Ali Farhadi and Noah A. Smith and Pang Wei Koh and Amanpreet Singh and Hannaneh Hajishirzi},
      year={2024},
      eprint={2409.02060},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2409.02060}, 
}

Files

15 files · 66.0 GBWeights 2.56 GB (smallest of 13 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 15 files with their sha256
FileSizesha256
.gitattributes1.56 KB2e8fee90afb8d255a457aa4d8ef05aa5315f32f233cd8024b5d46c463da4b6fe
README.md969 B742f44142aa0b33db7611555b1d6ff9dfa708249fe48ac14749ba6a102f6d67f
olmoe-1b-7b-0924-f16.gguf13.8 GB893424707d060dc852dc2308432798655f0385e96e65774d00019810cd5395b9
olmoe-1b-7b-0924-q2_k.gguf2.56 GB65cd555f7c31f9097503cd973ba211cdd536d97784bf50c372c00f1b5a8caecf
olmoe-1b-7b-0924-q3_k_l.gguf3.61 GBb6e331fcc4f4a4e37c2596a3437014d5426a047d2a82160f22a07e40e8569f08
olmoe-1b-7b-0924-q3_k_m.gguf3.34 GB958673da218c4e2e1fb88eb55d78f8f27b25a58eda8579bbea7f95747b674304
olmoe-1b-7b-0924-q3_k_s.gguf3.02 GB0eb24a9224998751e94e185dad665d769bcb5a79d29481dab578c74c129f86ce
olmoe-1b-7b-0924-q4_0.gguf3.93 GBdd99f24474fe3feda18c39c89c719754d5ed0cbe4016e9724101a0b05475e048
olmoe-1b-7b-0924-q4_k_m.gguf4.21 GBf3ae25f6c7e83efb0e3632ef068b321f4d4a644bcfb6c0e01dd8c00e94e53f14
olmoe-1b-7b-0924-q4_k_s.gguf3.96 GBfc0f32e4a57708e589f3cbc68798636e0ab69d9c89e02267df48a41d8241b1dc
olmoe-1b-7b-0924-q5_0.gguf4.78 GBd8888c85c51459bdda9cb4d7079a780c142461b68944b25e50a348c8108e0c60
olmoe-1b-7b-0924-q5_k_m.gguf4.93 GBe4e5652e7d3410dddd989cf85271b7d356207e9164b796f9685c443b4c7abe3f
olmoe-1b-7b-0924-q5_k_s.gguf4.78 GB979914cca2d49a598964e5cc0c8cfed218a346e9a60cf0374b86b8bbaefeb31c
olmoe-1b-7b-0924-q6_k.gguf5.68 GB9c8b3ccb1a35b2d13b1b36552f0ce2f2a069ef90141c2392f64349e6ebbd3bbd
olmoe-1b-7b-0924-q8_0.gguf7.36 GBf2049d5ac4a1c226bedb5b704dab0098d938199e7ddc052662e9159fab50e1b7
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
70df85ed71 pinned now2026-11-15 05:03 UTC15 files · 66.0 GB

Use it

$ fw get allenai/OLMoE-1B-7B-0924-GGUF
# manifest sha256 41df130c608d… · 66.0 GB · 15 files
$ fw verify ./OLMoE-1B-7B-0924-GGUF allenai/OLMoE-1B-7B-0924-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0924-GGUF.json --dir ./OLMoE-1B-7B-0924-GGUF $ python3 fw.py verify ./OLMoE-1B-7B-0924-GGUF ./allenai__OLMoE-1B-7B-0924-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0924-GGUF --revision 70df85ed7132bf21b5acbcb33817f58e7d3cb949 --local-dir ./OLMoE-1B-7B-0924-GGUF
llama.cppDownload one GGUF variant (olmoe-1b-7b-0924-q2_k, 2.56 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0924-GGUF --include "olmoe-1b-7b-0924-q2_k*" --local-dir ./OLMoE-1B-7B-0924-GGUF $ llama-server -m ./OLMoE-1B-7B-0924-GGUF/olmoe-1b-7b-0924-q2_k.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./OLMoE-1B-7B-0924-GGUF/olmoe-1b-7b-0924-q2_k.gguf\n' > Modelfile $ ollama create olmoe-1b-7b-0924-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
742f44142aa0b33db7611555b1d6ff9dfa708249fe48ac14749ba6a102f6d67f
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject: OLMoE-1B-7B-0924-GGUFDate: 2026-11-15Commit: 70df85eSigned: 2DC28CC7B26A283B ✓
Upstream
allenai/OLMoE-1B-7B-0924-GGUF
Pinned commit
70df85ed7132bf21b5acbcb33817f58e7d3cb949
Manifest
OLMoE-1B-7B-0924-GGUF.json · .minisig
Manifest sha256
41df130c608d380ae6a6b695102c092ad1e76e88c14b570c48c5028d2a7a16b9
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:03 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0924-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0924-GGUF.json.minisig $ minisign -Vm OLMoE-1B-7B-0924-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

allenai/OLMoE-1B-7B-0924 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0924-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. OLMoE-1B-7B-0924-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/allenai/OLMoE-1B-7B-0924-GGUF

Related models

All of alt.freeweights.olmo →
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF