alt.freeweights.olmo / OLMoE-1B-7B-0924-Instruct-GGUF

From:

allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject:

OLMoE-1B-7B-0924-Instruct-GGUF

Date: 2026-11-15Commit: 02ab6eaSigned: 2DC28CC7B26A283B ✓

Model. Gguf weights, 66.0 GB in all. Published by allenai under Apache-2.0.

olmo

66.0GBOLMoE-1B-7B-0924-Instruct-GGUFggufpermissive

FactsParamsnot statedSize66.0 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive

$ fw get allenai/OLMoE-1B-7B-0924-Instruct-GGUF
# manifest sha256 24e3c9dd93a8… · 66.0 GB · 15 files
$ fw verify ./OLMoE-1B-7B-0924-Instruct-GGUF allenai/OLMoE-1B-7B-0924-Instruct-GGUF

From sourceHosted (signed)allenai/OLMoE-1B-7B-0924-Instruct-GGUFLast check: 2026-11-15 04:46 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of OLMoE-1B-7B-0924-Instruct.

Works with

Run11 Convert1 Scan1

Runs with

Ranked by fit to this model (gguf), then by GitHub stars.

Ollama

llama.cpp LocalAI

BitNet llamafile KoboldCpp PocketPal AI llama-swap ik_llama.cpp RamaLama Maid

Convert with

ggml

Scan with

ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 66.0 GB
Weights: 2.56 GB (smallest of 13 GGUF variants)
Parameters: not stated
Formats: gguf
Task: not tagged
License: Apache-2.0 (permissive)
Files: 15, each with a sha256
Publisher: allenai
Added: 2026-11-15
Section: alt.freeweights.olmo

Lineage

Original release from the publisher.

Base model: allenai/OLMoE-1B-7B-0924-Instruct

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 04:46 UTC	passed

Model card

From the publisher at commit 02ab6ea. Shown as plain text with links; images open at the publisher.

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924-Instruct

@misc{muennighoff2024olmoeopenmixtureofexpertslanguage,
      title={OLMoE: Open Mixture-of-Experts Language Models}, 
      author={Niklas Muennighoff and Luca Soldaini and Dirk Groeneveld and Kyle Lo and Jacob Morrison and Sewon Min and Weijia Shi and Pete Walsh and Oyvind Tafjord and Nathan Lambert and Yuling Gu and Shane Arora and Akshita Bhagia and Dustin Schwenk and David Wadden and Alexander Wettig and Binyuan Hui and Tim Dettmers and Douwe Kiela and Ali Farhadi and Noah A. Smith and Pang Wei Koh and Amanpreet Singh and Hannaneh Hajishirzi},
      year={2024},
      eprint={2409.02060},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2409.02060}, 
}

Files

15 files · 66.0 GBWeights 2.56 GB (smallest of 13 GGUF variants). Sizes and sha256 from the signed manifest.

Hide all 15 files with their sha256

File	Size	sha256
.gitattributes	1.56 KB	2e8fee90afb8d255a457aa4d8ef05aa5315f32f233cd8024b5d46c463da4b6fe
README.md	1.00 KB	d5648d83b5817e154b8dfbf151814391de1e17700adbd1e547108593a325655c
olmoe-1b-7b-0924-instruct-f16.gguf	13.8 GB	bd310879bec683e61f793243ee033e3d5619e7103a6d8ca104986443ae71413b
olmoe-1b-7b-0924-instruct-q2_k.gguf	2.56 GB	30a594dcb82aedfa10af714cdd218717dc00de71b980e7bf35d18055f82ea525
olmoe-1b-7b-0924-instruct-q3_k_l.gguf	3.61 GB	69228ec3767eb58c93521413a2f8c376eaddea2d3a52fd6a885e709e9066be87
olmoe-1b-7b-0924-instruct-q3_k_m.gguf	3.34 GB	1e589f85f43f619a7f4d8bbb3f5799dc268baebd4761b568a59002ef8033d7dc
olmoe-1b-7b-0924-instruct-q3_k_s.gguf	3.02 GB	e99875673941de26e5860e4b990e13ae414ef85bbe6e710ad8c0571ddef1a352
olmoe-1b-7b-0924-instruct-q4_0.gguf	3.93 GB	361e8d83f0820e50d0ed1a13b10586ed9f476d99dcaf6aafd14f07e11840b22b
olmoe-1b-7b-0924-instruct-q4_k_m.gguf	4.21 GB	8c310f1435a1222338fd2d3d974975be9cd908180b644bab0c2a94da1ac32f3f
olmoe-1b-7b-0924-instruct-q4_k_s.gguf	3.96 GB	222aa205cf24fee28ff5a90b49b575b7e8935be9da8ba79ec650426f13e416d2
olmoe-1b-7b-0924-instruct-q5_0.gguf	4.78 GB	a2908af3dc40657f11cb7493366e18699a766895a994c8872d919dbc3f67fee3
olmoe-1b-7b-0924-instruct-q5_k_m.gguf	4.93 GB	54dd9b00d9368a9f57ba3695e27456b6cf2e2e6085cc85ba6f757b58ace30dff
olmoe-1b-7b-0924-instruct-q5_k_s.gguf	4.78 GB	8432e700f10109ebb7801bedd60c03fb114a1d54aad38a8ba7a8ace92ef87aaf
olmoe-1b-7b-0924-instruct-q6_k.gguf	5.68 GB	ec4687f2ad96fd7800512fb5c12105dcf4336db28f0363a54f1cb5b64ecd0045
olmoe-1b-7b-0924-instruct-q8_0.gguf	7.36 GB	d089e8b12dee00764c1783f6c557a2ddd1f680ffb0d22b44ad28ef25f8909c66

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
02ab6ea689 pinned now	2026-11-15 04:46 UTC	15 files · 66.0 GB

Use it

$ fw get allenai/OLMoE-1B-7B-0924-Instruct-GGUF
# manifest sha256 24e3c9dd93a8… · 66.0 GB · 15 files
$ fw verify ./OLMoE-1B-7B-0924-Instruct-GGUF allenai/OLMoE-1B-7B-0924-Instruct-GGUF

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0924-Instruct-GGUF.json --dir ./OLMoE-1B-7B-0924-Instruct-GGUF
$ python3 fw.py verify ./OLMoE-1B-7B-0924-Instruct-GGUF ./allenai__OLMoE-1B-7B-0924-Instruct-GGUF.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0924-Instruct-GGUF --revision 02ab6ea6894a8418eb14f6d8ee1bfb08bd298080 --local-dir ./OLMoE-1B-7B-0924-Instruct-GGUF

llama.cppDownload one GGUF variant (olmoe-1b-7b-0924-instruct-q2_k, 2.56 GB), then serve it.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0924-Instruct-GGUF --include "olmoe-1b-7b-0924-instruct-q2_k*" --local-dir ./OLMoE-1B-7B-0924-Instruct-GGUF
$ llama-server -m ./OLMoE-1B-7B-0924-Instruct-GGUF/olmoe-1b-7b-0924-instruct-q2_k.gguf

OllamaMake an Ollama model from the downloaded file.

$ printf 'FROM ./OLMoE-1B-7B-0924-Instruct-GGUF/olmoe-1b-7b-0924-instruct-q2_k.gguf\n' > Modelfile
$ ollama create olmoe-1b-7b-0924-instruct-gguf -f Modelfile

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: d5648d83b5817e154b8dfbf151814391de1e17700adbd1e547108593a325655c
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From:

allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject: OLMoE-1B-7B-0924-Instruct-GGUFDate: 2026-11-15Commit: 02ab6eaSigned: 2DC28CC7B26A283B ✓

Upstream: allenai/OLMoE-1B-7B-0924-Instruct-GGUF
Pinned commit: 02ab6ea6894a8418eb14f6d8ee1bfb08bd298080
Manifest: OLMoE-1B-7B-0924-Instruct-GGUF.json · .minisig
Manifest sha256: 24e3c9dd93a8a79aa5834cf1aaa00884a0d718f77b954c9628bd013484e54399
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 04:46 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0924-Instruct-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/allenai/OLMoE-1B-7B-0924-Instruct-GGUF.json.minisig
$ minisign -Vm OLMoE-1B-7B-0924-Instruct-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

allenai/OLMoE-1B-7B-0924-Instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/OLMoE-1B-7B-0924-Instruct-GGUF

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. OLMoE-1B-7B-0924-Instruct-GGUF.json. Provenance. Takedown history: none.

Source

huggingface.co/allenai/OLMoE-1B-7B-0924-Instruct-GGUF

Related models

All of alt.freeweights.olmo →

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF