CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.olmo / Emo_1b14b_1T
From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject:

Emo_1b14b_1T

Date: 2026-11-15Commit: 007852bSigned: 2DC28CC7B26A283B ✓

Text generation model with 13.6B parameters. Safetensors weights, 54.3 GB in all. Published by allenai under Apache-2.0.

13.6B params54.3GBEmo_1b14b_1Tsafetensorspermissive
FactsParams13.6BSize54.3 GBFormatssafetensorsTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get allenai/Emo_1b14b_1T
# manifest sha256 1da57f1985d8… · 54.3 GB · 24 files
$ fw verify ./Emo_1b14b_1T allenai/Emo_1b14b_1T
From sourceHosted (signed)allenai/Emo_1b14b_1TLast check: 2026-11-15 03:48 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run24Fine-tune29Convert15Evaluate13Scan13Apps58
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
54.3 GB
Weights
54.3 GB (safetensors)
Parameters
13.6B
Formats
safetensors
Task
text generation
License
Apache-2.0 (permissive)
Files
24, each with a sha256
Publisher
allenai
Added
2026-11-15
Section
alt.freeweights.olmo
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 03:48 UTCpassed

Model card

From the publisher at commit 007852b. Shown as plain text with links; images open at the publisher.

Emo_1b14b_1T#

The main release of EMO from EMO: Pretraining Mixture of Experts for Emergent Modularity — referred to as EMO (1T tokens, midtrained) in the paper.

1B-active / 14B-total parameter Mixture-of-Experts model (128 experts: 127 routed + 1 shared, k=8 active per token) pretrained on 1T tokens of the OLMoE pretraining mix and annealed under the EMO objective for an additional 50B tokens. Tokens within the same document are constrained to route through a shared pool of experts during training, producing expert subsets that can be deployed in isolation for specific domains with minimal performance degradation.

Usage#

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "allenai/Emo_1b14b_1T"
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)

inputs = tokenizer(["Language modeling is "], return_tensors="pt", return_token_type_ids=False)
out = model.generate(**inputs, max_new_tokens=100, do_sample=True, temperature=1.0, top_p=0.7)
print(tokenizer.batch_decode(out, skip_special_tokens=True)[0])

Citation#

@article{wang2026emo,
  title  = {EMO: Pretraining Mixture of Experts for Emergent Modularity},
  author = {Wang, Ryan and Bhagia, Akshita and Min, Sewon},
  year   = {2026},
  url    = {https://arxiv.org/abs/2605.06663}
}

License#

This model is licensed under Apache 2.0. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines

Files

24 files · 54.3 GBWeights 54.3 GB (safetensors). Sizes and sha256 from the signed manifest.
Show all 24 files with their sha256
FileSizesha256
.gitattributes1.52 KB11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361
README.md1.92 KBf0cf546e2f75f960d7ffef98ebd31c70b403d3e2f9f749ddba3adb13b2e822b5
chat_template.jinja196 B153280e3ff55d19da1398bdb3914ee2a51b80429bfaedde11d7d216c39db80f3
config.json1.12 KB508fb6d7ae0419a27af8e9d776ba546152e89d259a80c35a9c5e3f8cfe8ee66e
configuration_emo.py11.7 KBf1bd419d8dd926cf7d15131b8192938a0feda1b003586320fa56de20360e4bf2
generation_config.json69 B49b7b376c9a77281e37b1544e00f6b83ffe1d46bd47ff1c5ee04a7d642ecbe2b
merges.txt917 KBb6fe424e334903f7fb84d3a106d9730455f4744b9fe3c21ee136d97a00e72502
model-00001-of-00011.safetensors4.99 GBb7e717ca28e080b583eb2dd6ce0e813714df613d33fe87f75b56eb060c4ed6c1
model-00002-of-00011.safetensors4.99 GB6c533f6d918782c976fa4d113fb2938e50de4460208cdeaab80eb69d859616fd
model-00003-of-00011.safetensors4.99 GBe4808949fd1f1f7231866ee3f7710d9d1c73b478e7f27b128d539152613be57a
model-00004-of-00011.safetensors4.99 GBfa24c856963ae94f4bc979404e2512426ccce866000966dd88fa41a2c9addc27
model-00005-of-00011.safetensors4.99 GB0fa388f0022d06daedfabbdd7ba8e425a3c4523a07ccba90f47a32db36551c83
model-00006-of-00011.safetensors4.99 GB4febe5341e9a1e54cd9be18391cb86fd156daefa005b5e872df1802c2cead783
model-00007-of-00011.safetensors4.99 GB8ef254c8ec77ff66e5cb63fb4082f6195ed926c9ffd42bcdd7094664e33b3088
model-00008-of-00011.safetensors4.99 GBa407e22d64255c2abe3fce86d42c999ef7ad3cfd86fbc4bcc53d9ff2e228b71b
model-00009-of-00011.safetensors4.99 GB739b5a1ccd6adf8de11365a704bbdded893a3314463ea024750b60503aed1c99
model-00010-of-00011.safetensors4.99 GBbd3a715cde8e4cdfd5bd3265e5954df375934297e3dc73ec1a67abe81ccf33b3
model-00011-of-00011.safetensors4.35 GB37f5cc7e2959c27f27d91023ea041f4008a16d2e0f4cca5bbe83deb71916ec8b
model.safetensors.index.json562 KB934e6eb0b66c52b4f4a5d7ef7fde489f41d8fa697ea8ff52862c959377412339
modeling_emo.py55.2 KBe10fb25a662d581b25708c7b1d640ba22c7547824a1f4f00c1fc39f08801d32b
special_tokens_map.json207 B4cb2b52960bababa8ec27153831e405ef7811e3fad1226106e09c28e715cfb21
tokenizer.json7.14 MB73fd5254624f39a88e3faac6a8e11300fc3c735ed37880d4f4f08db898eaecca
tokenizer_config.json4.31 KB733b2ec0f743cf206dd20335eacbd4427c85487fd6f5216bb361f92a85314315
vocab.json1.61 MB9e14712c91b37c7aab74b1306baa46ac342d620637a4b44523cdc3aec7d24195
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
007852b1e3 pinned now2026-11-15 03:48 UTC24 files · 54.3 GB

Use it

$ fw get allenai/Emo_1b14b_1T
# manifest sha256 1da57f1985d8… · 54.3 GB · 24 files
$ fw verify ./Emo_1b14b_1T allenai/Emo_1b14b_1T
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/Emo_1b14b_1T.json --dir ./Emo_1b14b_1T $ python3 fw.py verify ./Emo_1b14b_1T ./allenai__Emo_1b14b_1T.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/Emo_1b14b_1T --revision 007852b1e3d22222f8ee03c6a53fa30e47898dcb --local-dir ./Emo_1b14b_1T
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForCausalLM, AutoTokenizer tok = AutoTokenizer.from_pretrained("allenai/Emo_1b14b_1T", revision="007852b1e3d22222f8ee03c6a53fa30e47898dcb") model = AutoModelForCausalLM.from_pretrained("allenai/Emo_1b14b_1T", revision="007852b1e3d22222f8ee03c6a53fa30e47898dcb", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve allenai/Emo_1b14b_1T --revision 007852b1e3d22222f8ee03c6a53fa30e47898dcb
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
f0cf546e2f75f960d7ffef98ebd31c70b403d3e2f9f749ddba3adb13b2e822b5
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject: Emo_1b14b_1TDate: 2026-11-15Commit: 007852bSigned: 2DC28CC7B26A283B ✓
Upstream
allenai/Emo_1b14b_1T
Pinned commit
007852b1e3d22222f8ee03c6a53fa30e47898dcb
Manifest
Emo_1b14b_1T.json · .minisig
Manifest sha256
1da57f1985d8a05f38d339efc721bc972e0aebe73f44254e39abfc62322d600b
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 03:48 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/Emo_1b14b_1T.json $ curl -O https://freeweights.allternit.com/manifests/allenai/Emo_1b14b_1T.json.minisig $ minisign -Vm Emo_1b14b_1T.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/Emo_1b14b_1T
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Emo_1b14b_1T.json. Provenance. Takedown history: none.
Source
huggingface.co/allenai/Emo_1b14b_1T

Related models

All of alt.freeweights.olmo →
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF