alt.freeweights.olmo / Flex-public-7B-1T

From:

allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject:

Flex-public-7B-1T

Date: 2026-11-15Commit: f78a73bSigned: 2DC28CC7B26A283B ✓

Text generation model with 7.3B parameters. Safetensors weights, 29.2 GB in all. Published by allenai under Apache-2.0.

7.3B params

29.2GBFlex-public-7B-1Tsafetensorspermissive

FactsParams7.3BSize29.2 GBFormatssafetensorsTasktext generationLicenseApache-2.0From sourcepermissive

$ fw get allenai/Flex-public-7B-1T
# manifest sha256 98a7ae385398… · 29.2 GB · 17 files
$ fw verify ./Flex-public-7B-1T allenai/Flex-public-7B-1T

From sourceHosted (signed)allenai/Flex-public-7B-1TLast check: 2026-11-15 03:30 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run24 Fine-tune29 Convert15 Evaluate13 Scan13 Apps58

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

vLLM exo Text Generation WebUI

SGLang MLC LLM KTransformers LMCache Xinference LMDeploy mistral.rs Mooncake FlashInfer

Show all 24

AIBrix fastllm ExLlamaV3

Transformers LocalAI tinygrad gpu-unlock Triton Inference Server BentoML CTranslate2 ExLlamaV2 LitServe

Convert with

mergekit TensorRT Model Optimizer

LLM Compressor Neural Compressor AutoRound AQLM GPTQModel ONNX Core ML Tools ExecuTorch

Show all 15

Evaluate with

Opik DeepEval Ragas lm-evaluation-harness OpenCompass SWE-bench

simple-evals TruLens HELM

LightEval

Evaluate Weave

Show all 13

Autoevals

Scan with

promptfoo garak Guardrails NeMo Guardrails Giskard DeepTeam AI Fairness 360 Fairlearn Detoxify MCP Scanner AgentDojo ModelScan

Show all 13

picklescan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 29.2 GB
Weights: 29.2 GB (safetensors)
Parameters: 7.3B
Formats: safetensors
Task: text generation
License: Apache-2.0 (permissive)
Files: 17, each with a sha256
Publisher: allenai
Added: 2026-11-15
Section: alt.freeweights.olmo

Lineage

Original release from the publisher.

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 03:30 UTC	passed

Model card

From the publisher at commit f78a73b. Shown as plain text with links; images open at the publisher.

Image: FlexOlmo Logo. FlexOlmo is a new kind of LM that unlocks a new paradigm of data collaboration. With FlexOlmo, data owners can contribute to the development of open language models without giving up control of their data. There is no need to share raw data directly, and data contributors can decide when their data is active in the model, deactivate it at any time, and receive attributions whenever it's used for inference.

Model Summary#

FlexOlmo-7x7B-1T (without router training) is a Mixture-of-Experts with 33B total parameters, combining independently trained experts on public-mix, news, math, code, academic texts, creative writing, and Reddit data. The public-mix expert is trained on 1T tokens of public data while the other experts are branched from the public-mix expert and trained on 50B tokens of their respective data.

This information and more can also be found:

Paper: https://allenai.org/papers/flexolmo
Code: https://github.com/allenai/FlexOlmo
Blog: https://allenai.org/blog/flexolmo
Data and corresponding models:

Corpus	Public	Math	News	Academic	Code	Creative Writing	Reddit
Model	Flex-public-7B-1T	Flex-math-2x7B-1T	Flex-news-2x7B-1T	Flex-pes2o-2x7B-1T	Flex-code-2x7B-1T	Flex-creative-2x7B-1T	Flex-reddit-2x7B-1T

Use#

Install transformers with version 4.57.0 or newer and run:

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

DEVICE = "cuda" if torch.cuda.is_available() else "cpu"

MODEL_NAME = "allenai/FlexOlmo-7x7B-1T"
TOKENIZER_NAME = "allenai/dolma2-tokenizer"
model = AutoModelForCausalLM.from_pretrained(MODEL_NAME).to(DEVICE)
tokenizer = AutoTokenizer.from_pretrained(TOKENIZER_NAME)
inputs = tokenizer("Bitcoin is", return_tensors="pt")
inputs = {k: v.to(DEVICE) for k, v in inputs.items()}
out = model.generate(**inputs, max_length=64)
print(tokenizer.decode(out[0]))

Evaluation Snapshot#

Model	MC9	Gen5	MMLU	MMLU Pro	AGIEval	BBH	Math2	NewsG	PoemG	SciRIFF5	Code4	Avg.
Prev. Public model	68.7	58.8	55.9	26.2	39.9	35.7	8.2	76.0	47.8	48.1	1.1	42.4
Individual
Math	62.5	44.3	50.6	24.1	42.0	45.6	53.1	42.6	28.0	50.7	15.8	41.8
Code	40.5	39.4	29.5	14.5	27.4	38.1	6.0	45.1	28.2	48.0	21.0	30.7
News	46.5	48.6	36.4	15.2	25.7	30.9	2.5	77.7	26.9	47.0	0.0	32.5
Creative Writing	42.7	43.9	31.5	11.6	23.3	27.6	1.7	56.9	67.5	42.4	0.0	31.7
Academic	41.0	45.2	33.8	14.8	24.1	32.4	6.5	51.8	23.0	52.0	0.0	29.5
Reddit	64.7	36.5	56.1	25.5	35.5	19.7	2.5	54.1	8.6	32.7	1.7	30.7
Combined
BTM (top-2)	68.7	57.7	59.4	28.3	43.2	44.3	23.1	73.6	54.4	46.3	24.0	47.6
FlexOlmo-7x7B-1T	65.6	44.7	50.9	22.1	37.2	35.6	25.4	55.8	39.0	45.9	10.6	39.3
FlexOlmo-7x7B-1T-RT	70.6	59.7	60.0	30.5	44.6	45.9	47.7	79.7	67.6	54.5	11.3	52.0

The evaluation of the individual model refers to the dense model, not the 2x7B MoE model.

Citation#

@misc{flexolmo,
      title={FlexOlmo: Open Language Models for Flexible Data Use}, 
      author={Weijia Shi and Akshita Bhagia and Kevin Farhat and Niklas Muennighoff and Pete Walsh and Jacob Morrison and Dustin Schwenk and Shayne Longpre and Jake Poznanski and Allyson Ettinger and Daogao Liu and Margaret Li and Mike Lewis and Wen-tau Yih and Dirk Groeneveld and Luca Soldaini and Kyle Lo and Noah A. Smith and Luke Zettlemoyer and Pang Wei Koh and Hannaneh Hajishirzi and Ali Farhadi and Sewon Min},
      year={2025},
      eprint={2507.07024},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://allenai.org/papers/flexolmo}, 
}

Files

17 files · 29.2 GBWeights 29.2 GB (safetensors). Sizes and sha256 from the signed manifest.

Hide all 17 files with their sha256

File	Size	sha256
.gitattributes	1.52 KB	11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361
FlexOlmo_Logo.png	17.8 KB	b85598008029e8e40ef7cf85dae4f5ead047c05bbd4451b9996a09d0d11b2eb6
README.md	4.94 KB	49370eb1db31ffb5e88393f43b9e6cc1aa4a674cc1a0a7dea63e62198c91300e
config.json	650 B	7e6652f46a1dd56bbc7e90e4d27e48b576ad24f86dcddad31a7128fa0465e1c0
generation_config.json	147 B	88f6004cde04d3b24218be4ed781a12264d774e3d1224559fa37f2c8275fdeae
merges.txt	917 KB	b6fe424e334903f7fb84d3a106d9730455f4744b9fe3c21ee136d97a00e72502
model-00001-of-00006.safetensors	4.95 GB	39f32672d6f3ca5c1c46dd23ba465bcfaba8f44c2d03ba90d49a480e40a55f4f
model-00002-of-00006.safetensors	4.99 GB	aabd965c225fb67963876a4b004d127a0e0d1931d5f0afebc564cdd2076fc52f
model-00003-of-00006.safetensors	4.92 GB	a2bc26cadf9d85e858cec68d8ea845a674e83c0d1d0f7a5b6a230fcad8315860
model-00004-of-00006.safetensors	4.86 GB	8858570eb05bcd69d93dc313b045f6eaff89a6e0c1f150cd6fc2ed40e54eb22e
model-00005-of-00006.safetensors	4.86 GB	f85c34dc2bf7b6c4883c824b5a79f6dc554d0d271d24d2e40684a0109a91229a
model-00006-of-00006.safetensors	4.61 GB	430df3110cfd3d5668bd97f99b80cecefab23e34860e1c6d000b481cb00a31a8
model.safetensors.index.json	29.6 KB	c285ec59423a5a7203724c6258f61d691c0816e4c3f79b1fede776298f894b07
special_tokens_map.json	581 B	78afb564e81264029b25f9caf24bda2521d5bdaeff5cd3fdbc01d3da2e8ce2f2
tokenizer.json	4.24 MB	969c214487b744f1457d8a4f2055fd4ad348edff5322d4f21f2906ceb158a636
tokenizer_config.json	4.51 KB	f820eb9a838bd1c87cb14ceee85a4d443efad3a380f666befd41ad18b0ac4f76
vocab.json	1.61 MB	9e14712c91b37c7aab74b1306baa46ac342d620637a4b44523cdc3aec7d24195

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
f78a73be4f pinned now	2026-11-15 03:30 UTC	17 files · 29.2 GB

Use it

$ fw get allenai/Flex-public-7B-1T
# manifest sha256 98a7ae385398… · 29.2 GB · 17 files
$ fw verify ./Flex-public-7B-1T allenai/Flex-public-7B-1T

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/allenai/Flex-public-7B-1T.json --dir ./Flex-public-7B-1T
$ python3 fw.py verify ./Flex-public-7B-1T ./allenai__Flex-public-7B-1T.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/Flex-public-7B-1T --revision f78a73be4fec6100329872652034a3443b3b79f7 --local-dir ./Flex-public-7B-1T

transformersLoad the weights in Python.

import os
os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("allenai/Flex-public-7B-1T", revision="f78a73be4fec6100329872652034a3443b3b79f7")
model = AutoModelForCausalLM.from_pretrained("allenai/Flex-public-7B-1T", revision="f78a73be4fec6100329872652034a3443b3b79f7", device_map="auto")

vLLMServe an OpenAI-compatible API.

$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve allenai/Flex-public-7B-1T --revision f78a73be4fec6100329872652034a3443b3b79f7

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: README.md
Text sha256: 49370eb1db31ffb5e88393f43b9e6cc1aa4a674cc1a0a7dea63e62198c91300e
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From:

allenai <huggingface.co/allenai>Newsgroups: alt.freeweights.olmoSubject: Flex-public-7B-1TDate: 2026-11-15Commit: f78a73bSigned: 2DC28CC7B26A283B ✓

Upstream: allenai/Flex-public-7B-1T
Pinned commit: f78a73be4fec6100329872652034a3443b3b79f7
Manifest: Flex-public-7B-1T.json · .minisig
Manifest sha256: 98a7ae3853986a07b8c1ee5081717f1131e1fe7810ce9a8fea9edb6047c29aa4
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 03:30 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/allenai/Flex-public-7B-1T.json
$ curl -O https://freeweights.allternit.com/manifests/allenai/Flex-public-7B-1T.json.minisig
$ minisign -Vm Flex-public-7B-1T.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download allenai/Flex-public-7B-1T

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. Flex-public-7B-1T.json. Provenance. Takedown history: none.

Source

huggingface.co/allenai/Flex-public-7B-1T

Related models

All of alt.freeweights.olmo →

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF

From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF

Flex-public-7B-1T

Works with

Runs with

Fine-tune with

Convert with

Evaluate with

Scan with

Works with

Overview

Model card

Model Summary#

Use#

Evaluation Snapshot#

Citation#

Files

Use it

License

Provenance

How to verify

Model tree

Related models