From: HuggingFaceFW <huggingface.co/HuggingFaceFW>Newsgroups: alt.freeweights.datasetsSubject:

fineweb-edu

Date: 2026-11-14Commit: 87f0914Signed: 2DC28CC7B26A283B ✓

Dataset. Parquet files, 28.5 GB in all. Published by HuggingFaceFW under ODC-By-1.0.

datasets28.5GBfineweb-eduparquetpermissive
FactsRowsnot statedSize28.5 GBFormatparquetLicenseODC-By-1.0From sourcepermissive
>>> from datasets import load_dataset
>>> ds = load_dataset("HuggingFaceFW/fineweb-edu")
# with HF_ENDPOINT=https://freeweights.allternit.com · manifest sha256 683d96457349…
From sourceHosted (signed)HuggingFaceFW/fineweb-eduLast check: 2026-11-14 14:45 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Runs with

Ranked by fit to this model (parquet), then by GitHub stars.

Overview

Size
28.5 GB
Weights
dataset
Parameters
not stated
Formats
parquet
Task
text generation
License
ODC-By-1.0 (permissive)
Files
15, each with a sha256
Publisher
HuggingFaceFW
Added
2026-11-14
Section
alt.freeweights.datasets
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 14:45 UTCpassed

Model card

No model card stored here.No README was stored for this model. Read the publisher's page: https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu

Files

15 files · 28.5 GB Sizes and sha256 from the signed manifest.
Hide all 15 files with their sha256
FileSizesha256
README.md26.4 KBa0cc8998a20499432b28b6575f3046b714938eb8e11b8d59a1d25ddf3716061e
sample/10BT/000_00000.parquet2.15 GBb1ba7b2ce4cb5ea6ef42dca40263eabb85f37700d01693a68e9b30a31d78e871
sample/10BT/001_00000.parquet2.15 GB3fcf2dc69cd52503986276d3d2d26a8c356d0f2ea28a0de4fdbda8cf87755693
sample/10BT/002_00000.parquet2.15 GB547ae182d132c9f06b6ce63149567208ea9f57630bfd9b1a2938e504f0c9ebd7
sample/10BT/003_00000.parquet2.15 GB22184e6eb25759ddd97783751ffc73e1705dfa2542e630dae1f2a8bac8ee6ddb
sample/10BT/004_00000.parquet2.15 GB33557ddd87a07a4ae6fcaf7a4789c7b484e5cc0c273ca12a65b74200e6d8748b
sample/10BT/005_00000.parquet2.15 GBe08d79927ecb377786572cd854817c748ceb8880878b1a0eb91abf8c85d505ea
sample/10BT/006_00000.parquet2.15 GB554fa2613c9261d6c9c396caab881de3160175794c6c3e1856bf28a0e9cb9b76
sample/10BT/007_00000.parquet2.15 GB4b7d1f697d4afff7f5f65cb7aa4d83acc6db716da4d46ea23399d0c50608c6e3
sample/10BT/008_00000.parquet2.15 GBa6d9dcc0c72ecd7c7f0173c2d06b3a4249a2ccaa94961469d1a522ca689bbf1a
sample/10BT/009_00000.parquet2.15 GBf836cd3c70b95776699eb6c356b2dbf702816e25dcf39992f5c80a29029d23c3
sample/10BT/010_00000.parquet2.15 GBe5a2eae25f057f0856a10bfae314c6ca8ea8bb08456d2131e9e89b2b8305e2f6
sample/10BT/011_00000.parquet2.15 GBdb71cf0425bb3d1813a09f12ff1acd6dabdfb91a2e4f141960254ee5a7f036e7
sample/10BT/012_00000.parquet2.15 GB08b47a3e1c25161f796d2f8dbf99ccf60affdebdcea4910833d0d5783315551f
sample/10BT/013_00000.parquet541 MBb393f51fefab26cd6f4c8f65707c1924f6666c4961a0ebebe04bb57f7ec832de
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
87f09149ef pinned now manifest updated, same commit2026-11-14 14:45 UTC15 files · 28.5 GB
87f09149ef2026-11-14 14:45 UTC15 files · 28.5 GB

Use it

>>> from datasets import load_dataset
>>> ds = load_dataset("HuggingFaceFW/fineweb-edu")
# with HF_ENDPOINT=https://freeweights.allternit.com · manifest sha256 683d96457349…
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/HuggingFaceFW/fineweb-edu.json --dir ./fineweb-edu $ python3 fw.py verify ./fineweb-edu ./HuggingFaceFW__fineweb-edu.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download HuggingFaceFW/fineweb-edu --revision 87f09149ef4734204d70ed1d046ddc9ca3f2b8f9 --local-dir ./fineweb-edu
datasetsLoad it with the datasets library.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from datasets import load_dataset ds = load_dataset("HuggingFaceFW/fineweb-edu", revision="87f09149ef4734204d70ed1d046ddc9ca3f2b8f9")

License

Name
Open Data Commons Attribution License 1.0
Id
ODC-By-1.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
Checked and recorded in the license audit. 2026-11-14
Text in
README.md
Text sha256
a0cc8998a20499432b28b6575f3046b714938eb8e11b8d59a1d25ddf3716061e
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: HuggingFaceFW <huggingface.co/HuggingFaceFW>Newsgroups: alt.freeweights.datasetsSubject: fineweb-eduDate: 2026-11-14Commit: 87f0914Signed: 2DC28CC7B26A283B ✓
Upstream
HuggingFaceFW/fineweb-edu
Pinned commit
87f09149ef4734204d70ed1d046ddc9ca3f2b8f9
Manifest
fineweb-edu.json · .minisig
Manifest sha256
683d9645734939de2cb9f57d306363f98493c498dbe88e2f8a53d02d55ff62a6
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 14:45 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/HuggingFaceFW/fineweb-edu.json $ curl -O https://freeweights.allternit.com/manifests/HuggingFaceFW/fineweb-edu.json.minisig $ minisign -Vm fineweb-edu.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download HuggingFaceFW/fineweb-edu
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. fineweb-edu.json. Provenance. Takedown history: none.
From: livecodebench <huggingface.co/livecodebench>Subject: code_generation_lite
From: allenai <huggingface.co/allenai>Subject: tulu-3-sft-mixture
From: Idavidrein <huggingface.co/Idavidrein>Subject: gpqa
From: openai <huggingface.co/openai>Subject: gsm8k
From: Anthropic <huggingface.co/Anthropic>Subject: hh-rlhf
From: TIGER-Lab <huggingface.co/TIGER-Lab>Subject: MMLU-Pro