From: TIGER-Lab <huggingface.co/TIGER-Lab>Newsgroups: alt.freeweights.datasetsSubject:

MMLU-Pro

Date: 2026-11-14Commit: b189ec7Signed: 2DC28CC7B26A283B ✓

Dataset. Parquet files, 4.21 MB in all. Published by TIGER-Lab under MIT.

datasets4.21MBMMLU-Proparquetpermissive
FactsRowsnot statedSize4.21 MBFormatparquetLicenseMITFrom sourcepermissive
>>> from datasets import load_dataset
>>> ds = load_dataset("TIGER-Lab/MMLU-Pro")
# with HF_ENDPOINT=https://freeweights.allternit.com · manifest sha256 5ab88dbb441a…
From sourceHosted (signed)TIGER-Lab/MMLU-ProLast check: 2026-11-14 06:37 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Overview

Size
4.21 MB
Weights
dataset
Parameters
not stated
Formats
parquet
Task
question answering
License
MIT (permissive)
Files
7, each with a sha256
Publisher
TIGER-Lab
Added
2026-11-14
Section
alt.freeweights.datasets
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 06:37 UTCpassed

Model card

No model card stored here.No README was stored for this model. Read the publisher's page: https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro

Files

7 files · 4.21 MB Sizes and sha256 from the signed manifest.
Hide all 7 files with their sha256
FileSizesha256
.gitattributes2.31 KBf4e703ea6e44bbebe53aceed2a89c11e40b88b7ae130c480c89860ab805ffc8f
README.md11.7 KB4bd710f67da3fa359a33edce1b4b5816b3de416c823c2624ba5e89c2557d2a47
data/test-00000-of-00001.parquet4.14 MB0e24a191921c2f453518a537a8b2117bd137e7714d4ef1565e9ba06c1ecb9ad8
data/validation-00000-of-00001.parquet42.9 KB139423c23722e480c807ac4a191409a710cfce4eba744c1d641cf88e730e2078
eval.yaml590 B2c40150225e27de8529ee29c19ce26ad2d53ee1add6b871c495250668b538e1c
run_claude3.py2.72 KB95165af65f5a98a9e26e6a3ef8effd9bbc000e47b0b28845c0a6384096a302be
run_gpt4o.py2.98 KBc51204e2ee4a7e2aa0f1082a7ffef0d6a2752450525b3c62d444d743f6fdb54f
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
b189ec765a pinned now2026-11-14 06:37 UTC7 files · 4.21 MB

Use it

>>> from datasets import load_dataset
>>> ds = load_dataset("TIGER-Lab/MMLU-Pro")
# with HF_ENDPOINT=https://freeweights.allternit.com · manifest sha256 5ab88dbb441a…
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/TIGER-Lab/MMLU-Pro.json --dir ./MMLU-Pro $ python3 fw.py verify ./MMLU-Pro ./TIGER-Lab__MMLU-Pro.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download TIGER-Lab/MMLU-Pro --revision b189ec765aa7ed75c8acfea42df31fdae71f97be --local-dir ./MMLU-Pro
datasetsLoad it with the datasets library.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from datasets import load_dataset ds = load_dataset("TIGER-Lab/MMLU-Pro", revision="b189ec765aa7ed75c8acfea42df31fdae71f97be")

License

Name
MIT License
Id
MIT
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
Checked and recorded in the license audit. 2026-11-14
Text in
README.md
Text sha256
4bd710f67da3fa359a33edce1b4b5816b3de416c823c2624ba5e89c2557d2a47
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: TIGER-Lab <huggingface.co/TIGER-Lab>Newsgroups: alt.freeweights.datasetsSubject: MMLU-ProDate: 2026-11-14Commit: b189ec7Signed: 2DC28CC7B26A283B ✓
Upstream
TIGER-Lab/MMLU-Pro
Pinned commit
b189ec765aa7ed75c8acfea42df31fdae71f97be
Manifest
MMLU-Pro.json · .minisig
Manifest sha256
5ab88dbb441aeb4071c00e6281f362ff91a981ed59930315e810ef09cccecf42
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 06:37 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/TIGER-Lab/MMLU-Pro.json $ curl -O https://freeweights.allternit.com/manifests/TIGER-Lab/MMLU-Pro.json.minisig $ minisign -Vm MMLU-Pro.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download TIGER-Lab/MMLU-Pro
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. MMLU-Pro.json. Provenance. Takedown history: none.
From: livecodebench <huggingface.co/livecodebench>Subject: code_generation_lite
From: allenai <huggingface.co/allenai>Subject: tulu-3-sft-mixture
From: HuggingFaceFW <huggingface.co/HuggingFaceFW>Subject: fineweb-edu
From: Idavidrein <huggingface.co/Idavidrein>Subject: gpqa
From: openai <huggingface.co/openai>Subject: gsm8k
From: Anthropic <huggingface.co/Anthropic>Subject: hh-rlhf