CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.nemotron / open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
From: laion <huggingface.co/laion>Newsgroups: alt.freeweights.nemotronSubject:

open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096

Date: 2026-11-15Commit: 2377259Signed: 2DC28CC7B26A283B ✓

Model with 1.7B parameters. Safetensors weights, 3.43 GB in all. Published by laion under Apache-2.0.

1.7B params3.43GBopen-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096safetensorspermissive
FactsParams1.7BSize3.43 GBFormatssafetensorsTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
# manifest sha256 3764faebb978… · 3.43 GB · 10 files
$ fw verify ./open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096 laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
From sourceHosted (signed)laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096Last check: 2026-11-15 04:24 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run8Fine-tune7Convert8Scan2

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

TransformersLocalAItinygradTriton Inference ServerBentoMLCTranslate2ExLlamaV2LitServe
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
3.43 GB
Weights
3.43 GB (safetensors)
Parameters
1.7B
Formats
safetensors
Task
not tagged
License
Apache-2.0 (permissive)
Files
10, each with a sha256
Publisher
laion
Added
2026-11-15
Section
alt.freeweights.nemotron
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:24 UTCpassed

Model card

From the publisher at commit 2377259. Shown as plain text with links; images open at the publisher.

Nemotron-CC-2024 HQ web + MixtureVitae reasoning/instruct subset, 1.7B / 100B tokens, 4096 ctx#

Base model. Blend is 42.06% MV reasoning+instruct / 57.94% Nemotron-CC, matching MixtureVitae's own measured reasoning share (175.15B reasoning of 416.45B full MV, both in GPT-NeoX). At 100B that is 0.24 epochs over the reasoning subset — no data repetition.

Context#

Part of a 2x2 study for the NeurIPS 2026 submission Strong Post-Training from Permissive, Reasoning-Dominant, Web-Scale Pretraining (rebuttal experiments), isolating web corpus from reasoning enrichment:

reasoning front-loadedno front-loading
MV webMV-100BTMV-noinstruct
Nemotron webnemotron-hq-mv_reasoning-100Bnemotron-hq-100B

The clean, unconfounded contrast is nemotron-hq-mv_reasoning-100B vs nemotron-hq-100B: same web substrate, same recipe, same tokenizer, same EOD convention — the only difference is the presence of the reasoning/instruct data.

Framing note. MixtureVitae's reasoning subset is itself permissively licensed, so the mv_reasoning model is a web-substrate swap (non-permissive web + permissive reasoning), not a fully non-permissive corpus. Please describe it as "Nemotron-CC web + MV reasoning subset".

Pretraining#

  • 1.7B dense, open-sci-ref protocol, GPT-NeoX tokenizer (vocab 50304, uint16)
  • 100B tokens, 23,842 iters, seq len 4096, RoPE theta 100k
  • WSD schedule, lr 4e-3, 20% linear cooldown, global batch 1024
  • 64 nodes x 4 GH200

Note on modeling_opensci.py#

Patched so OpensciModel.forward accepts **kwargs. Recent transformers passes num_items_in_batch down from Trainer for correct loss averaging, and OpensciForCausalLM.forward forwards **kwargs into both self.model(...) and self.loss_function(...). Without the patch training fails with TypeError: OpensciModel.forward() got an unexpected keyword argument 'num_items_in_batch'. Loss behaviour is unchanged.

Files

10 files · 3.43 GBWeights 3.43 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 10 files with their sha256
FileSizesha256
.gitattributes1.52 KB11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361
README.md2.19 KBe494cc09c67771a7df9690ea8e73f8bce23de5f9aa417581741bbd8fbd3ef75e
config.json951 Bb2d8faeee3c63b0355d0b17be3a2a1adc29d112a7be962ade812730203a3f5d9
configuration_opensci.py11.2 KBd3d0e71d723af0bfb561cea4bcc30b6e72ad761d5828bc5910137c8fb05686e8
model.safetensors3.43 GB77b67e1c66994e76e93ae3eb1385f3c6c75df273a699b9bad80089b900ce9072
modeling_opensci.py46.0 KBcf603acb76bcbe41654dede4d3e933700c06e33480892410bb92c067df38b354
special_tokens_map.json99 B6f50ab5a5a509a1c309d6171f339b196a900dc9c99ad0408ff23bb615fdae7ad
tokenizer.json2.47 MBec642759cd0a96a69b570c14ab9d40a4ccf1be3a8f640b652589865bfcd9ca90
tokenizer_config.json169 B338355775a7f90b18e69d5bfdc684c2018d90c6cda9532c526b86939237072e4
vocab.json1.18 MB8388db73145fb44a7eda80049ce0f9bd6753165df1d66fce9423c127c5dbf83d
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
2377259442 pinned now2026-11-15 04:24 UTC10 files · 3.43 GB

Use it

$ fw get laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
# manifest sha256 3764faebb978… · 3.43 GB · 10 files
$ fw verify ./open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096 laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096.json --dir ./open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096 $ python3 fw.py verify ./open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096 ./laion__open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096 --revision 2377259442a01dce892e2fcf70917f656540ce39 --local-dir ./open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
e494cc09c67771a7df9690ea8e73f8bce23de5f9aa417581741bbd8fbd3ef75e
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: laion <huggingface.co/laion>Newsgroups: alt.freeweights.nemotronSubject: open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096Date: 2026-11-15Commit: 2377259Signed: 2DC28CC7B26A283B ✓
Upstream
laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
Pinned commit
2377259442a01dce892e2fcf70917f656540ce39
Manifest
open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096.json · .minisig
Manifest sha256
3764faebb9787d279eeee79711424057a4feaf123423fda90b18d74d870189fd
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:24 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096.json $ curl -O https://freeweights.allternit.com/manifests/laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096.json.minisig $ minisign -Vm open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096.json. Provenance. Takedown history: none.
Source
huggingface.co/laion/open-sci-ref-1.7b-nemotron-hq-mv_reasoning-100B-4096

Related models

All of alt.freeweights.nemotron →
From: laion <huggingface.co/laion>Subject: a3-rl-laion_nemotron-gym-agent-calendar-80-8B
From: ServiceNow-AI <huggingface.co/ServiceNow-AI>Subject: Apriel-Nemotron-15b-Thinker
From: lmstudio-community <huggingface.co/lmstudio-community>Subject: Apriel-Nemotron-15b-Thinker-GGUF
From: nvidia <huggingface.co/nvidia>Subject: Nemotron-3-Diarization
From: nvidia <huggingface.co/nvidia>Subject: nemotron-3.5-asr-streaming-0.6b
From: bartowski <huggingface.co/bartowski>Subject: nvidia_OpenCodeReasoning-Nemotron-14B-GGUF