CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.nemotron / open-sci-ref-1.7b-nemotron-hq-100B-4096
From: laion <huggingface.co/laion>Newsgroups: alt.freeweights.nemotronSubject:

open-sci-ref-1.7b-nemotron-hq-100B-4096

Date: 2026-11-15Commit: f68b476Signed: 2DC28CC7B26A283B ✓

Model with 1.7B parameters. Safetensors weights, 3.43 GB in all. Published by laion under Apache-2.0.

1.7B params3.43GBopen-sci-ref-1.7b-nemotron-hq-100B-4096safetensorspermissive
FactsParams1.7BSize3.43 GBFormatssafetensorsTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get laion/open-sci-ref-1.7b-nemotron-hq-100B-4096
# manifest sha256 f6874b00fe9b… · 3.43 GB · 10 files
$ fw verify ./open-sci-ref-1.7b-nemotron-hq-100B-4096 laion/open-sci-ref-1.7b-nemotron-hq-100B-4096
From sourceHosted (signed)laion/open-sci-ref-1.7b-nemotron-hq-100B-4096Last check: 2026-11-15 04:23 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run8Fine-tune7Convert8Scan2

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

TransformersLocalAItinygradTriton Inference ServerBentoMLCTranslate2ExLlamaV2LitServe
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
3.43 GB
Weights
3.43 GB (safetensors)
Parameters
1.7B
Formats
safetensors
Task
not tagged
License
Apache-2.0 (permissive)
Files
10, each with a sha256
Publisher
laion
Added
2026-11-15
Section
alt.freeweights.nemotron
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:23 UTCpassed

Model card

From the publisher at commit f68b476. Shown as plain text with links; images open at the publisher.

Nemotron-CC-2024 HQ (real+synthetic), 1.7B / 100B tokens, 4096 ctx#

Base model. No reasoning enrichment — the no front-loading / non-permissive-web cell.

Context#

Part of a 2x2 study for the NeurIPS 2026 submission Strong Post-Training from Permissive, Reasoning-Dominant, Web-Scale Pretraining (rebuttal experiments), isolating web corpus from reasoning enrichment:

reasoning front-loadedno front-loading
MV webMV-100BTMV-noinstruct
Nemotron webnemotron-hq-mv_reasoning-100Bnemotron-hq-100B

The clean, unconfounded contrast is nemotron-hq-mv_reasoning-100B vs nemotron-hq-100B: same web substrate, same recipe, same tokenizer, same EOD convention — the only difference is the presence of the reasoning/instruct data.

Framing note. MixtureVitae's reasoning subset is itself permissively licensed, so the mv_reasoning model is a web-substrate swap (non-permissive web + permissive reasoning), not a fully non-permissive corpus. Please describe it as "Nemotron-CC web + MV reasoning subset".

Pretraining#

  • 1.7B dense, open-sci-ref protocol, GPT-NeoX tokenizer (vocab 50304, uint16)
  • 100B tokens, 23,842 iters, seq len 4096, RoPE theta 100k
  • WSD schedule, lr 4e-3, 20% linear cooldown, global batch 1024
  • 64 nodes x 4 GH200

Note on modeling_opensci.py#

Patched so OpensciModel.forward accepts **kwargs. Recent transformers passes num_items_in_batch down from Trainer for correct loss averaging, and OpensciForCausalLM.forward forwards **kwargs into both self.model(...) and self.loss_function(...). Without the patch training fails with TypeError: OpensciModel.forward() got an unexpected keyword argument 'num_items_in_batch'. Loss behaviour is unchanged.

Files

10 files · 3.43 GBWeights 3.43 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 10 files with their sha256
FileSizesha256
.gitattributes1.52 KB11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361
README.md1.99 KB8b985283a3eb83cd0a210db9f367a15a086fd73b66a781b56562d6e7e400afe4
config.json951 Bb2d8faeee3c63b0355d0b17be3a2a1adc29d112a7be962ade812730203a3f5d9
configuration_opensci.py11.2 KBd3d0e71d723af0bfb561cea4bcc30b6e72ad761d5828bc5910137c8fb05686e8
model.safetensors3.43 GBab31b32f9b6fe4e3bb8553a50cb6e56a5756c28571d8290259bff5cae0207b29
modeling_opensci.py46.0 KBcf603acb76bcbe41654dede4d3e933700c06e33480892410bb92c067df38b354
special_tokens_map.json99 B6f50ab5a5a509a1c309d6171f339b196a900dc9c99ad0408ff23bb615fdae7ad
tokenizer.json2.47 MBec642759cd0a96a69b570c14ab9d40a4ccf1be3a8f640b652589865bfcd9ca90
tokenizer_config.json169 B338355775a7f90b18e69d5bfdc684c2018d90c6cda9532c526b86939237072e4
vocab.json1.18 MB8388db73145fb44a7eda80049ce0f9bd6753165df1d66fce9423c127c5dbf83d
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
f68b4764de pinned now2026-11-15 04:23 UTC10 files · 3.43 GB

Use it

$ fw get laion/open-sci-ref-1.7b-nemotron-hq-100B-4096
# manifest sha256 f6874b00fe9b… · 3.43 GB · 10 files
$ fw verify ./open-sci-ref-1.7b-nemotron-hq-100B-4096 laion/open-sci-ref-1.7b-nemotron-hq-100B-4096
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/laion/open-sci-ref-1.7b-nemotron-hq-100B-4096.json --dir ./open-sci-ref-1.7b-nemotron-hq-100B-4096 $ python3 fw.py verify ./open-sci-ref-1.7b-nemotron-hq-100B-4096 ./laion__open-sci-ref-1.7b-nemotron-hq-100B-4096.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download laion/open-sci-ref-1.7b-nemotron-hq-100B-4096 --revision f68b4764de30fd027e41fed0eb95eed3f42976ce --local-dir ./open-sci-ref-1.7b-nemotron-hq-100B-4096
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
8b985283a3eb83cd0a210db9f367a15a086fd73b66a781b56562d6e7e400afe4
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: laion <huggingface.co/laion>Newsgroups: alt.freeweights.nemotronSubject: open-sci-ref-1.7b-nemotron-hq-100B-4096Date: 2026-11-15Commit: f68b476Signed: 2DC28CC7B26A283B ✓
Upstream
laion/open-sci-ref-1.7b-nemotron-hq-100B-4096
Pinned commit
f68b4764de30fd027e41fed0eb95eed3f42976ce
Manifest
open-sci-ref-1.7b-nemotron-hq-100B-4096.json · .minisig
Manifest sha256
f6874b00fe9bd6fb00b9c8173a357c3cd44c1fa3865a1c7843af8f4e6490f15e
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:23 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/laion/open-sci-ref-1.7b-nemotron-hq-100B-4096.json $ curl -O https://freeweights.allternit.com/manifests/laion/open-sci-ref-1.7b-nemotron-hq-100B-4096.json.minisig $ minisign -Vm open-sci-ref-1.7b-nemotron-hq-100B-4096.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download laion/open-sci-ref-1.7b-nemotron-hq-100B-4096
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. open-sci-ref-1.7b-nemotron-hq-100B-4096.json. Provenance. Takedown history: none.
Source
huggingface.co/laion/open-sci-ref-1.7b-nemotron-hq-100B-4096

Related models

All of alt.freeweights.nemotron →
From: laion <huggingface.co/laion>Subject: a3-rl-laion_nemotron-gym-agent-calendar-80-8B
From: ServiceNow-AI <huggingface.co/ServiceNow-AI>Subject: Apriel-Nemotron-15b-Thinker
From: lmstudio-community <huggingface.co/lmstudio-community>Subject: Apriel-Nemotron-15b-Thinker-GGUF
From: nvidia <huggingface.co/nvidia>Subject: Nemotron-3-Diarization
From: nvidia <huggingface.co/nvidia>Subject: nemotron-3.5-asr-streaming-0.6b
From: bartowski <huggingface.co/bartowski>Subject: nvidia_OpenCodeReasoning-Nemotron-14B-GGUF