CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.nemotron / NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.nemotronSubject:

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit

Date: 2026-11-15Commit: 881a85fSigned: 2DC28CC7B26A283B ✓

Text generation model with 31.6B parameters. Safetensors weights, 33.6 GB in all. Published by mlx-community under OpenMDW-1.1.

31.6B params33.6GBNVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bitsafetensorscustom terms
FactsParams31.6BSize33.6 GBFormatssafetensorsTasktext generationLicenseOpenMDW-1.1From sourcecustom termsread terms
# custom terms: read the license before you download
$ fw get mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
# manifest sha256 8bfaaf123cd3… · 33.6 GB · 15 files
$ fw verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
From sourceHosted (signed)mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bitLast check: 2026-11-15 00:21 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16.

Works with

Run24Fine-tune29Convert15Evaluate13Scan13Apps58
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
33.6 GB
Weights
33.6 GB (safetensors)
Parameters
31.6B
Formats
safetensors
Task
text generation
License
OpenMDW-1.1 (custom)
Files
15, each with a sha256
Publisher
mlx-community
Added
2026-11-15
Section
alt.freeweights.nemotron
Lineage

Original release from the publisher.

Base model: nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 00:21 UTCpassed

Model card

From the publisher at commit 881a85f. Shown as plain text with links; images open at the publisher.

mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit#

This model mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit was converted to MLX format from nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 using mlx-lm version 0.31.3 (8-bit, group size 64).

NVIDIA-Nemotron-3.5-Lightning-30B-A3B is a hybrid Mamba-2 / attention Mixture-of-Experts model (~31B total parameters, ~3B active per token).

Use with mlx#

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit")

prompt = "Hello, who are you?"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Files

15 files · 33.6 GBWeights 33.6 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 15 files with their sha256
FileSizesha256
.gitattributes1.57 KB34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
README.md1.44 KBf25d22a34e28a1bca15a1a82e373e714e7357f8a5ced0535e0953a61b7939990
chat_template.jinja9.87 KB58933db77d3099b4f78c55a38347a72e1ea05b97d6bd8f38775303dc0194e0a9
config.json2.93 KBa1b0135c0973322d188a836c86746e69ea07c02b241e1f26681bf5123345359b
generation_config.json210 B0ed94823ae737b507aef6af01e837041b7aa2fb0306793a310cd201d89a31ff4
model-00001-of-00007.safetensors5.36 GB7ce9d0b7b01bb133ebf089a65dbcce23dcf35d73eb28dfa20b639a21e86711f3
model-00002-of-00007.safetensors5.05 GBad229b96564455b865364db16918a557d55f21199e4ff7a9d0e0952e56c5c9e0
model-00003-of-00007.safetensors4.96 GBa2c01a7ae42cc9881768fc3f4c1820a86c00766f8f88f154fd17e32d10ed1a46
model-00004-of-00007.safetensors5.05 GBf9afcd3cedfc7e107b7e199fea995d105ee2ad56929fd3dd017ce6dd24ea9f55
model-00005-of-00007.safetensors4.94 GBbf8ef73665e3d894d5badd01cef18a99e7da7dcc3a21c52c80a298976499420c
model-00006-of-00007.safetensors5.03 GBbbd2d487828c3e2434ca181673023a1489699a6739c2725250ac0c91d5eb1e17
model-00007-of-00007.safetensors3.17 GB01b0ace9963a901962e9bbe492d66faa5a0ed47b09ade9da5529375694fa770e
model.safetensors.index.json65.4 KB14f9c8d6ff717ea35d64585e4f723544aa0964d7492c10dbf2e27a1ee29a87e5
tokenizer.json17.1 MB623c34567aebb18582765289fbe23d901c62704d6518d71866e0e58db892b5b7
tokenizer_config.json430 Bec380f0a6c0c2e294eb2435f5ec521fb2121cfc970e6ebf023d06829714a4eaa
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
881a85f9e8 pinned now2026-11-15 00:21 UTC15 files · 33.6 GB

Use it

# custom terms: read the license before you download
$ fw get mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
# manifest sha256 8bfaaf123cd3… · 33.6 GB · 15 files
$ fw verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
Terms that come with these files. OpenMDW 1.1: keep the agreement and the copyright notices with the files when you pass them on.
Custom license (custom). Read the license text first. Open this panel to show the commands once you accept its terms.
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit.json --dir ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit $ python3 fw.py verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit ./mlx-community__NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit --revision 881a85f9e84dac5ab1a61d4493739b5ef67efeaa --local-dir ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForCausalLM, AutoTokenizer tok = AutoTokenizer.from_pretrained("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit", revision="881a85f9e84dac5ab1a61d4493739b5ef67efeaa") model = AutoModelForCausalLM.from_pretrained("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit", revision="881a85f9e84dac5ab1a61d4493739b5ef67efeaa", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit --revision 881a85f9e84dac5ab1a61d4493739b5ef67efeaa
Run at home

License

Name
OpenMDW-1.1
Id
OpenMDW-1.1
Class
Custom terms
Redistribution
click-through
Listing
Hosted (signed)
Terms
OpenMDW 1.1: keep the agreement and the copyright notices with the files when you pass them on.
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
f25d22a34e28a1bca15a1a82e373e714e7357f8a5ced0535e0953a61b7939990
Terms gate
Yes. The commands stay folded until you open them after reading the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.nemotronSubject: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bitDate: 2026-11-15Commit: 881a85fSigned: 2DC28CC7B26A283B ✓
Upstream
mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
Pinned commit
881a85f9e84dac5ab1a61d4493739b5ef67efeaa
Manifest
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit.json · .minisig
Manifest sha256
8bfaaf123cd384b2c8a57ccd3ed13670302fe08af7e54805ff0fadca05357ec2
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 00:21 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit.json $ curl -O https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit.json.minisig $ minisign -Vm NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Read license, then download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit.json. Provenance. Takedown history: none.
Source
huggingface.co/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-8bit

Related models

All of alt.freeweights.nemotron →
From: laion <huggingface.co/laion>Subject: a3-rl-laion_nemotron-gym-agent-calendar-80-8B
From: ServiceNow-AI <huggingface.co/ServiceNow-AI>Subject: Apriel-Nemotron-15b-Thinker
From: lmstudio-community <huggingface.co/lmstudio-community>Subject: Apriel-Nemotron-15b-Thinker-GGUF
From: nvidia <huggingface.co/nvidia>Subject: Nemotron-3-Diarization
From: nvidia <huggingface.co/nvidia>Subject: nemotron-3.5-asr-streaming-0.6b
From: bartowski <huggingface.co/bartowski>Subject: nvidia_OpenCodeReasoning-Nemotron-14B-GGUF