CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.nemotron / NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.nemotronSubject:

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8

Date: 2026-11-15Commit: 69776f5Signed: 2DC28CC7B26A283B ✓

Text generation model with 31.6B parameters. Safetensors weights, 32.6 GB in all. Published by mlx-community under OpenMDW-1.1.

31.6B params32.6GBNVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8safetensorscustom terms
FactsParams31.6BSize32.6 GBFormatssafetensorsTasktext generationLicenseOpenMDW-1.1From sourcecustom termsread terms
# custom terms: read the license before you download
$ fw get mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
# manifest sha256 3e1aae02ee94… · 32.6 GB · 15 files
$ fw verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8 mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
From sourceHosted (signed)mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8Last check: 2026-11-15 00:22 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16.

Works with

Run24Fine-tune29Convert15Evaluate13Scan13Apps58
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
32.6 GB
Weights
32.6 GB (safetensors)
Parameters
31.6B
Formats
safetensors
Task
text generation
License
OpenMDW-1.1 (custom)
Files
15, each with a sha256
Publisher
mlx-community
Added
2026-11-15
Section
alt.freeweights.nemotron
Lineage

Original release from the publisher.

Base model: nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 00:22 UTCpassed

Model card

From the publisher at commit 69776f5. Shown as plain text with links; images open at the publisher.

mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8#

This model mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8 was converted to MLX format from nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 using mlx-lm version 0.31.3 (MXFP8, group size 32).

NVIDIA-Nemotron-3.5-Lightning-30B-A3B is a hybrid Mamba-2 / attention Mixture-of-Experts model (~31B total parameters, ~3B active per token).

Use with mlx#

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8")

prompt = "Hello, who are you?"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Files

15 files · 32.6 GBWeights 32.6 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 15 files with their sha256
FileSizesha256
.gitattributes1.57 KB34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
README.md1.44 KBcc9241409755d3be9038e628715008ba191831e7c2628e0db3e84fc2c56a8b8d
chat_template.jinja9.87 KB58933db77d3099b4f78c55a38347a72e1ea05b97d6bd8f38775303dc0194e0a9
config.json2.93 KBea60c131bfcd161acadfaebc74a0c9c5a683622d1ceea005b0f72eb16ecac811
generation_config.json210 B0ed94823ae737b507aef6af01e837041b7aa2fb0306793a310cd201d89a31ff4
model-00001-of-00007.safetensors5.22 GB0ac1637249f5b772970d7b418f111775e454d47237daba9c0888dfd20829c8d7
model-00002-of-00007.safetensors4.88 GBa53bc718b99818b0e12c6948f5cefbc49c4f745a74904b08ce1f09b5ceac4157
model-00003-of-00007.safetensors4.82 GBe29fac529c255c9814841c4364cb2434fd936989272ae5501dac8bbb3d1e8b72
model-00004-of-00007.safetensors4.90 GBff5cf070add1b39beccfb3062bfb7c170437cede9ef9da1c6873e617359451b3
model-00005-of-00007.safetensors4.79 GBce5156c6c7f17c28389dfd75906b01a574c17ef2d77f090271ce241c820a9485
model-00006-of-00007.safetensors4.88 GBe6a9f94b67f79b9e9fc22caed1c6fc977992ab45d264dfe7b28d54f7e02cc053
model-00007-of-00007.safetensors3.08 GBa141a34e891a82b787e26ae3089d3f4f0dbb4e7b3e4dad26a91f4785320b8732
model.safetensors.index.json50.2 KB6b1ebae1d3a40bf1eb6539a2fe2ec46e283c7baa1411af1b5c4bf70b66fda29b
tokenizer.json17.1 MB623c34567aebb18582765289fbe23d901c62704d6518d71866e0e58db892b5b7
tokenizer_config.json430 Bec380f0a6c0c2e294eb2435f5ec521fb2121cfc970e6ebf023d06829714a4eaa
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
69776f59ea pinned now2026-11-15 00:22 UTC15 files · 32.6 GB

Use it

# custom terms: read the license before you download
$ fw get mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
# manifest sha256 3e1aae02ee94… · 32.6 GB · 15 files
$ fw verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8 mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
Terms that come with these files. OpenMDW 1.1: keep the agreement and the copyright notices with the files when you pass them on.
Custom license (custom). Read the license text first. Open this panel to show the commands once you accept its terms.
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8.json --dir ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8 $ python3 fw.py verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8 ./mlx-community__NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8 --revision 69776f59ea03d25b8b7e091bf60df396b3a2fda8 --local-dir ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForCausalLM, AutoTokenizer tok = AutoTokenizer.from_pretrained("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8", revision="69776f59ea03d25b8b7e091bf60df396b3a2fda8") model = AutoModelForCausalLM.from_pretrained("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8", revision="69776f59ea03d25b8b7e091bf60df396b3a2fda8", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8 --revision 69776f59ea03d25b8b7e091bf60df396b3a2fda8
Run at home

License

Name
OpenMDW-1.1
Id
OpenMDW-1.1
Class
Custom terms
Redistribution
click-through
Listing
Hosted (signed)
Terms
OpenMDW 1.1: keep the agreement and the copyright notices with the files when you pass them on.
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
cc9241409755d3be9038e628715008ba191831e7c2628e0db3e84fc2c56a8b8d
Terms gate
Yes. The commands stay folded until you open them after reading the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.nemotronSubject: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8Date: 2026-11-15Commit: 69776f5Signed: 2DC28CC7B26A283B ✓
Upstream
mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
Pinned commit
69776f59ea03d25b8b7e091bf60df396b3a2fda8
Manifest
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8.json · .minisig
Manifest sha256
3e1aae02ee94fa48bc83c3701c00986f5dccf37b313d93263df5fd4bbba730a8
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 00:22 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8.json $ curl -O https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8.json.minisig $ minisign -Vm NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Read license, then download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8.json. Provenance. Takedown history: none.
Source
huggingface.co/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp8

Related models

All of alt.freeweights.nemotron →
From: laion <huggingface.co/laion>Subject: a3-rl-laion_nemotron-gym-agent-calendar-80-8B
From: ServiceNow-AI <huggingface.co/ServiceNow-AI>Subject: Apriel-Nemotron-15b-Thinker
From: lmstudio-community <huggingface.co/lmstudio-community>Subject: Apriel-Nemotron-15b-Thinker-GGUF
From: nvidia <huggingface.co/nvidia>Subject: Nemotron-3-Diarization
From: nvidia <huggingface.co/nvidia>Subject: nemotron-3.5-asr-streaming-0.6b
From: bartowski <huggingface.co/bartowski>Subject: nvidia_OpenCodeReasoning-Nemotron-14B-GGUF