From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.nemotronSubject: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 Date: 2026-11-15Commit: 950f6c7Signed: 2DC28CC7B26A283B ✓ Text generation model with 31.6B parameters. Safetensors weights, 16.8 GB in all. Published by mlx-community under OpenMDW-1.1.
31.6B params 16.8 GB NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 safetensors custom terms Facts Params 31.6B Size 16.8 GB Formats safetensors Task text generation License OpenMDW-1.1 custom terms read terms
fw
# custom terms: read the license before you download
$ fw get mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4
# manifest sha256 e6d11b90cda2… · 16.8 GB · 12 files
$ fw verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4Hosted (signed) mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 Last check: 2026-11-15 00:21 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 .
Works with
Runs with Ranked by fit to this model (safetensors), then by GitHub stars.
Show all 24 Fine-tune with Show all 29
Overview
Size 16.8 GB
Weights 16.8 GB (safetensors)
Parameters 31.6B
Formats safetensors
Task text generation
License OpenMDW-1.1 (custom)
Files 12, each with a sha256
Publisher mlx-community
Added 2026-11-15
Section alt.freeweights.nemotron Lineage
Original release from the publisher.
Base model: nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
Where these bytes come from
Publisher at the pinned commit →You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
Badge Host Last check Result huggingface.co 2026-11-15 00:21 UTC passed
Model card From the publisher at commit
950f6c7 . Shown as plain text with links; images open at the publisher.
This model mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 was converted to MLX format from nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 using mlx-lm version 0.31.3 (MXFP4, group size 32).
NVIDIA-Nemotron-3.5-Lightning-30B-A3B is a hybrid Mamba-2 / attention Mixture-of-Experts model (~31B total parameters, ~3B active per token).
Use with mlx#
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4")
prompt = "Hello, who are you?"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True) Files 12 files · 16.8 GB Weights 16.8 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 12 files with their sha256 File Size sha256 .gitattributes 1.57 KB 34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930 README.md 1.44 KB 79b85b10db21c7b8d0e870c3c2a53560206e4e9912c1e42eea7194c09fc8eb3e chat_template.jinja 9.87 KB 58933db77d3099b4f78c55a38347a72e1ea05b97d6bd8f38775303dc0194e0a9 config.json 2.93 KB e56a375199cdb1d80093efe0a2313ba412a980f09b17227ade86761cc8160eb0 generation_config.json 210 B 0ed94823ae737b507aef6af01e837041b7aa2fb0306793a310cd201d89a31ff4 model-00001-of-00004.safetensors 5.21 GB bf8fea327ab2dfd8f0847fc9f78e8b5eb3a4e1d550fe5bdfc91a2b81a2457b48 model-00002-of-00004.safetensors 5.35 GB 363fb211de92122414dd2fcabb76f5361e2d48d5c8a6cdcbab2a1f3fa1c55fca model-00003-of-00004.safetensors 5.36 GB 56d7c20d25e0518cac88ec6bf11ed2d785cb8a36804fbd0565870406bae9bcfa model-00004-of-00004.safetensors 877 MB eb6886fa30bba96d0968871d2e89a773ac6fce57eea09ac648a5d9b61fae72fd model.safetensors.index.json 50.2 KB 80858fd795e2ae38f3d82c6fc5240e34f2959e0cb6656f4818b064767d9c5f86 tokenizer.json 17.1 MB 623c34567aebb18582765289fbe23d901c62704d6518d71866e0e58db892b5b7 tokenizer_config.json 430 B ec380f0a6c0c2e294eb2435f5ec521fb2121cfc970e6ebf023d06829714a4eaa
Versions Each time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commit Date Contents 950f6c7321 pinned now 2026-11-15 00:21 UTC 12 files · 16.8 GB
Use it fw
# custom terms: read the license before you download
$ fw get mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4
# manifest sha256 e6d11b90cda2… · 16.8 GB · 12 files
$ fw verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4Terms that come with these files. OpenMDW 1.1: keep the agreement and the copyright notices with the files when you pass them on.
Custom license (custom). Read the license text first. Open this panel to show the commands once you accept its terms. fw.py Checks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4.json --dir ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4
$ python3 fw.py verify ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 ./mlx-community__NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4.jsonhf The Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 --revision 950f6c73210db5f782a26d873977189f96d5efc1 --local-dir ./NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4transformers Load the weights in Python.
import os
os.environ["HF_ENDPOINT" ] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4", revision="950f6c73210db5f782a26d873977189f96d5efc1")
model = AutoModelForCausalLM.from_pretrained("mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4", revision="950f6c73210db5f782a26d873977189f96d5efc1", device_map="auto")vLLM Serve an OpenAI-compatible API.
$ HF_ENDPOINT =https://freeweights.allternit.com vllm serve mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 --revision 950f6c73210db5f782a26d873977189f96d5efc1License Name OpenMDW-1.1 Id OpenMDW-1.1 Class Custom terms Redistribution click-through Listing Hosted (signed) Terms OpenMDW 1.1: keep the agreement and the copyright notices with the files when you pass them on. Decided License as declared by the publisher. No person read it. 2026-11-15 Text in README.md Text sha256 79b85b10db21c7b8d0e870c3c2a53560206e4e9912c1e42eea7194c09fc8eb3e Terms gate Yes. The commands stay folded until you open them after reading the license. Read the license text
Licenses are checked against the license table . A custom license passes only after a person reads it.
Provenance From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.nemotronSubject: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4 Date: 2026-11-15Commit: 950f6c7Signed: 2DC28CC7B26A283B ✓ How to verify
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4.json
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4.json.minisig
$ minisign -Vm NVIDIA-Nemotron-3.5-Lightning-30B-A3B-mxfp4.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tab A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree No model in the catalog names this one as its parent.
8.2B params 16.5 GB a3-rl-laion_nemotron-gym-agent-calendar-80-8B safetensors permissive Facts Params 8.2B Size 16.5 GB Formats safetensors Task reinforcement learning License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-laion_nemotron-gym-agent-calendar-80-8B 15B params 30.0 GB Apriel-Nemotron-15b-Thinker safetensors permissive Facts Params 15B Size 30.0 GB Formats safetensors Task text generation License MIT permissive flip From: ServiceNow-AI <huggingface.co/ServiceNow-AI> Subject: Apriel-Nemotron-15b-Thinker nemotron 45.3 GB Apriel-Nemotron-15b-Thinker-GGUF gguf permissive Facts Params not stated Size 45.3 GB Formats gguf Task text generation License MIT permissive flip From: <huggingface.co/lmstudio-community> Subject: Apriel-Nemotron-15b-Thinker-GGUF 99M params 710 MB Nemotron-3-Diarization gguf safetensors custom terms Facts Params 99M Size 710 MB Formats gguf, safetensors Task voice activity detection License OpenMDW-1.1 custom terms read terms flip From: <huggingface.co/nvidia> Subject: Nemotron-3-Diarization 638M params 5.66 GB nemotron-3.5-asr-streaming-0.6b gguf safetensors custom terms Facts Params 638M Size 5.66 GB Formats gguf, safetensors Task automatic speech recognition License OpenMDW-1.1 custom terms read terms flip From: <huggingface.co/nvidia> Subject: nemotron-3.5-asr-streaming-0.6b nemotron 236 GB nvidia_OpenCodeReasoning-Nemotron-14B-GGUF gguf permissive Facts Params not stated Size 236 GB Formats gguf Task text generation License Apache-2.0 permissive flip From: bartowski <huggingface.co/bartowski> Subject: nvidia_OpenCodeReasoning-Nemotron-14B-GGUF
mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.nemotronSubject: 
lmstudio-community 
nvidia