alt.freeweights.* · 29 sections · 8900 models listed (2868 shown under their base as variants) · collection

GGUF for llama.cpp and Ollama

Repos with GGUF files, ready for llama.cpp, Ollama and LM Studio.

Filters

Sections

alt.freeweights.*6279 qwen655 deepseek82 kimi34 glm182 minimax29 mimo11 gemma376 gpt-oss9 olmo575 nemotron109 phi66 mistral118 granite162 smollm49 minicpm106 llama254 lfm74 text1134 speech186 embed219 vision1225 image199 video73 music16 ocr1 datasets11 tools247 abliterated77 allternit

Collections

Runs on a 256 GB Mac3692 Small enough for a laptop2556 Embeddings and rerankers290 Speech276 GGUF for llama.cpp and Ollama694 Open datasets11 Runs on a phone450 Runs on a laptop864 Needs a workstation455 Runs in the browser338

Filter

Sectiontext266llama115gemma54nemotron51qwen45abliterated43

Show 16 more

minicpm20lfm16minimax12kimi11glm10mistral10deepseek9granite5phi5speech5embed4vision4smollm3image2olmo2video2

Tasktext generation496not tagged85image text to text77any to any13feature extraction7translation4

Show 6 more

automatic speech recognition3text to speech3image to video2sentence similarity2text to 3d1voice activity detection1

License classLicense not reviewed (link only)415Gated (link only)186Permissive65Custom terms18Non-commercial (link only)9Territory-limited (link only)1

Formatgguf694safetensors30onnx2openvino2

SizeUnder 4 GB494 to 40 GB13540 to 200 GB255200 GB and up255

ListingFrom the publisher · License not reviewed415From the publisher · Gated186Hosted (signed)83From the publisher · Non-commercial9From the publisher · Territory-limited1

Bytes fromFrom the publisher611From source83

TermsNo extra terms65Requires accepting terms629

ParametersUnder 1B231B to 3B663B to 6B646B to 9B1479B to 12B2412B to 24B67

Show 6 more

24B to 32B3832B to 64B4364B to 128B77128B to 500B5Over 500B3Not stated137

LibraryGGUF694transformers183PyTorch40safetensors34PEFT19JAX4

Show 4 more

sentence-transformers4ONNX2OpenVINO2Transformers.js2

LanguageEnglish310Spanish66French66Chinese64German55Portuguese55

Show 154 more

Italian51Hindi37Korean37Thai34Japanese32Arabic27Vietnamese22Multilingual21Indonesian19Russian18Polish17Dutch12Czech11Greek11Hungarian11Romanian11Swedish11Turkish11Ukrainian11Bulgarian10Danish10Finnish10Slovak10Bangla9Estonian9Gujarati9Hebrew9Croatian9Kannada9Lithuanian9Latvian9Malayalam9Marathi9Norwegian9Punjabi9Slovenian9Tamil9Telugu9Odia8Filipino8Assamese7Catalan7Basque7Persian7Georgian7Malay7Urdu7Afrikaans6Amharic6Azerbaijani6Belarusian6Breton6Bosnian6Welsh6Esperanto6Western Frisian6Irish6Scottish Gaelic6Galician6Hausa6Armenian6Icelandic6Javanese6Kazakh6Khmer6Kurdish6Kyrgyz6Latin6Lao6Malagasy6Macedonian6Mongolian6Maltese6Burmese6Nepali6Oromo6Pashto6Sanskrit6Sindhi6Sinhala6Somali6Albanian6Serbian6Sundanese6Swahili6Uyghur6Uzbek6Xhosa6Yiddish6Afar4Akan4Avaric4Aymara4Bashkir4Bislama4Bambara4Tibetan4Chechen4Chamorro4Corsican4Chuvash4Divehi4Dzongkha4Ewe4Fula4Fijian4Faroese4Guarani4Manx4Hiri Motu4Haitian Creole4Igbo4Inuktitut4Kongo4Kuanyama4Kalaallisut4Kashmiri4Komi4Cornish4Luxembourgish4Ganda4Lingala4Luba-Katanga4Marshallese4Māori4South Ndebele4Navajo4Nyanja4Occitan4Ojibwa4Ossetic4Quechua4Romansh4Rundi4Kinyarwanda4Northern Sami4Sango4Samoan4Shona4Swati4Southern Sotho4Tajik4Tigrinya4Turkmen4Tswana4Tongan4Tsonga4Tatar4Venda4Walloon4Wolof4Yoruba4Zhuang4Zulu4

Appsllama.cpp684LM Studio684Ollama684Jan675SGLang19vLLM19

Show 1 more

whisper.cpp3

On devicePhone33Laptop63Workstation31In the browser7

Enginellama.cpp76webgpu7mlx4

all 6279 Runs on a 256 GB Mac 3692 Small enough for a laptop 2556 Embeddings and rerankers 290 Speech 276 GGUF for llama.cpp and Ollama 694 Open datasets 11 Runs on a phone 450 Runs on a laptop 864 Needs a workstation 455 Runs in the browser 338 qwen 655 deepseek 82 kimi 34 glm 182 minimax 29 mimo 11 gemma 376 gpt-oss 9 olmo 575 nemotron 109 phi 66 mistral 118 granite 162 smollm 49 minicpm 106 llama 254 lfm 74 text 1134 speech 186 embed 219 vision 1225 image 199 video 73 music 16 ocr 1 datasets 11 tools 247 abliterated 77

Search models/

Sort

694 models

SubjectSizeParamsLicenseDate

NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUFFrom the publisher From: unsloth in alt.freeweights.nemotron510 GB—Not reviewed2026-11-15 dolphin-2.9-llama3-8b-GGUFFrom the publisher From: bartowski in alt.freeweights.llama151 GB—Gated2026-11-15

Kimi-K2-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.kimi16.8 TB—Not reviewed2026-11-15

Step-3.5-Flash-GGUFFrom the publisher From: ggml-org in alt.freeweights.text119 GB—Not reviewed2026-11-15

Llama-3.3-70B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama213 GB—Gated2026-11-15 Qwen2.5-Coder-3B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated49.3 GB—Non-commercial2026-11-15 magnum-v4-12b-GGUFFrom the publisher From: bartowski in alt.freeweights.text197 GB—Not reviewed2026-11-15

Llama-3.1-8B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.llama126 GB—Gated2026-11-15 TheDrummer_Rocinante-X-12B-v1-GGUFFrom the publisher From: bartowski in alt.freeweights.text196 GB—Not reviewed2026-11-15 Dolphin3.0-Llama3.2-3B-GGUFFrom the publisher From: bartowski in alt.freeweights.llama63.0 GB—Gated2026-11-15

GLM-5.3-Flash-abliterated-Maya-M-GGUFHosted (signed) From: alesha-pro in alt.freeweights.abliterated117 GB—Permissive2026-11-14 UI-Venus-2-9B-GGUFFrom the publisher From: bartowski in alt.freeweights.text154 GB—Not reviewed2026-11-15 Hermes-3-Llama-3.1-8B-GGUFFrom the publisher From: bartowski in alt.freeweights.llama125 GB—Gated2026-11-15

Muse-Spark-Open-816B-A42B-GGUFFrom the publisher From: unsloth in alt.freeweights.text2.46 TB—Not reviewed2026-11-15 Meta-Llama-3.1-8B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated125 GB—Gated2026-11-15 huihui-ai_DeepSeek-R1-Distill-Llama-70B-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated834 GB—Not reviewed2026-11-15 Hermes-3-Llama-3.2-3B-GGUFFrom the publisher From: bartowski in alt.freeweights.llama66.7 GB—Gated2026-11-15 MN-12B-Mag-Mell-R1-GGUFFrom the publisher From: bartowski in alt.freeweights.text191 GB—Not reviewed2026-11-15 L3.3-70B-Euryale-v2.3-GGUFFrom the publisher From: bartowski in alt.freeweights.text930 GB—Gated2026-11-15

NVIDIA-Nemotron-3-Nano-4B-GGUFFrom the publisher From: unsloth in alt.freeweights.nemotron72.1 GB—Not reviewed2026-11-15 ukisai_Swift-1.5-Qwen3.8-27b-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen447 GB—Not reviewed2026-11-15 LFM2.5-24B-A2B-GGUFHosted (signed) From: bartowski in alt.freeweights.lfm378 GB—Custom terms2026-11-15

orpheus-3b-0.1-ft-GGUFFrom the publisher From: unsloth in alt.freeweights.speech57.1 GB—Gated2026-11-15 TheDrummer_Rocinante-XL-16B-v1-GGUFFrom the publisher From: bartowski in alt.freeweights.text261 GB—Not reviewed2026-11-15 MiniCPM-V-2_6-ggufFrom the publisher From: openbmb in alt.freeweights.minicpm118 GB—Not reviewed2026-11-15 DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUFFrom the publisher From: bartowski in alt.freeweights.llama125 GB—Gated2026-11-15 Goekdeniz-Guelmez_Josiefied-Qwen3-8B-abliterated-v1-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated130 GB—Not reviewed2026-11-15 Qwen2.5-Coder-1.5B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated29.3 GB—Not reviewed2026-11-15 Llama-3.1-8B-Lexi-Uncensored-V2-GGUFFrom the publisher From: bartowski in alt.freeweights.llama125 GB—Gated2026-11-15

NVIDIA-Nemotron-3-Nano-30B-A3B-GGUFFrom the publisher From: ggml-org in alt.freeweights.nemotron119 GB—Not reviewed2026-11-15 cognitivecomputations_Dolphin3.0-R1-Mistral-24B-GGUFFrom the publisher From: bartowski in alt.freeweights.mistral422 GB—Not reviewed2026-11-15

Nanonets-OCR-s-GGUFFrom the publisher From: unsloth in alt.freeweights.text57.5 GB—Not reviewed2026-11-15

MiniMax-M3-GGUFFrom the publisher From: unsloth in alt.freeweights.minimax6.18 TB—Not reviewed2026-11-15 gemma-2-9b-it-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated166 GB—Gated2026-11-15

HunyuanOCR-GGUFFrom the publisher From: ggml-org in alt.freeweights.text3.39 GB—Territory-limited2026-11-15 kai-os_Grug-12B-GGUFFrom the publisher From: bartowski in alt.freeweights.text198 GB—Not reviewed2026-11-15 TheDrummer_Skyfall-31B-v4.2-GGUFFrom the publisher From: bartowski in alt.freeweights.text517 GB—Not reviewed2026-11-15 Ateron_Gemma-4-Novelist-Eclipse-31B-GGUFFrom the publisher From: bartowski in alt.freeweights.gemma550 GB—Not reviewed2026-11-15

NVIDIA-Nemotron-3-Super-120B-A12B-GGUFFrom the publisher From: unsloth in alt.freeweights.nemotron2.01 TB—Not reviewed2026-11-15

Hermes-4-70B-GGUFFrom the publisher From: unsloth in alt.freeweights.text1.14 TB—Gated2026-11-15 TheDrummer_Orion-26B-A4B-v1-GGUFFrom the publisher From: bartowski in alt.freeweights.text436 GB—Not reviewed2026-11-15 Agnes-AI_Agnes-3.0-Qwen-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen2.91 TB—Not reviewed2026-11-15 Dolphin3.0-Qwen2.5-3b-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen60.0 GB—Non-commercial2026-11-15

Llama-3.2-1B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama3.88 GB—Gated2026-11-15 mlabonne_gemma-3-4b-it-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated66.0 GB—Gated2026-11-15 ukisai_Swift-Qwen3.8-27b-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen447 GB—Not reviewed2026-11-15 OpenGVLab_InternVL3_5-14B-GGUFFrom the publisher From: bartowski in alt.freeweights.text237 GB—Not reviewed2026-11-15

LFM2.5-1.2B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.lfm2.94 GB—Not reviewed2026-11-15 Goekdeniz-Guelmez_Josiefied-Qwen3-14B-abliterated-v3-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated240 GB—Not reviewed2026-11-15 TheDrummer_Fallen-Gemma3-27B-v1-GGUFFrom the publisher From: bartowski in alt.freeweights.gemma435 GB—Not reviewed2026-11-15 tencent_Hunyuan-7B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.text117 GB—Not reviewed2026-11-15 TheDrummer_Cydonia-24B-v4.2.0-GGUFFrom the publisher From: bartowski in alt.freeweights.text377 GB—Not reviewed2026-11-15

MiniMax-M2-GGUFFrom the publisher From: unsloth in alt.freeweights.minimax3.75 TB—Not reviewed2026-11-15 TheDrummer_Artemis-31B-v1.1-GGUFFrom the publisher From: bartowski in alt.freeweights.text527 GB—Not reviewed2026-11-15

Meta-Llama-3-8B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama29.6 GB—Gated2026-11-15 MiniMax-M3-GGUFFrom the publisher From: bartowski in alt.freeweights.minimax5.32 TB—Not reviewed2026-11-15 mlabonne_gemma-3-12b-it-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated195 GB—Gated2026-11-15 TheDrummer_Cydonia-R1-24B-v4.1-GGUFFrom the publisher From: bartowski in alt.freeweights.text377 GB—Not reviewed2026-11-15 mlabonne_gemma-3-27b-it-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated438 GB—Gated2026-11-15

LFM2.5-24B-A2B-GGUFHosted (signed) From: ggml-org in alt.freeweights.lfm88.0 GB—Custom terms2026-11-15

Hermes-4-70B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text213 GB—Gated2026-11-15 OpenGVLab_InternVL3_5-2B-GGUFFrom the publisher From: bartowski in alt.freeweights.text35.0 GB—Not reviewed2026-11-15 SUFE-AIFLM-Lab_Fin-R1-GGUFFrom the publisher From: bartowski in alt.freeweights.text120 GB—Not reviewed2026-11-15

grok-2-GGUFFrom the publisher From: unsloth in alt.freeweights.text4.53 TB—Not reviewed2026-11-15

MiniMax-M2.7-GGUFFrom the publisher From: unsloth in alt.freeweights.minimax3.34 TB—Not reviewed2026-11-15

LFM2.5-VL-3B-GGUFHosted (signed) From: unsloth in alt.freeweights.lfm44.3 GB—Custom terms2026-11-15 tencent_Hunyuan-0.5B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.text9.15 GB—Not reviewed2026-11-15

DeepSeek-Prover-V2-7B-GGUFFrom the publisher From: unsloth in alt.freeweights.deepseek116 GB—Not reviewed2026-11-15 Llama-3.1-8B-Lexi-Uncensored-GGUFFrom the publisher From: bartowski in alt.freeweights.llama125 GB—Gated2026-11-15 tencent_Hunyuan-1.8B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.text29.0 GB—Not reviewed2026-11-15

Cosmos-Reason1-7B-GGUFFrom the publisher From: unsloth in alt.freeweights.text134 GB—Not reviewed2026-11-15 glm-4-9b-chat-GGUFFrom the publisher From: bartowski in alt.freeweights.glm115 GB—Not reviewed2026-11-15

EXAONE-3.5-7.8B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text23.7 GB—Not reviewed2026-11-15 jina-embeddings-v4-text-retrieval-GGUFFrom the publisher From: jinaai in alt.freeweights.text35.5 GB—Not reviewed2026-11-15 dolphin-2.9.4-llama3.1-8b-GGUFFrom the publisher From: bartowski in alt.freeweights.llama125 GB—Gated2026-11-15 Naphula_Cyberdonia-24B-v8-GGUFFrom the publisher From: bartowski in alt.freeweights.text343 GB—Not reviewed2026-11-15

OpenCoder-1.5B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text6.66 GB—Not reviewed2026-11-15

EXAONE-3.5-2.4B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text8.14 GB—Not reviewed2026-11-15 Naphula_Goetia-26B-A4B-v1.7-GGUFFrom the publisher From: bartowski in alt.freeweights.text442 GB—Not reviewed2026-11-15 nvidia_Llama-3.1-Nemotron-Nano-4B-v1.1-GGUFFrom the publisher From: bartowski in alt.freeweights.nemotron72.1 GB—Not reviewed2026-11-15 huihui-ai_gemma-3-1b-it-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated20.0 GB—Gated2026-11-15

NVIDIA-Nemotron-3.5-Bolt-E4B-GGUFHosted (signed) From: ggml-org in alt.freeweights.nemotron23.7 GB—Custom terms2026-11-15 NousResearch_Hermes-4-70B-GGUFFrom the publisher From: bartowski in alt.freeweights.text863 GB—Gated2026-11-15 Ateron_Gemma-4-MoonGem-31B-GGUFFrom the publisher From: bartowski in alt.freeweights.gemma496 GB—Not reviewed2026-11-15 Falcon3-7B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.text109 GB—Not reviewed2026-11-15

NVIDIA-Nemotron-3-Nano-30B-A3B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron176 GB—Not reviewed2026-11-15

← PreviousPage 3 of 7Next →

Slide, drag, or use the arrow keys.

No model matches these filters.Remove a filter or search for something shorter.

Every row is downloadable or links to its source. Press / to search, n and p to move in the list.

From:

unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.nemotronSubject: NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUFDate: 2026-11-15

Text generation model. Gguf weights, 510 GB in all. Published by unsloth under nvidia-nemotron-open-model-license.

nemotron

510GBNVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUFgguflicense not reviewed

FactsParamsnot statedSize510 GBFormatsggufTasktext generationLicensenvidia-nemotron-open-model-licenseFrom the publisher · License not reviewedlicense not reviewedread terms

link only

$ fw info unsloth/NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUF
link only — read the license:
https://huggingface.co/unsloth/NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUF

License and source

Goal 1: 45 USD, 3 months x 15 USD; or a verified free VM0% fundedREADME: operating statementAllternit, the open source alternative