alt.freeweights.* · 29 sections · 8900 models listed (2868 shown under their base as variants) · collection

GGUF for llama.cpp and Ollama

Repos with GGUF files, ready for llama.cpp, Ollama and LM Studio.

Filters

Sections

alt.freeweights.*6279 qwen655 deepseek82 kimi34 glm182 minimax29 mimo11 gemma376 gpt-oss9 olmo575 nemotron109 phi66 mistral118 granite162 smollm49 minicpm106 llama254 lfm74 text1134 speech186 embed219 vision1225 image199 video73 music16 ocr1 datasets11 tools247 abliterated77 allternit

Collections

Runs on a 256 GB Mac3692 Small enough for a laptop2556 Embeddings and rerankers290 Speech276 GGUF for llama.cpp and Ollama694 Open datasets11 Runs on a phone450 Runs on a laptop864 Needs a workstation455 Runs in the browser338

Filter

Sectiontext266llama115gemma54nemotron51qwen45abliterated43

Show 16 more

minicpm20lfm16minimax12kimi11glm10mistral10deepseek9granite5phi5speech5embed4vision4smollm3image2olmo2video2

Tasktext generation496not tagged85image text to text77any to any13feature extraction7translation4

Show 6 more

automatic speech recognition3text to speech3image to video2sentence similarity2text to 3d1voice activity detection1

License classLicense not reviewed (link only)415Gated (link only)186Permissive65Custom terms18Non-commercial (link only)9Territory-limited (link only)1

Formatgguf694safetensors30onnx2openvino2

SizeUnder 4 GB494 to 40 GB13540 to 200 GB255200 GB and up255

ListingFrom the publisher · License not reviewed415From the publisher · Gated186Hosted (signed)83From the publisher · Non-commercial9From the publisher · Territory-limited1

Bytes fromFrom the publisher611From source83

TermsNo extra terms65Requires accepting terms629

ParametersUnder 1B231B to 3B663B to 6B646B to 9B1479B to 12B2412B to 24B67

Show 6 more

24B to 32B3832B to 64B4364B to 128B77128B to 500B5Over 500B3Not stated137

LibraryGGUF694transformers183PyTorch40safetensors34PEFT19JAX4

Show 4 more

sentence-transformers4ONNX2OpenVINO2Transformers.js2

LanguageEnglish310Spanish66French66Chinese64German55Portuguese55

Show 154 more

Italian51Hindi37Korean37Thai34Japanese32Arabic27Vietnamese22Multilingual21Indonesian19Russian18Polish17Dutch12Czech11Greek11Hungarian11Romanian11Swedish11Turkish11Ukrainian11Bulgarian10Danish10Finnish10Slovak10Bangla9Estonian9Gujarati9Hebrew9Croatian9Kannada9Lithuanian9Latvian9Malayalam9Marathi9Norwegian9Punjabi9Slovenian9Tamil9Telugu9Odia8Filipino8Assamese7Catalan7Basque7Persian7Georgian7Malay7Urdu7Afrikaans6Amharic6Azerbaijani6Belarusian6Breton6Bosnian6Welsh6Esperanto6Western Frisian6Irish6Scottish Gaelic6Galician6Hausa6Armenian6Icelandic6Javanese6Kazakh6Khmer6Kurdish6Kyrgyz6Latin6Lao6Malagasy6Macedonian6Mongolian6Maltese6Burmese6Nepali6Oromo6Pashto6Sanskrit6Sindhi6Sinhala6Somali6Albanian6Serbian6Sundanese6Swahili6Uyghur6Uzbek6Xhosa6Yiddish6Afar4Akan4Avaric4Aymara4Bashkir4Bislama4Bambara4Tibetan4Chechen4Chamorro4Corsican4Chuvash4Divehi4Dzongkha4Ewe4Fula4Fijian4Faroese4Guarani4Manx4Hiri Motu4Haitian Creole4Igbo4Inuktitut4Kongo4Kuanyama4Kalaallisut4Kashmiri4Komi4Cornish4Luxembourgish4Ganda4Lingala4Luba-Katanga4Marshallese4Māori4South Ndebele4Navajo4Nyanja4Occitan4Ojibwa4Ossetic4Quechua4Romansh4Rundi4Kinyarwanda4Northern Sami4Sango4Samoan4Shona4Swati4Southern Sotho4Tajik4Tigrinya4Turkmen4Tswana4Tongan4Tsonga4Tatar4Venda4Walloon4Wolof4Yoruba4Zhuang4Zulu4

Appsllama.cpp684LM Studio684Ollama684Jan675SGLang19vLLM19

Show 1 more

whisper.cpp3

On devicePhone33Laptop63Workstation31In the browser7

Enginellama.cpp76webgpu7mlx4

all 6279 Runs on a 256 GB Mac 3692 Small enough for a laptop 2556 Embeddings and rerankers 290 Speech 276 GGUF for llama.cpp and Ollama 694 Open datasets 11 Runs on a phone 450 Runs on a laptop 864 Needs a workstation 455 Runs in the browser 338 qwen 655 deepseek 82 kimi 34 glm 182 minimax 29 mimo 11 gemma 376 gpt-oss 9 olmo 575 nemotron 109 phi 66 mistral 118 granite 162 smollm 49 minicpm 106 llama 254 lfm 74 text 1134 speech 186 embed 219 vision 1225 image 199 video 73 music 16 ocr 1 datasets 11 tools 247 abliterated 77

Search models/

Sort

694 models

SubjectSizeParamsLicenseDate

FuseChat-Qwen-2.5-7B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen156 GB—Not reviewed2026-11-15 Gemmasutra-Mini-2B-v1-GGUFFrom the publisher From: bartowski in alt.freeweights.gemma33.3 GB—Not reviewed2026-11-15 MathCoder2-Llama-3-8B-GGUFFrom the publisher From: bartowski in alt.freeweights.llama127 GB—Gated2026-11-15

InternVL3_5-2B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text6.89 GB—Not reviewed2026-11-15

Falcon-H1-7B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.text125 GB—Not reviewed2026-11-15

cogito-v1-preview-llama-3B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama11.0 GB—Gated2026-11-15

Hermes-4-405B-GGUFFrom the publisher From: unsloth in alt.freeweights.text2.55 TB—Gated2026-11-15

Llama-4-Scout-17B-16E-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama329 GB—Gated2026-11-15

Meta-Llama-3-120B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama859 GB—Gated2026-11-15

Llama-3-Groq-70B-Tool-Use-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama359 GB—Gated2026-11-15

MiniMax-M2.5-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.minimax569 GB—Not reviewed2026-11-15

internlm2-math-plus-7b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text116 GB—Not reviewed2026-11-15

r1-1776-GGUFFrom the publisher From: unsloth in alt.freeweights.text5.47 TB—Not reviewed2026-11-15

r1-1776-distill-llama-70b-GGUFFrom the publisher From: unsloth in alt.freeweights.llama454 GB—Not reviewed2026-11-15

Reflection-Llama-3.1-70B-GGUFFrom the publisher From: unsloth in alt.freeweights.llama156 GB—Gated2026-11-15

CodeLlama-7B-KStack-clean-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama19.9 GB—Gated2026-11-15

cogito-v2-preview-deepseek-671B-MoE-GGUFFrom the publisher From: unsloth in alt.freeweights.deepseek10.7 TB—Not reviewed2026-11-15

Meta-Llama-3-8B-Instruct-BPE-fix-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama39.9 GB—Gated2026-11-15

Meta-Llama-3-70B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama80.4 GB—Gated2026-11-15

LoRA-Qwen2.5-72B-Instruct-abliterated-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated1.73 GB—Not reviewed2026-11-15

cogito-671b-v2.1-GGUFFrom the publisher From: unsloth in alt.freeweights.text11.0 TB—Not reviewed2026-11-15

LFM2.5-VL-1.6B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.lfm3.79 GB—Not reviewed2026-11-15

internlm2-math-plus-20b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text295 GB—Not reviewed2026-11-15

InternVL3_5-1B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text2.97 GB—Not reviewed2026-11-15

LFM2.5-1.2B-Thinking-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.lfm5.28 GB—Not reviewed2026-11-15

MiniMax-M2-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.minimax569 GB—Not reviewed2026-11-15

Meta-Llama-3-70B-Instruct-BPE-fix-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama184 GB—Gated2026-11-15

InternVL2_5-4B-GGUFFrom the publisher From: ggml-org in alt.freeweights.text13.5 GB—Non-commercial2026-11-15

LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated374 MB—Not reviewed2026-11-15

Llama-3.1-Nemotron-70B-Instruct-HF-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron213 GB—Gated2026-11-15

DiscoPOP-zephyr-7b-gemma-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.gemma36.8 GB—Gated2026-11-15

Llama3-ChatQA-1.5-70B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama400 GB—Gated2026-11-15

Nemotron-3-Nano-4B-GGUFFrom the publisher From: ggml-org in alt.freeweights.nemotron12.2 GB—Not reviewed2026-11-15

internlm2-math-plus-mixtral8x22b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text1.14 TB—Not reviewed2026-11-15

Hunyuan-A13B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text240 GB—Not reviewed2026-11-15

Falcon3-7B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text22.6 GB—Not reviewed2026-11-15

Falcon3-10B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text31.2 GB—Not reviewed2026-11-15

Athene-V2-Chat-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text229 GB—Not reviewed2026-11-15

internlm2_5-20b-chat-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text93.9 GB—Not reviewed2026-11-15

InternVL3_5-30B-A3B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text91.4 GB—Not reviewed2026-11-15

Athene-70B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text390 GB—Non-commercial2026-11-15

Nemotron-3-Super-120B-GGUFFrom the publisher From: ggml-org in alt.freeweights.nemotron69.9 GB—Not reviewed2026-11-15

Llama3-ChatQA-1.5-8B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama34.8 GB—Gated2026-11-15

internlm2_5-1_8b-chat-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text8.18 GB—Not reviewed2026-11-15

EXAONE-4.0.1-32B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text96.4 GB—Not reviewed2026-11-15

AceReason-Nemotron-14B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron44.7 GB—Not reviewed2026-11-15

Skywork-R1V3-38B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text110 GB—Not reviewed2026-11-15

LoRA-llama-3-70B-Instruct-abliterated-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated1.70 GB—Not reviewed2026-11-15

AceReason-Nemotron-7B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron23.1 GB—Not reviewed2026-11-15

Llama-3.1-Nemotron-Nano-4B-v1.1-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron13.8 GB—Not reviewed2026-11-15

Llama-3_1-Nemotron-Ultra-253B-v1-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron761 GB—Not reviewed2026-11-15

cogito-v1-preview-llama-8B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama24.4 GB—Gated2026-11-15

LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated364 MB—Not reviewed2026-11-15

OpenCoder-8B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text23.5 GB—Not reviewed2026-11-15

EXAONE-Deep-7.8B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text23.7 GB—Not reviewed2026-11-15

KwaiCoder-AutoThink-preview-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text122 GB—Not reviewed2026-11-15

EXAONE-4.0-1.2B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text3.23 GB—Not reviewed2026-11-15

LoRA-Qwen2.5-32B-Instruct-abliterated-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated1.12 GB—Not reviewed2026-11-15

Jedi-3B-1080p-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text10.8 GB—Not reviewed2026-11-15

AceReason-Nemotron-1.1-7B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron23.1 GB—Not reviewed2026-11-15

LoRA-phi-4-abliterated-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated474 MB—Not reviewed2026-11-15

Skywork-OR1-7B-Preview-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text23.1 GB—Not reviewed2026-11-15

MindLink-72B-0801-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text229 GB—Not reviewed2026-11-15

cogito-v2-preview-llama-70B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama213 GB—Gated2026-11-15

cogito-v1-preview-llama-70B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama213 GB—Gated2026-11-15

Skywork-OR1-32B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text98.8 GB—Not reviewed2026-11-15 smollm-1.7B-instruct-v0.2-Q8_0-GGUFFrom the publisher From: HuggingFaceTB in alt.freeweights.smollm1.82 GB—Not reviewed2026-11-15

Falcon3-3B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text9.87 GB—Not reviewed2026-11-15

Falcon3-1B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text5.14 GB—Not reviewed2026-11-15

Athene-V2-Agent-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text229 GB—Not reviewed2026-11-15

Hermes-4-405B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text1.22 TB—Gated2026-11-15

cogito-v2-preview-llama-109B-MoE-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama326 GB—Gated2026-11-15

Llama-3_1-Nemotron-51B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron155 GB—Not reviewed2026-11-15

openchat-3.6-8b-20240522-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text34.8 GB—Gated2026-11-15

EXAONE-4.0-32B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text96.4 GB—Not reviewed2026-11-15

EXAONE-3.5-32B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text96.4 GB—Not reviewed2026-11-15

LoRA-Qwen2.5-Coder-7B-Instruct-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.qwen726 MB—Not reviewed2026-11-15

r1-1776-distill-llama-70b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama213 GB—Not reviewed2026-11-15

r1-1776-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text2.02 TB—Not reviewed2026-11-15

LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated558 MB—Not reviewed2026-11-15

Kevin-32B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text98.8 GB—Not reviewed2026-11-15

Skywork-OR1-32B-Preview-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text98.8 GB—Not reviewed2026-11-15

Skywork-OR1-Math-7B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text23.1 GB—Not reviewed2026-11-15

LoRA-Qwen2.5-14B-Instruct-abliterated-v2-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated1.18 GB—Not reviewed2026-11-15

Falcon-H1-0.5B-Instruct-Q8_0-GGUFFrom the publisher From: ggml-org in alt.freeweights.text556 MB—Not reviewed2026-11-15

LoRA-Human-Like-Qwen2.5-7B-Instruct-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.qwen726 MB—Not reviewed2026-11-15

EXAONE-Deep-32B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text96.4 GB—Not reviewed2026-11-15

LoRA-Qwerus-Qwen2.5-7B-Instruct-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.qwen364 MB—Not reviewed2026-11-15

Skywork-OR1-7B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text23.1 GB—Not reviewed2026-11-15

LoRA-SmallThinker-3B-Preview-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.text558 MB—Not reviewed2026-11-15

LoRA-Deepthink-Reasoning-7B-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.text726 MB—Not reviewed2026-11-15

LoRA-Llama-3.1-8B-MultiReflection-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.llama740 MB—Not reviewed2026-11-15

LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUFFrom the publisher From: ggml-org in alt.freeweights.abliterated353 MB—Gated2026-11-15

LoRA-Deepthink-Reasoning-Qwen2.5-7B-Instruct-Q8_0-GGUFFrom the publisher From: ggml-org in alt.freeweights.qwen162 MB—Not reviewed2026-11-15

← PreviousPage 7 of 7

Slide, drag, or use the arrow keys.

No model matches these filters.Remove a filter or search for something shorter.

Every row is downloadable or links to its source. Press / to search, n and p to move in the list.

From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.qwenSubject: FuseChat-Qwen-2.5-7B-Instruct-GGUFDate: 2026-11-15

Text generation model. Gguf weights, 156 GB in all. Published by bartowski under unknown.

qwen156GBFuseChat-Qwen-2.5-7B-Instruct-GGUFgguflicense not reviewed

FactsParamsnot statedSize156 GBFormatsggufTasktext generationLicenseunknownFrom the publisher · License not reviewedlicense not reviewedread terms

link only

$ fw info bartowski/FuseChat-Qwen-2.5-7B-Instruct-GGUF
link only — read the license:
https://huggingface.co/bartowski/FuseChat-Qwen-2.5-7B-Instruct-GGUF

License and source

Goal 1: 45 USD, 3 months x 15 USD; or a verified free VM0% fundedREADME: operating statementAllternit, the open source alternative