alt.freeweights.* · 29 sections · 8900 models listed (2868 shown under their base as variants) · collection

GGUF for llama.cpp and Ollama

Repos with GGUF files, ready for llama.cpp, Ollama and LM Studio.

Filters

Sections

alt.freeweights.*6279 qwen655 deepseek82 kimi34 glm182 minimax29 mimo11 gemma376 gpt-oss9 olmo575 nemotron109 phi66 mistral118 granite162 smollm49 minicpm106 llama254 lfm74 text1134 speech186 embed219 vision1225 image199 video73 music16 ocr1 datasets11 tools247 abliterated77 allternit

Collections

Runs on a 256 GB Mac3692 Small enough for a laptop2556 Embeddings and rerankers290 Speech276 GGUF for llama.cpp and Ollama694 Open datasets11 Runs on a phone450 Runs on a laptop864 Needs a workstation455 Runs in the browser338

Filter

Sectiontext266llama115gemma54nemotron51qwen45abliterated43

Show 16 more

minicpm20lfm16minimax12kimi11glm10mistral10deepseek9granite5phi5speech5embed4vision4smollm3image2olmo2video2

Tasktext generation496not tagged85image text to text77any to any13feature extraction7translation4

Show 6 more

automatic speech recognition3text to speech3image to video2sentence similarity2text to 3d1voice activity detection1

License classLicense not reviewed (link only)415Gated (link only)186Permissive65Custom terms18Non-commercial (link only)9Territory-limited (link only)1

Formatgguf694safetensors30onnx2openvino2

SizeUnder 4 GB494 to 40 GB13540 to 200 GB255200 GB and up255

ListingFrom the publisher · License not reviewed415From the publisher · Gated186Hosted (signed)83From the publisher · Non-commercial9From the publisher · Territory-limited1

Bytes fromFrom the publisher611From source83

TermsNo extra terms65Requires accepting terms629

ParametersUnder 1B231B to 3B663B to 6B646B to 9B1479B to 12B2412B to 24B67

Show 6 more

24B to 32B3832B to 64B4364B to 128B77128B to 500B5Over 500B3Not stated137

LibraryGGUF694transformers183PyTorch40safetensors34PEFT19JAX4

Show 4 more

sentence-transformers4ONNX2OpenVINO2Transformers.js2

LanguageEnglish310Spanish66French66Chinese64German55Portuguese55

Show 154 more

Italian51Hindi37Korean37Thai34Japanese32Arabic27Vietnamese22Multilingual21Indonesian19Russian18Polish17Dutch12Czech11Greek11Hungarian11Romanian11Swedish11Turkish11Ukrainian11Bulgarian10Danish10Finnish10Slovak10Bangla9Estonian9Gujarati9Hebrew9Croatian9Kannada9Lithuanian9Latvian9Malayalam9Marathi9Norwegian9Punjabi9Slovenian9Tamil9Telugu9Odia8Filipino8Assamese7Catalan7Basque7Persian7Georgian7Malay7Urdu7Afrikaans6Amharic6Azerbaijani6Belarusian6Breton6Bosnian6Welsh6Esperanto6Western Frisian6Irish6Scottish Gaelic6Galician6Hausa6Armenian6Icelandic6Javanese6Kazakh6Khmer6Kurdish6Kyrgyz6Latin6Lao6Malagasy6Macedonian6Mongolian6Maltese6Burmese6Nepali6Oromo6Pashto6Sanskrit6Sindhi6Sinhala6Somali6Albanian6Serbian6Sundanese6Swahili6Uyghur6Uzbek6Xhosa6Yiddish6Afar4Akan4Avaric4Aymara4Bashkir4Bislama4Bambara4Tibetan4Chechen4Chamorro4Corsican4Chuvash4Divehi4Dzongkha4Ewe4Fula4Fijian4Faroese4Guarani4Manx4Hiri Motu4Haitian Creole4Igbo4Inuktitut4Kongo4Kuanyama4Kalaallisut4Kashmiri4Komi4Cornish4Luxembourgish4Ganda4Lingala4Luba-Katanga4Marshallese4Māori4South Ndebele4Navajo4Nyanja4Occitan4Ojibwa4Ossetic4Quechua4Romansh4Rundi4Kinyarwanda4Northern Sami4Sango4Samoan4Shona4Swati4Southern Sotho4Tajik4Tigrinya4Turkmen4Tswana4Tongan4Tsonga4Tatar4Venda4Walloon4Wolof4Yoruba4Zhuang4Zulu4

Appsllama.cpp684LM Studio684Ollama684Jan675SGLang19vLLM19

Show 1 more

whisper.cpp3

On devicePhone33Laptop63Workstation31In the browser7

Enginellama.cpp76webgpu7mlx4

all 6279 Runs on a 256 GB Mac 3692 Small enough for a laptop 2556 Embeddings and rerankers 290 Speech 276 GGUF for llama.cpp and Ollama 694 Open datasets 11 Runs on a phone 450 Runs on a laptop 864 Needs a workstation 455 Runs in the browser 338 qwen 655 deepseek 82 kimi 34 glm 182 minimax 29 mimo 11 gemma 376 gpt-oss 9 olmo 575 nemotron 109 phi 66 mistral 118 granite 162 smollm 49 minicpm 106 llama 254 lfm 74 text 1134 speech 186 embed 219 vision 1225 image 199 video 73 music 16 ocr 1 datasets 11 tools 247 abliterated 77

Search models/

Sort

694 models

SubjectSizeParamsLicenseDate

Yi-1.5-9B-Chat-GGUFHosted (signed) From: bartowski in alt.freeweights.text131 GB—Permissive2026-11-15

NVIDIA-Nemotron-3.5-Bolt-74B-A9B-GGUFHosted (signed) From: lmstudio-community in alt.freeweights.nemotron23.8 GB—Custom terms2026-11-15 Yi-1.5-6B-Chat-GGUFHosted (signed) From: bartowski in alt.freeweights.text90.7 GB—Permissive2026-11-15

gemma-3n-E4B-it-text-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.gemma17.3 GB—Gated2026-11-15 gemma-1.1-7b-it-GGUFFrom the publisher From: bartowski in alt.freeweights.gemma84.1 GB—Gated2026-11-15

tinyLFM3-Omni-for-testing-ggufHosted (signed) From: ggml-org in alt.freeweights.lfm39.3 MB—Custom terms2026-11-15

ultravox-v0_5-llama-3_1-8b-GGUFHosted (signed) From: ggml-org in alt.freeweights.llama6.30 GB—Permissive2026-11-15 codegemma-7b-it-GGUFFrom the publisher From: bartowski in alt.freeweights.gemma96.2 GB—Gated2026-11-15

gemma-2-it-GGUFFrom the publisher From: unsloth in alt.freeweights.gemma16.5 GB—Gated2026-11-15 Meta-Llama-3-70B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.llama1.28 TB—Gated2026-11-15

Mistral-Nemo-Instruct-2407-GGUFHosted (signed) From: unsloth in alt.freeweights.mistral74.7 GB—Permissive2026-11-15 codegemma-2b-GGUFFrom the publisher From: bartowski in alt.freeweights.gemma30.3 GB—Gated2026-11-15

gemma-3n-E2B-it-text-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.gemma11.3 GB—Gated2026-11-15 Meta-Llama-3-8B-Instruct-abliterated-v3-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated107 GB—Gated2026-11-15 Replete-LLM-V2.5-Qwen-0.5b-GGUFHosted (signed) From: bartowski in alt.freeweights.qwen9.88 GB—Permissive2026-11-15

codegemma-7b-it-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.gemma96.2 GB—Gated2026-11-15 tinybrainbot-100m-v5-baseHosted (signed) From: nkthebass in alt.freeweights.text579 MB100MPermissive2026-11-15

codegemma-2b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.gemma30.3 GB—Gated2026-11-15 c4ai-command-r7b-12-2024-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated126 GB—Non-commercial2026-11-15

gemma-3n-E4B-it-GGUFFrom the publisher From: ggml-org in alt.freeweights.gemma21.1 GB—Gated2026-11-15 Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated638 GB—Gated2026-11-15

InternVL3-2B-GGUFHosted (signed) From: unsloth in alt.freeweights.text30.6 GB—Permissive2026-11-15

InternVL3-8B-GGUFHosted (signed) From: unsloth in alt.freeweights.text118 GB—Permissive2026-11-15

InternVL3-1B-GGUFHosted (signed) From: unsloth in alt.freeweights.text14.9 GB—Permissive2026-11-15

InternVL3-14B-Instruct-GGUFHosted (signed) From: unsloth in alt.freeweights.text223 GB—Permissive2026-11-15 Qwen1.5-110B-Chat-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen1.19 TB—Not reviewed2026-11-15

Llama-3_1-Nemotron-Ultra-253B-v1-GGUFFrom the publisher From: unsloth in alt.freeweights.nemotron4.12 TB—Not reviewed2026-11-15 internlm2_5-7b-chat-GGUFFrom the publisher From: bartowski in alt.freeweights.text140 GB—Not reviewed2026-11-15 DeepSeek-Coder-V2-Lite-Base-GGUFFrom the publisher From: bartowski in alt.freeweights.deepseek270 GB—Not reviewed2026-11-15

stable-code-instruct-3b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text27.0 GB—Not reviewed2026-11-15 Meta-Llama-3-8B-Instruct-old-GGUFFrom the publisher From: bartowski in alt.freeweights.llama89.6 GB—Gated2026-11-15 Meta-Llama-3-8B-Instruct-GGUF-special-tokensFrom the publisher From: bartowski in alt.freeweights.llama106 GB—Gated2026-11-15 Codestral-22B-v0.1-abliterated-v3-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated289 GB—Not reviewed2026-11-15 CodeQwen1.5-7B-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen86.2 GB—Not reviewed2026-11-15 CodeQwen1.5-7B-Chat-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen86.2 GB—Not reviewed2026-11-15

wavecoder-ultra-6.7b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.text73.0 GB—Not reviewed2026-11-15

gemma-1.1-2b-it-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.gemma25.9 GB—Gated2026-11-15

codegemma-7b-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.gemma96.2 GB—Gated2026-11-15

Qwen1.5-32B-Chat-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.qwen376 GB—Not reviewed2026-11-15 THUDM_GLM-4-32B-0414-GGUFFrom the publisher From: bartowski in alt.freeweights.glm521 GB—Not reviewed2026-11-15 Qwen2-VL-7B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated118 GB—Not reviewed2026-11-15

InternVL3-78B-GGUFFrom the publisher From: unsloth in alt.freeweights.text1.12 TB—Not reviewed2026-11-15

GLM-4-32B-0414-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.glm98.2 GB—Not reviewed2026-11-15

InternVL3-38B-GGUFFrom the publisher From: unsloth in alt.freeweights.text524 GB—Not reviewed2026-11-15

InternVL3-38B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.text524 GB—Not reviewed2026-11-15

NVIDIA-Nemotron-3.5-Bolt-E4B-GGUFHosted (signed) From: unsloth in alt.freeweights.nemotron59.5 GB—Custom terms2026-11-15

LTX-2.3-GGUFFrom the publisher From: unsloth in alt.freeweights.video1.08 TB—Not reviewed2026-11-15

LFM2.5-24B-A2B-GGUFHosted (signed) From: unsloth in alt.freeweights.lfm171 GB—Custom terms2026-11-15

Qwen3.8-Flash-Next-abliterated-GSQ-RCO-Strata-GGUFHosted (signed) From: alesha-pro in alt.freeweights.abliterated295 GB—Custom terms2026-11-14 thomsonreuters_Thomson-1.0-Small-GGUFFrom the publisher From: bartowski in alt.freeweights.text571 GB—Not reviewed2026-11-15 Meta-Llama-3.1-8B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.llama143 GB—Gated2026-11-15

Llama-3.2-3B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.llama61.4 GB—Gated2026-11-15

Kimi-K3-GGUFFrom the publisher From: unsloth in alt.freeweights.kimi7.42 TB—Not reviewed2026-11-15 Llama-3.3-70B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.llama1.23 TB—Gated2026-11-15

Qwen2.5-VL-3B-Instruct-GGUFFrom the publisher From: ggml-org in alt.freeweights.qwen13.6 GB—Not reviewed2026-11-15 Llama-3.2-3B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.llama43.1 GB—Gated2026-11-15 Llama-3.2-1B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.llama17.2 GB—Gated2026-11-15

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUFFrom the publisher From: ggml-org in alt.freeweights.nemotron538 GB—Not reviewed2026-11-15 TheDrummer_Artemis-31B-v1.2-GGUFFrom the publisher From: bartowski in alt.freeweights.text496 GB—Not reviewed2026-11-15

tinygemma3-GGUFFrom the publisher From: ggml-org in alt.freeweights.gemma48.6 MB—Not reviewed2026-11-15 Qwen2.5-Coder-14B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated242 GB—Not reviewed2026-11-15 TheDrummer_Orion-26B-A4B-v1.1-GGUFFrom the publisher From: bartowski in alt.freeweights.text426 GB—Not reviewed2026-11-15

Meta-Llama-3.1-8B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama34.6 GB—Gated2026-11-15

Llama-3.2-3B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.llama9.90 GB—Gated2026-11-15

Llama-3.2-1B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.llama24.9 GB—Gated2026-11-15

NVIDIA-Nemotron-3-Nano-4B-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron11.0 GB—Not reviewed2026-11-15 Llama-3.3-70B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated928 GB—Gated2026-11-15

LTX-2-GGUFFrom the publisher From: unsloth in alt.freeweights.video304 GB—Not reviewed2026-11-15 cognitivecomputations_Dolphin3.0-Mistral-24B-GGUFFrom the publisher From: bartowski in alt.freeweights.mistral422 GB—Not reviewed2026-11-15 LiquidAI_LFM2.5-1.2B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.lfm18.6 GB—Not reviewed2026-11-15

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUFHosted (signed) From: unsloth in alt.freeweights.nemotron867 GB—Custom terms2026-11-15 TheDrummer_Cydonia-24B-v4.3-GGUFFrom the publisher From: bartowski in alt.freeweights.text377 GB—Not reviewed2026-11-15 Llama-3.2-3B-Instruct-uncensored-GGUFFrom the publisher From: bartowski in alt.freeweights.llama57.4 GB—Not reviewed2026-11-15

Qwen2.5-VL-3B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.qwen57.5 GB—Not reviewed2026-11-15

Nemotron-3-Nano-30B-A3B-GGUFFrom the publisher From: unsloth in alt.freeweights.nemotron576 GB—Not reviewed2026-11-15

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.nemotron93.2 GB—Not reviewed2026-11-15

Llama-4-Scout-17B-16E-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.llama1.80 TB—Gated2026-11-15 Meta-Llama-3.1-70B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.llama863 GB—Gated2026-11-15

Llama-3.3-70B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.llama1.34 TB—Gated2026-11-15

LFM2.5-1.2B-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.lfm16.3 GB—Not reviewed2026-11-15 gemma-2-2b-it-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated36.3 GB—Gated2026-11-15 TheDrummer_Magidonia-24B-v4.3-GGUFFrom the publisher From: bartowski in alt.freeweights.text377 GB—Not reviewed2026-11-15

Kimi-K2.5-GGUFFrom the publisher From: unsloth in alt.freeweights.kimi16.8 TB—Not reviewed2026-11-15 Qwen2.5-Coder-32B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated527 GB—Not reviewed2026-11-15 Dolphin3.0-Llama3.1-8B-GGUFFrom the publisher From: bartowski in alt.freeweights.llama155 GB—Gated2026-11-15

Llama-4-Maverick-17B-128E-Instruct-GGUFFrom the publisher From: unsloth in alt.freeweights.llama6.62 TB—Gated2026-11-15 DeepSeek-R1-Distill-Qwen-32B-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated519 GB—Not reviewed2026-11-15 nvidia_NVIDIA-Nemotron-Nano-9B-v2-GGUFFrom the publisher From: bartowski in alt.freeweights.nemotron165 GB—Not reviewed2026-11-15

LFM2.5-8B-A1B-GGUFHosted (signed) From: unsloth in alt.freeweights.lfm124 GB—Custom terms2026-11-15

Qwen2.5-VL-3B-Instruct-GGUFFrom the publisher From: lmstudio-community in alt.freeweights.qwen10.8 GB—Not reviewed2026-11-15

Kimi-K2.7-Code-GGUFFrom the publisher From: unsloth in alt.freeweights.kimi4.30 TB—Not reviewed2026-11-15

← PreviousPage 2 of 7Next →

Slide, drag, or use the arrow keys.

No model matches these filters.Remove a filter or search for something shorter.

Every row is downloadable or links to its source. Press / to search, n and p to move in the list.

From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.textSubject: Yi-1.5-9B-Chat-GGUFDate: 2026-11-15Commit: 8189878Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 131 GB in all. Published by bartowski under Apache-2.0.

text131GBYi-1.5-9B-Chat-GGUFggufpermissive

FactsParamsnot statedSize131 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive

$ fw get bartowski/Yi-1.5-9B-Chat-GGUF
# manifest sha256 8c9d7f823d40… · 131 GB · 26 files
$ fw verify ./Yi-1.5-9B-Chat-GGUF bartowski/Yi-1.5-9B-Chat-GGUF

Open model page

Goal 1: 45 USD, 3 months x 15 USD; or a verified free VM0% fundedREADME: operating statementAllternit, the open source alternative