alt.freeweights.* · 29 sections · 8900 models listed (2868 shown under their base as variants) · collection

GGUF for llama.cpp and Ollama

Repos with GGUF files, ready for llama.cpp, Ollama and LM Studio.

Filters

Sections

alt.freeweights.*6279 qwen655 deepseek82 kimi34 glm182 minimax29 mimo11 gemma376 gpt-oss9 olmo575 nemotron109 phi66 mistral118 granite162 smollm49 minicpm106 llama254 lfm74 text1134 speech186 embed219 vision1225 image199 video73 music16 ocr1 datasets11 tools247 abliterated77 allternit

Collections

Runs on a 256 GB Mac3692 Small enough for a laptop2556 Embeddings and rerankers290 Speech276 GGUF for llama.cpp and Ollama694 Open datasets11 Runs on a phone450 Runs on a laptop864 Needs a workstation455 Runs in the browser338

Filter

Sectiontext266llama115gemma54nemotron51qwen45abliterated43

Show 16 more

minicpm20lfm16minimax12kimi11glm10mistral10deepseek9granite5phi5speech5embed4vision4smollm3image2olmo2video2

Tasktext generation496not tagged85image text to text77any to any13feature extraction7translation4

Show 6 more

automatic speech recognition3text to speech3image to video2sentence similarity2text to 3d1voice activity detection1

License classLicense not reviewed (link only)415Gated (link only)186Permissive65Custom terms18Non-commercial (link only)9Territory-limited (link only)1

Formatgguf694safetensors30onnx2openvino2

SizeUnder 4 GB494 to 40 GB13540 to 200 GB255200 GB and up255

ListingFrom the publisher · License not reviewed415From the publisher · Gated186Hosted (signed)83From the publisher · Non-commercial9From the publisher · Territory-limited1

Bytes fromFrom the publisher611From source83

TermsNo extra terms65Requires accepting terms629

ParametersUnder 1B231B to 3B663B to 6B646B to 9B1479B to 12B2412B to 24B67

Show 6 more

24B to 32B3832B to 64B4364B to 128B77128B to 500B5Over 500B3Not stated137

LibraryGGUF694transformers183PyTorch40safetensors34PEFT19JAX4

Show 4 more

sentence-transformers4ONNX2OpenVINO2Transformers.js2

LanguageEnglish310Spanish66French66Chinese64German55Portuguese55

Show 154 more

Italian51Hindi37Korean37Thai34Japanese32Arabic27Vietnamese22Multilingual21Indonesian19Russian18Polish17Dutch12Czech11Greek11Hungarian11Romanian11Swedish11Turkish11Ukrainian11Bulgarian10Danish10Finnish10Slovak10Bangla9Estonian9Gujarati9Hebrew9Croatian9Kannada9Lithuanian9Latvian9Malayalam9Marathi9Norwegian9Punjabi9Slovenian9Tamil9Telugu9Odia8Filipino8Assamese7Catalan7Basque7Persian7Georgian7Malay7Urdu7Afrikaans6Amharic6Azerbaijani6Belarusian6Breton6Bosnian6Welsh6Esperanto6Western Frisian6Irish6Scottish Gaelic6Galician6Hausa6Armenian6Icelandic6Javanese6Kazakh6Khmer6Kurdish6Kyrgyz6Latin6Lao6Malagasy6Macedonian6Mongolian6Maltese6Burmese6Nepali6Oromo6Pashto6Sanskrit6Sindhi6Sinhala6Somali6Albanian6Serbian6Sundanese6Swahili6Uyghur6Uzbek6Xhosa6Yiddish6Afar4Akan4Avaric4Aymara4Bashkir4Bislama4Bambara4Tibetan4Chechen4Chamorro4Corsican4Chuvash4Divehi4Dzongkha4Ewe4Fula4Fijian4Faroese4Guarani4Manx4Hiri Motu4Haitian Creole4Igbo4Inuktitut4Kongo4Kuanyama4Kalaallisut4Kashmiri4Komi4Cornish4Luxembourgish4Ganda4Lingala4Luba-Katanga4Marshallese4Māori4South Ndebele4Navajo4Nyanja4Occitan4Ojibwa4Ossetic4Quechua4Romansh4Rundi4Kinyarwanda4Northern Sami4Sango4Samoan4Shona4Swati4Southern Sotho4Tajik4Tigrinya4Turkmen4Tswana4Tongan4Tsonga4Tatar4Venda4Walloon4Wolof4Yoruba4Zhuang4Zulu4

Appsllama.cpp684LM Studio684Ollama684Jan675SGLang19vLLM19

Show 1 more

whisper.cpp3

On devicePhone33Laptop63Workstation31In the browser7

Enginellama.cpp76webgpu7mlx4

all 6279 Runs on a 256 GB Mac 3692 Small enough for a laptop 2556 Embeddings and rerankers 290 Speech 276 GGUF for llama.cpp and Ollama 694 Open datasets 11 Runs on a phone 450 Runs on a laptop 864 Needs a workstation 455 Runs in the browser 338 qwen 655 deepseek 82 kimi 34 glm 182 minimax 29 mimo 11 gemma 376 gpt-oss 9 olmo 575 nemotron 109 phi 66 mistral 118 granite 162 smollm 49 minicpm 106 llama 254 lfm 74 text 1134 speech 186 embed 219 vision 1225 image 199 video 73 music 16 ocr 1 datasets 11 tools 247 abliterated 77

Search models/

Sort

694 models

SubjectSizeParamsLicenseDate

mxbai-embed-large-v1Hosted (signed) From: mixedbread-ai in alt.freeweights.embed5.36 GB335MPermissive2026-11-14

parakeet-tdt-0.6b-v3Hosted (signed) From: nvidia in alt.freeweights.speech5.73 GB627MPermissive2026-11-15

nemotron-3.5-asr-streaming-0.6bHosted (signed) From: nvidia in alt.freeweights.nemotron5.66 GB638MCustom terms2026-11-15 MiniCPM5-2B-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm9.28 GB—Permissive2026-11-14

Nemotron-3-DiarizationHosted (signed) From: nvidia in alt.freeweights.nemotron710 MB99MCustom terms2026-11-15

gemma-7bFrom the publisher From: google in alt.freeweights.gemma51.3 GB8.5BGated2026-11-15

madlad400-3b-mtHosted (signed) From: google in alt.freeweights.vision15.7 GB2.9BPermissive2026-11-14 snowflake-arctic-embed-m-v1.5Hosted (signed) From: Snowflake in alt.freeweights.embed2.85 GB109MPermissive2026-11-14

VibeVoice-ASR-BitNetHosted (signed) From: microsoft in alt.freeweights.speech13.0 GB323MPermissive2026-11-14

Qwen3-Coder-Next-GGUFHosted (signed) From: Qwen in alt.freeweights.qwen470 GB—Permissive2026-11-15

gemma-2bFrom the publisher From: google in alt.freeweights.gemma15.1 GB2.5BGated2026-11-15 MiniCPM5-1B-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm4.01 GB—Permissive2026-11-14

Qwen3-Next-80B-A3B-Instruct-GGUFHosted (signed) From: Qwen in alt.freeweights.qwen470 GB—Permissive2026-11-15

Phi-3-mini-4k-instruct-ggufHosted (signed) From: microsoft in alt.freeweights.phi10.0 GB—Permissive2026-11-14

gemma-2b-itFrom the publisher From: google in alt.freeweights.gemma15.1 GB2.5BGated2026-11-15

Qwen2-1.5B-Instruct-GGUFHosted (signed) From: Qwen in alt.freeweights.qwen11.7 GB—Permissive2026-11-15

phi-4-ggufHosted (signed) From: microsoft in alt.freeweights.phi211 GB—Permissive2026-11-15

Qwen1.5-0.5B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen3.54 GB—Not reviewed2026-11-15

bitnet-b1.58-2B-4T-ggufHosted (signed) From: microsoft in alt.freeweights.text1.19 GB—Permissive2026-11-15 stablelm-2-zephyr-1_6bFrom the publisher From: stabilityai in alt.freeweights.text12.6 GB1.6BNot reviewed2026-11-15 stable-code-3bFrom the publisher From: stabilityai in alt.freeweights.text15.5 GB2.8BNot reviewed2026-11-15

madlad400-10b-mtHosted (signed) From: google in alt.freeweights.vision57.7 GB10.7BPermissive2026-11-14

Qwen2-72B-Instruct-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen572 GB—Not reviewed2026-11-15 MiniCPM4.1-8B-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm4.97 GB—Permissive2026-11-14

Qwen1.5-7B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen41.8 GB—Not reviewed2026-11-15

glm-edge-4b-chat-ggufFrom the publisher From: zai-org in alt.freeweights.glm45.2 GB—Not reviewed2026-11-15

glm-edge-1.5b-chat-ggufFrom the publisher From: zai-org in alt.freeweights.glm16.8 GB—Not reviewed2026-11-15 stable-code-instruct-3bFrom the publisher From: stabilityai in alt.freeweights.text9.30 GB2.8BNot reviewed2026-11-15

CodeQwen1.5-7B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen40.3 GB—Not reviewed2026-11-15

codegeex4-all-9b-GGUFFrom the publisher From: zai-org in alt.freeweights.glm40.7 GB—Not reviewed2026-11-15

Qwen1.5-1.8B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen10.4 GB—Not reviewed2026-11-15

Qwen2-57B-A14B-Instruct-GGUFHosted (signed) From: Qwen in alt.freeweights.qwen398 GB—Permissive2026-11-15

madlad400-7b-mtHosted (signed) From: google in alt.freeweights.vision44.7 GB8.3BPermissive2026-11-14

Qwen3-Next-80B-A3B-Thinking-GGUFHosted (signed) From: Qwen in alt.freeweights.qwen470 GB—Permissive2026-11-15 MiniCPM5-2B-DSpark-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm653 MB—Permissive2026-11-15

Qwen1.5-14B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen78.6 GB—Not reviewed2026-11-15 AgentCPM-Explore-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm20.6 GB—Permissive2026-11-15

Qwen1.5-4B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen21.5 GB—Not reviewed2026-11-15

DiarizationLM-8b-Fisher-v2From the publisher From: google in alt.freeweights.text29.5 GB8BGated2026-11-15

Qwen1.5-32B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen173 GB—Not reviewed2026-11-15

glm-edge-v-5b-ggufFrom the publisher From: zai-org in alt.freeweights.glm46.3 GB—Not reviewed2026-11-15

DiarizationLM-13b-Fisher-v1From the publisher From: google in alt.freeweights.text47.7 GB13BGated2026-11-15

madlad400-7b-mt-btHosted (signed) From: google in alt.freeweights.vision44.7 GB8.3BPermissive2026-11-15

bitnet-embedding-0.6bHosted (signed) From: microsoft in alt.freeweights.text428 MB—Permissive2026-11-15

bitnet-embedding-270mHosted (signed) From: microsoft in alt.freeweights.text368 MB—Permissive2026-11-15 AgentCPM-Report-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm4.97 GB—Permissive2026-11-15

glm-edge-v-2b-ggufFrom the publisher From: zai-org in alt.freeweights.glm17.7 GB—Not reviewed2026-11-15 MiniCPM4-0.5B-QAT-Int4-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm265 MB—Permissive2026-11-15 MiniCPM4-8B-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm4.97 GB—Permissive2026-11-15 BitCPM-CANN-8B-ggufHosted (signed) From: openbmb in alt.freeweights.minicpm2.37 GB—Permissive2026-11-15

Qwen1.5-72B-Chat-GGUFFrom the publisher From: Qwen in alt.freeweights.qwen387 GB—Not reviewed2026-11-15 granite-4.0-tiny-base-preview-GGUFHosted (signed) From: ibm-granite in alt.freeweights.granite72.8 GB—Permissive2026-11-15 stablelm-2-12b-chat-GGUFFrom the publisher From: stabilityai in alt.freeweights.image80.8 GB—Not reviewed2026-11-15 BitCPM4-0.5B-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm450 MB—Permissive2026-11-15

DiarizationLM-8b-Fisher-v1From the publisher From: google in alt.freeweights.text29.5 GB8BGated2026-11-15

OLMo-2-1124-7B-GGUFHosted (signed) From: allenai in alt.freeweights.olmo70.4 GB—Permissive2026-11-15

OLMo-2-1124-13B-GGUFHosted (signed) From: allenai in alt.freeweights.olmo132 GB—Permissive2026-11-15

gemma-7b-GGUFFrom the publisher From: google in alt.freeweights.gemma34.2 GB—Gated2026-11-15 BitCPM4-1B-GGUFHosted (signed) From: openbmb in alt.freeweights.minicpm1.31 GB—Permissive2026-11-15

codegemma-7b-it-GGUFFrom the publisher From: google in alt.freeweights.gemma50.3 GB—Gated2026-11-15

Bunny-v1_0-4B-ggufHosted (signed) From: BAAI in alt.freeweights.text10.9 GB—Permissive2026-11-15

Bunny-Llama-3-8B-V-ggufHosted (signed) From: BAAI in alt.freeweights.llama21.9 GB—Permissive2026-11-15

codegemma-2b-GGUFFrom the publisher From: google in alt.freeweights.gemma14.4 GB—Gated2026-11-15

codegemma-1.1-7b-it-GGUFFrom the publisher From: google in alt.freeweights.gemma50.3 GB—Gated2026-11-15

gemma-2-2b-GGUFFrom the publisher From: google in alt.freeweights.gemma10.5 GB—Gated2026-11-15

gemma-2b-GGUFFrom the publisher From: google in alt.freeweights.gemma10.0 GB—Gated2026-11-15

gemma-2b-it-GGUFFrom the publisher From: google in alt.freeweights.gemma10.0 GB—Gated2026-11-15

codegemma-1.1-2b-GGUFFrom the publisher From: google in alt.freeweights.gemma14.4 GB—Gated2026-11-15

gemma-1.1-7b-it-GGUFFrom the publisher From: google in alt.freeweights.gemma34.2 GB—Gated2026-11-15 minicpm-dpo-bf16-ggml-model-q4_0Hosted (signed) From: openbmb in alt.freeweights.minicpm1.77 GB—Permissive2026-11-15

codegemma-7b-GGUFFrom the publisher From: google in alt.freeweights.gemma50.3 GB—Gated2026-11-15

gemma-1.1-2b-it-GGUFFrom the publisher From: google in alt.freeweights.gemma10.0 GB—Gated2026-11-15 ar-stablelm-2-chat-ggufFrom the publisher From: stabilityai in alt.freeweights.image1.75 GB—Not reviewed2026-11-15

gemma-7b-itFrom the publisher From: google in alt.freeweights.gemma51.3 GB8.5BGated2026-11-15 MiniCPM-OCR-1.0-DSpark-ggufHosted (signed) From: openbmb in alt.freeweights.minicpm2.98 GB—Permissive2026-11-14 phonon-31m-enHosted (signed) From: gradium in alt.freeweights.speech223 MB41MPermissive2026-11-15

bge-small-en-v1.5-GGUFHosted (signed) From: unsloth in alt.freeweights.embed67.7 MB—Permissive2026-11-15 DeepSeek-Coder-V2-Lite-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.deepseek270 GB—Not reviewed2026-11-15

stories15M_MOEHosted (signed) From: ggml-org in alt.freeweights.text466 MB36MPermissive2026-11-15 Mistral-7B-Instruct-v0.3-GGUFHosted (signed) From: bartowski in alt.freeweights.mistral107 GB—Permissive2026-11-15 sentence-bert-swedish-casedHosted (signed) From: KBLab in alt.freeweights.embed1.25 GB125MPermissive2026-11-15 ZONOS3-MiniHosted (signed) From: Zyphra in alt.freeweights.speech30.7 GB—Permissive2026-11-15 L3-8B-Lunaris-v1-GGUFFrom the publisher From: bartowski in alt.freeweights.text148 GB—Gated2026-11-15 Meta-Llama-3-8B-Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.llama138 GB—Gated2026-11-15 Lexi-Llama-3-8B-Uncensored-GGUFFrom the publisher From: bartowski in alt.freeweights.llama89.6 GB—Gated2026-11-15 Qwen3.5-4B-3D-CoderHosted (signed) From: ccore in alt.freeweights.qwen17.0 GB4.5BPermissive2026-11-15 humanizerHosted (signed) From: jialinyyzz in alt.freeweights.text87.6 GB12BPermissive2026-11-15 Qwen2.5-Coder-7B-Instruct-abliterated-GGUFFrom the publisher From: bartowski in alt.freeweights.abliterated121 GB—Not reviewed2026-11-15 Qwen2.5-14B_Uncensored_Instruct-GGUFFrom the publisher From: bartowski in alt.freeweights.qwen232 GB—Not reviewed2026-11-15

GLM-4-32B-0414-GGUFFrom the publisher From: unsloth in alt.freeweights.glm531 GB—Not reviewed2026-11-15 Phi-3-mini-4k-instruct-GGUFHosted (signed) From: bartowski in alt.freeweights.phi57.1 GB—Permissive2026-11-15

Page 1 of 7Next →

Slide, drag, or use the arrow keys.

No model matches these filters.Remove a filter or search for something shorter.

Every row is downloadable or links to its source. Press / to search, n and p to move in the list.

From: mixedbread-ai <huggingface.co/mixedbread-ai>Newsgroups: alt.freeweights.embedSubject: mxbai-embed-large-v1Date: 2026-11-14Commit: b33106fSigned: 2DC28CC7B26A283B ✓

Feature extraction model with 335M parameters. Gguf and onnx and openvino and safetensors weights, 5.36 GB in all. Published by mixedbread-ai under Apache-2.0.

335M params5.36GBmxbai-embed-large-v1gguf onnx openvino safetensorspermissive

FactsParams335MSize5.36 GBFormatsgguf, onnx, openvino, safetensorsTaskfeature extractionLicenseApache-2.0From sourcepermissive

$ fw get mixedbread-ai/mxbai-embed-large-v1
# manifest sha256 e60db70cfbaa… · 5.36 GB · 21 files
$ fw verify ./mxbai-embed-large-v1 mixedbread-ai/mxbai-embed-large-v1

Open model page

Goal 1: 45 USD, 3 months x 15 USD; or a verified free VM0% fundedREADME: operating statementAllternit, the open source alternative