alt.freeweights.mistral / Mistral-Small-3.2-24B-Instruct-2506-GGUF
From: lmstudio-community <huggingface.co/lmstudio-community>Newsgroups: alt.freeweights.mistralSubject:

Mistral-Small-3.2-24B-Instruct-2506-GGUF

Date: 2026-11-15Commit: 36798e8Signed: 2DC28CC7B26A283B ✓

Image text to text model. Gguf weights, 107 GB in all. Published by lmstudio-community under Apache-2.0.

mistral107GBMistral-Small-3.2-24B-Instruct-2506-GGUFggufpermissive
FactsParamsnot statedSize107 GBFormatsggufTaskimage text to textLicenseApache-2.0From sourcepermissive
$ fw get lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF
# manifest sha256 43ca2d013916… · 107 GB · 7 files
$ fw verify ./Mistral-Small-3.2-24B-Instruct-2506-GGUF lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF
From sourceHosted (signed)lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUFLast check: 2026-11-15 04:41 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Mistral-Small-3.2-24B-Instruct-2506.

Works with

Convert with

Overview

Size
107 GB
Weights
14.3 GB (smallest of 4 GGUF variants)
Parameters
not stated
Formats
gguf
Task
image text to text
License
Apache-2.0 (permissive)
Files
7, each with a sha256
Publisher
lmstudio-community
Added
2026-11-15
Section
alt.freeweights.mistral
Lineage

Original release from the publisher.

Base model: mistralai/Mistral-Small-3.2-24B-Instruct-2506

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:41 UTCpassed

Model card

From the publisher at commit 36798e8. Shown as plain text with links; images open at the publisher.

💫 Community Model> Mistral Small 3.2 24B Instruct 2506 by Mistralai#

👾 LM Studio Community models highlights program. Highlighting new & noteworthy models by the community. Join the conversation on Discord.

Model creator: mistralai

Original model: Mistral-Small-3.2-24B-Instruct-2506

GGUF quantization: provided by lmmy based on llama.cpp release b5726

Technical Details#

Text and image input. Text output.

Supports a context length of 128k.

Supports dozens of languages, including English, French, German, Spanish, Portuguese, Italian, Japanese, Korean, Russian, Chinese, Arabic, Persian, Indonesian, Malay, Nepali, Polish, Romanian, Serbian, Swedish, Turkish, Ukrainian, Vietnamese, Hindi, and Bengali.

This model's tool calling performance may be degraded. Stay tuned for more updates from the team.

Special thanks#

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Disclaimers#

LM Studio is not the creator, originator, or owner of any Model featured in the Community Model Program. Each Community Model is created and provided by third parties. LM Studio does not endorse, support, represent or guarantee the completeness, truthfulness, accuracy, or reliability of any Community Model. You understand that Community Models can produce content that might be offensive, harmful, inaccurate or otherwise inappropriate, or deceptive. Each Community Model is the sole responsibility of the person or entity who originated such Model. LM Studio may not monitor or control the Community Models and cannot, and does not, take responsibility for any such Model. LM Studio disclaims all warranties or guarantees about the accuracy, reliability or benefits of the Community Models. LM Studio further disclaims any warranty that the Community Model will meet your requirements, be secure, uninterrupted or available at any time or location, or error-free, viruses-free, or that any errors will be corrected, or otherwise. You will be solely responsible for any damage resulting from your use of or access to the Community Models, your downloading of any Community Model, or use of any other Community Model provided by or through LM Studio.

Files

7 files · 107 GBWeights 14.3 GB (smallest of 4 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 7 files with their sha256
FileSizesha256
.gitattributes1.94 KB1bb500ec0a7002a69e675496723a20f2c92b2a0b180f742546e8fc8c8458bf48
Mistral-Small-3.2-24B-Instruct-2506-F16.gguf47.2 GB8365414bd54eb221f9b03387c5db26a02bbf8062752d89ac477ef1439da69f73
Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf14.3 GB9829cc54f2105c79499b783e81fbb476b610e91ee9373cc68334c267e49f6bbc
Mistral-Small-3.2-24B-Instruct-2506-Q6_K.gguf19.3 GB3eece79d91c54e9766d557274e9f5dfe4ffbe9b502ab7892a4bc48a9cc1c43e1
Mistral-Small-3.2-24B-Instruct-2506-Q8_0.gguf25.1 GBab6c4a8e27a255359acf31ca34e1bcb1320b4e1bfcc6ab2e3df6e549fde1848a
README.md2.83 KB3095abb6c58eb36a158b088f225021f8587c1461d4875bf266b0526eb601f90a
mmproj-Mistral-Small-3.2-24B-Instruct-2506-F16.gguf878 MBa3d0966c1331a2ad48f7c8fe2ffdb1c2b39116f69dc0f2e38f4a1ea01c74874b
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
36798e8b85 pinned now2026-11-15 04:41 UTC7 files · 107 GB

Use it

$ fw get lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF
# manifest sha256 43ca2d013916… · 107 GB · 7 files
$ fw verify ./Mistral-Small-3.2-24B-Instruct-2506-GGUF lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF.json --dir ./Mistral-Small-3.2-24B-Instruct-2506-GGUF $ python3 fw.py verify ./Mistral-Small-3.2-24B-Instruct-2506-GGUF ./lmstudio-community__Mistral-Small-3.2-24B-Instruct-2506-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF --revision 36798e8b853bcf0ce899aeba9f8a7530ff1991fe --local-dir ./Mistral-Small-3.2-24B-Instruct-2506-GGUF
llama.cppDownload one GGUF variant (Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M, 14.3 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF --include "Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M*" --local-dir ./Mistral-Small-3.2-24B-Instruct-2506-GGUF $ llama-server -m ./Mistral-Small-3.2-24B-Instruct-2506-GGUF/Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Mistral-Small-3.2-24B-Instruct-2506-GGUF/Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf\n' > Modelfile $ ollama create mistral-small-3.2-24b-instruct-2506-gguf -f Modelfile

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
3095abb6c58eb36a158b088f225021f8587c1461d4875bf266b0526eb601f90a
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: lmstudio-community <huggingface.co/lmstudio-community>Newsgroups: alt.freeweights.mistralSubject: Mistral-Small-3.2-24B-Instruct-2506-GGUFDate: 2026-11-15Commit: 36798e8Signed: 2DC28CC7B26A283B ✓
Upstream
lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF
Pinned commit
36798e8b853bcf0ce899aeba9f8a7530ff1991fe
Manifest
Mistral-Small-3.2-24B-Instruct-2506-GGUF.json · .minisig
Manifest sha256
43ca2d01391615cd0090f80ff0c06bd73138512d27885bd6ecfbf5ac052f5ee8
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:41 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF.json.minisig $ minisign -Vm Mistral-Small-3.2-24B-Instruct-2506-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

mistralai/Mistral-Small-3.2-24B-Instruct-2506 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Mistral-Small-3.2-24B-Instruct-2506-GGUF.json. Provenance. Takedown history: none.
From: bartowski <huggingface.co/bartowski>Subject: alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF
From: microsoft <huggingface.co/microsoft>Subject: chatbench-mistral-7b
From: NousResearch <huggingface.co/NousResearch>Subject: DeepHermes-3-Mistral-24B-Preview
From: mistralai <huggingface.co/mistralai>Subject: Devstral-Small-2-24B-Instruct-2512
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-4bit
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-6bit