CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.mistral / Mistral-Small-3.1-24B-Instruct-2503-GGUF
From: ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.mistralSubject:

Mistral-Small-3.1-24B-Instruct-2503-GGUF

Date: 2026-11-15Commit: 68a3e05Signed: 2DC28CC7B26A283B ✓

Image text to text model. Gguf weights, 10.1 GB in all. Published by ggml-org under Apache-2.0.

mistral10.1GBMistral-Small-3.1-24B-Instruct-2503-GGUFggufpermissive
FactsParamsnot statedSize10.1 GBFormatsggufTaskimage text to textLicenseApache-2.0From sourcepermissive
$ fw get ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
# manifest sha256 f63db95df6de… · 10.1 GB · 5 files
$ fw verify ./Mistral-Small-3.1-24B-Instruct-2503-GGUF ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
From sourceHosted (signed)ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUFLast check: 2026-11-15 05:15 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Mistral-Small-3.1-24B-Instruct-2503.

Works with

Run13Convert1Evaluate13Scan12Apps62

Convert with

ggml
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
10.1 GB
Weights
8.76 GB (GGUF)
Parameters
not stated
Formats
gguf
Task
image text to text
License
Apache-2.0 (permissive)
Files
5, each with a sha256
Publisher
ggml-org
Added
2026-11-15
Section
alt.freeweights.mistral
Lineage

Original release from the publisher.

Base model: mistralai/Mistral-Small-3.1-24B-Instruct-2503

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:15 UTCpassed

Model card

From the publisher at commit 68a3e05. Shown as plain text with links; images open at the publisher.

Mistral-Small-3.1-24B-Instruct-2503 with VISION support#

IMPORTANT: This repo is mainly used for CI testing purpose, so we don't upload all quants possible, only some of them.

The text model borrowed from UnslothAI, all credits to them: https://huggingface.co/unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

mmproj is generated from convert_hf_to_gguf.py with --mmproj option

For more details, see: https://github.com/ggml-org/llama.cpp/pull/13231

Files

5 files · 10.1 GBWeights 8.76 GB (GGUF). Sizes and sha256 from the signed manifest.
Hide all 5 files with their sha256
FileSizesha256
.gitattributes1.78 KBa53b4948d5a851149e2ee0025912065d329e1143b523f2d531701d507f8ee259
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf8.76 GBfadb5c04d1140ac878f8e59187853258a2c0e4e127ddcb19cc76a111a9450b3a
README.md587 B2e1907bea3d9ffea1121a909b5a3a2c0db90b5ab4d3a992d710192b3250a415a
mmproj-Mistral-Small-3.1-24B-Instruct-2503-Q8_0.gguf467 MB6de5bee5ce4950fa362b97b875d0ffd1ae7e058c399834c1d0d1f7b014714fb4
mmproj-Mistral-Small-3.1-24B-Instruct-2503-f16.gguf878 MB26594528d61f4a10e39e3d72ab44a784a2213a7c710ee93d5cb55e60cf6b5c78
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
68a3e055a6 pinned now2026-11-15 05:15 UTC5 files · 10.1 GB

Use it

$ fw get ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
# manifest sha256 f63db95df6de… · 10.1 GB · 5 files
$ fw verify ./Mistral-Small-3.1-24B-Instruct-2503-GGUF ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF.json --dir ./Mistral-Small-3.1-24B-Instruct-2503-GGUF $ python3 fw.py verify ./Mistral-Small-3.1-24B-Instruct-2503-GGUF ./ggml-org__Mistral-Small-3.1-24B-Instruct-2503-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF --revision 68a3e055a6ec6952faa1db12aea9592e23d890e0 --local-dir ./Mistral-Small-3.1-24B-Instruct-2503-GGUF
llama.cppDownload one GGUF variant (Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M, 8.76 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF --include "Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M*" --local-dir ./Mistral-Small-3.1-24B-Instruct-2503-GGUF $ llama-server -m ./Mistral-Small-3.1-24B-Instruct-2503-GGUF/Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Mistral-Small-3.1-24B-Instruct-2503-GGUF/Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf\n' > Modelfile $ ollama create mistral-small-3.1-24b-instruct-2503-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
2e1907bea3d9ffea1121a909b5a3a2c0db90b5ab4d3a992d710192b3250a415a
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.mistralSubject: Mistral-Small-3.1-24B-Instruct-2503-GGUFDate: 2026-11-15Commit: 68a3e05Signed: 2DC28CC7B26A283B ✓
Upstream
ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
Pinned commit
68a3e055a6ec6952faa1db12aea9592e23d890e0
Manifest
Mistral-Small-3.1-24B-Instruct-2503-GGUF.json · .minisig
Manifest sha256
f63db95df6de51b6bcd8be4130c45651bde0f7bc277a516cf7dc8722b0fef988
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:15 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF.json.minisig $ minisign -Vm Mistral-Small-3.1-24B-Instruct-2503-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

mistralai/Mistral-Small-3.1-24B-Instruct-2503 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Mistral-Small-3.1-24B-Instruct-2503-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Related models

All of alt.freeweights.mistral →
From: bartowski <huggingface.co/bartowski>Subject: alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF
From: microsoft <huggingface.co/microsoft>Subject: chatbench-mistral-7b
From: NousResearch <huggingface.co/NousResearch>Subject: DeepHermes-3-Mistral-24B-Preview
From: mistralai <huggingface.co/mistralai>Subject: Devstral-Small-2-24B-Instruct-2512
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-4bit
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-6bit