CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.mistral / Devstral-Small-2-24B-Instruct-2512-GGUF
From: ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.mistralSubject:

Devstral-Small-2-24B-Instruct-2512-GGUF

Date: 2026-11-15Commit: f7fe27cSigned: 2DC28CC7B26A283B ✓

Model. Gguf weights, 25.9 GB in all. Published by ggml-org under Apache-2.0.

mistral25.9GBDevstral-Small-2-24B-Instruct-2512-GGUFggufpermissive
FactsParamsnot statedSize25.9 GBFormatsggufTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF
# manifest sha256 4424b419baad… · 25.9 GB · 4 files
$ fw verify ./Devstral-Small-2-24B-Instruct-2512-GGUF ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF
From sourceHosted (signed)ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUFLast check: 2026-11-15 04:50 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Devstral-Small-2-24B-Instruct-2512.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
25.9 GB
Weights
25.1 GB (GGUF)
Parameters
not stated
Formats
gguf
Task
not tagged
License
Apache-2.0 (permissive)
Files
4, each with a sha256
Publisher
ggml-org
Added
2026-11-15
Section
alt.freeweights.mistral
Lineage

Original release from the publisher.

Base model: mistralai/Devstral-Small-2-24B-Instruct-2512

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:50 UTCpassed

Model card

From the publisher at commit f7fe27c. Shown as plain text with links; images open at the publisher.

Devstral-Small-2-24B-Instruct-2512 GGUF#

Recommended way to run this model:

llama-server -hf ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF -c 0

Then, access http://localhost:8080

Files

4 files · 25.9 GBWeights 25.1 GB (GGUF). Sizes and sha256 from the signed manifest.
Hide all 4 files with their sha256
FileSizesha256
.gitattributes1.69 KBbbaa136a9a02e22913bb6f64346f164a26002dc2c1fafce2444d631f4044414d
Devstral-Small-2-24B-Instruct-2512-Q8_0.gguf25.1 GB3c191981f6d5f1273f98ed716ae4478c054ac99de3e218a9ad3117cd41f50759
README.md263 Be348eed93520fa0e0768c82adda97c5ba5d6e39f5892ab7adadcff2b9c4cc4d7
mmproj-Devstral-Small-2-24B-Instruct-2512-F16.gguf878 MB28e03dd787c1716748e4288c5bd45dbe2e87eca62222b9918fa882f9c9b610f2
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
f7fe27c29b pinned now2026-11-15 04:50 UTC4 files · 25.9 GB

Use it

$ fw get ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF
# manifest sha256 4424b419baad… · 25.9 GB · 4 files
$ fw verify ./Devstral-Small-2-24B-Instruct-2512-GGUF ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF.json --dir ./Devstral-Small-2-24B-Instruct-2512-GGUF $ python3 fw.py verify ./Devstral-Small-2-24B-Instruct-2512-GGUF ./ggml-org__Devstral-Small-2-24B-Instruct-2512-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF --revision f7fe27c29bbd52ba0073ccbfe7beefd4de35dd6d --local-dir ./Devstral-Small-2-24B-Instruct-2512-GGUF
llama.cppDownload one GGUF variant (Devstral-Small-2-24B-Instruct-2512-Q8_0, 25.1 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF --include "Devstral-Small-2-24B-Instruct-2512-Q8_0*" --local-dir ./Devstral-Small-2-24B-Instruct-2512-GGUF $ llama-server -m ./Devstral-Small-2-24B-Instruct-2512-GGUF/Devstral-Small-2-24B-Instruct-2512-Q8_0.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Devstral-Small-2-24B-Instruct-2512-GGUF/Devstral-Small-2-24B-Instruct-2512-Q8_0.gguf\n' > Modelfile $ ollama create devstral-small-2-24b-instruct-2512-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
Inherited from the base model mistralai/Devstral-Small-2-24B-Instruct-2512: the strictest license along the lineage applies. 2026-11-15
Text in
README.md
Text sha256
e348eed93520fa0e0768c82adda97c5ba5d6e39f5892ab7adadcff2b9c4cc4d7
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.mistralSubject: Devstral-Small-2-24B-Instruct-2512-GGUFDate: 2026-11-15Commit: f7fe27cSigned: 2DC28CC7B26A283B ✓
Upstream
ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF
Pinned commit
f7fe27c29bbd52ba0073ccbfe7beefd4de35dd6d
Manifest
Devstral-Small-2-24B-Instruct-2512-GGUF.json · .minisig
Manifest sha256
4424b419baadee25176fdffe0c3ed7c3e56ab3e00fcfc38c136cd720a251ac38
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:50 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF.json.minisig $ minisign -Vm Devstral-Small-2-24B-Instruct-2512-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

mistralai/Devstral-Small-2-24B-Instruct-2512 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Devstral-Small-2-24B-Instruct-2512-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF

Related models

All of alt.freeweights.mistral →
From: bartowski <huggingface.co/bartowski>Subject: alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF
From: microsoft <huggingface.co/microsoft>Subject: chatbench-mistral-7b
From: NousResearch <huggingface.co/NousResearch>Subject: DeepHermes-3-Mistral-24B-Preview
From: mistralai <huggingface.co/mistralai>Subject: Devstral-Small-2-24B-Instruct-2512
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-4bit
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-6bit