CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.mistral / Mistral-Small-24B-Instruct-2501-4bit
From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.mistralSubject:

Mistral-Small-24B-Instruct-2501-4bit

Date: 2026-11-15Commit: 51ed0c6Signed: 2DC28CC7B26A283B ✓

Model with 23.6B parameters. Safetensors weights, 13.3 GB in all. Published by mlx-community under Apache-2.0.

23.6B params13.3GBMistral-Small-24B-Instruct-2501-4bitsafetensorspermissive
FactsParams23.6BSize13.3 GBFormatssafetensorsTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get mlx-community/Mistral-Small-24B-Instruct-2501-4bit
# manifest sha256 c7e365f9d3d5… · 13.3 GB · 10 files
$ fw verify ./Mistral-Small-24B-Instruct-2501-4bit mlx-community/Mistral-Small-24B-Instruct-2501-4bit
From sourceHosted (signed)mlx-community/Mistral-Small-24B-Instruct-2501-4bitLast check: 2026-11-15 05:11 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Mistral-Small-24B-Instruct-2501.

Works with

Run8Fine-tune7Convert8Scan2

Runs with

Ranked by fit to this model (safetensors), then by GitHub stars.

TransformersLocalAItinygradTriton Inference ServerBentoMLCTranslate2ExLlamaV2LitServe
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
13.3 GB
Weights
13.3 GB (safetensors)
Parameters
23.6B
Formats
safetensors
Task
not tagged
License
Apache-2.0 (permissive)
Files
10, each with a sha256
Publisher
mlx-community
Added
2026-11-15
Section
alt.freeweights.mistral
Lineage

Original release from the publisher.

Base model: mistralai/Mistral-Small-24B-Instruct-2501

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:11 UTCpassed

Model card

From the publisher at commit 51ed0c6. Shown as plain text with links; images open at the publisher.

mlx-community/Mistral-Small-24B-Instruct-2501-4bit#

The Model mlx-community/Mistral-Small-24B-Instruct-2501-4bit was converted to MLX format from mistralai/Mistral-Small-24B-Instruct-2501 using mlx-lm version 0.21.0.

Use with mlx#

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Mistral-Small-24B-Instruct-2501-4bit")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Files

10 files · 13.3 GBWeights 13.3 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 10 files with their sha256
FileSizesha256
.gitattributes1.57 KB34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
README.md1.16 KB044a48f4e334822c0068fbd6502c5f251c90780621f9a71e18ec34d3e6111d54
config.json825 B8b4413498badd74aee46afc4071633533c0749883024394afb4cc1c96b6c80f1
model-00001-of-00003.safetensors5.29 GB4c93bf99bd4f467c55f77eb9555685cf2c00bce50e8b7d22f3b300bc6327b005
model-00002-of-00003.safetensors5.31 GB1d83f155ea967330209f8eeb226cdb4468d932e9b9cb3579f674474f52c0b777
model-00003-of-00003.safetensors2.66 GB570ee17d38facfcf6fc8000c7b3b6e71ecbaee2180c976a107d6cc69129fcdf8
model.safetensors.index.json79.3 KB42180bd2e96e647bf8528c861f5c25adfbf8dfa87e12fe6e7662df4beeafe5f0
special_tokens_map.json21.3 KB5bc5d1c106bf86895473568ef5211f3fde8415e6fdee039223d6db8ca52cbe01
tokenizer.json17.1 MBb76085f9923309d873994d444989f7eb6ec074b06f25b58f1e8d7b7741070949
tokenizer_config.json198 KB19b35bf8e9a0d4c8c48e4a5773963e6b9872ae3b65c1f44e8152ce54fb48c1ab
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
51ed0c6d2f pinned now2026-11-15 05:11 UTC10 files · 13.3 GB

Use it

$ fw get mlx-community/Mistral-Small-24B-Instruct-2501-4bit
# manifest sha256 c7e365f9d3d5… · 13.3 GB · 10 files
$ fw verify ./Mistral-Small-24B-Instruct-2501-4bit mlx-community/Mistral-Small-24B-Instruct-2501-4bit
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/Mistral-Small-24B-Instruct-2501-4bit.json --dir ./Mistral-Small-24B-Instruct-2501-4bit $ python3 fw.py verify ./Mistral-Small-24B-Instruct-2501-4bit ./mlx-community__Mistral-Small-24B-Instruct-2501-4bit.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/Mistral-Small-24B-Instruct-2501-4bit --revision 51ed0c6d2f98a25d8a60f19994f0e86c944995e0 --local-dir ./Mistral-Small-24B-Instruct-2501-4bit
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
044a48f4e334822c0068fbd6502c5f251c90780621f9a71e18ec34d3e6111d54
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.mistralSubject: Mistral-Small-24B-Instruct-2501-4bitDate: 2026-11-15Commit: 51ed0c6Signed: 2DC28CC7B26A283B ✓
Upstream
mlx-community/Mistral-Small-24B-Instruct-2501-4bit
Pinned commit
51ed0c6d2f98a25d8a60f19994f0e86c944995e0
Manifest
Mistral-Small-24B-Instruct-2501-4bit.json · .minisig
Manifest sha256
c7e365f9d3d503a46386cc7af9400fc819ff40a00e65fa6208fd500df33391e7
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:11 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/mlx-community/Mistral-Small-24B-Instruct-2501-4bit.json $ curl -O https://freeweights.allternit.com/manifests/mlx-community/Mistral-Small-24B-Instruct-2501-4bit.json.minisig $ minisign -Vm Mistral-Small-24B-Instruct-2501-4bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

mistralai/Mistral-Small-24B-Instruct-2501 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/Mistral-Small-24B-Instruct-2501-4bit
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Mistral-Small-24B-Instruct-2501-4bit.json. Provenance. Takedown history: none.
Source
huggingface.co/mlx-community/Mistral-Small-24B-Instruct-2501-4bit

Related models

All of alt.freeweights.mistral →
From: bartowski <huggingface.co/bartowski>Subject: alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF
From: microsoft <huggingface.co/microsoft>Subject: chatbench-mistral-7b
From: NousResearch <huggingface.co/NousResearch>Subject: DeepHermes-3-Mistral-24B-Preview
From: mistralai <huggingface.co/mistralai>Subject: Devstral-Small-2-24B-Instruct-2512
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-4bit
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-6bit