CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.mistral / Mistral-Nemo-Instruct-2407-GGUF
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.mistralSubject:

Mistral-Nemo-Instruct-2407-GGUF

Date: 2026-11-15Commit: 6ce5144Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 74.7 GB in all. Published by unsloth under Apache-2.0.

mistral74.7GBMistral-Nemo-Instruct-2407-GGUFggufpermissive
FactsParamsnot statedSize74.7 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get unsloth/Mistral-Nemo-Instruct-2407-GGUF
# manifest sha256 c394345bf739… · 74.7 GB · 10 files
$ fw verify ./Mistral-Nemo-Instruct-2407-GGUF unsloth/Mistral-Nemo-Instruct-2407-GGUF
From sourceHosted (signed)unsloth/Mistral-Nemo-Instruct-2407-GGUFLast check: 2026-11-15 03:26 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run14Convert1Evaluate13Scan12Apps58

Convert with

ggml
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
74.7 GB
Weights
4.79 GB (smallest of 7 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
Apache-2.0 (permissive)
Files
10, each with a sha256
Publisher
unsloth
Added
2026-11-15
Section
alt.freeweights.mistral
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 03:26 UTCpassed

Model card

From the publisher at commit 6ce5144. Shown as plain text with links; images open at the publisher.

GGUF uploads#

Finetune Mistral, Gemma, Llama 2-5x faster with 70% less memory via Unsloth!#

We have a free Google Colab Tesla T4 notebook for Mistral Nemo 12b here: https://colab.research.google.com/drive/17d3U-CAIwzmbDRqbZ9NnpHxCkmXB6LZ0?usp=sharing

https://discord.gg/u54VK8m8tk https://ko-fi.com/unsloth https://github.com/unslothai/unsloth

✨ Finetune for Free#

All notebooks are beginner friendly! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.

Unsloth supportsFree NotebooksPerformanceMemory use
Llama-3 8b▶️ Start on Colab2.4x faster58% less
Gemma 7b▶️ Start on Colab2.4x faster58% less
Mistral 7b▶️ Start on Colab2.2x faster62% less
Llama-2 7b▶️ Start on Colab2.2x faster43% less
TinyLlama▶️ Start on Colab3.9x faster74% less
CodeLlama 34b A100▶️ Start on Colab1.9x faster27% less
Mistral 7b 1xT4▶️ Start on Kaggle5x faster\*62% less
DPO - Zephyr▶️ Start on Colab1.9x faster19% less

Files

10 files · 74.7 GBWeights 4.79 GB (smallest of 7 GGUF variants). Sizes and sha256 from the signed manifest.
Hide all 10 files with their sha256
FileSizesha256
.gitattributes2.42 KB476bf675c2dd39fcc393e5388301f00716705f7bca6b78fde6cc9a6ae786a97b
Mistral-Nemo-Instruct-2407.Q2_K.gguf4.79 GBe2631c7397d90d3a5338f25d204e704f4acb65211fa225a0e48257e4c24cfc6e
Mistral-Nemo-Instruct-2407.Q3_K_M.gguf6.08 GB73eefb32c22b499c3304a02a16f3a98c61ef8982d21efa80de833c5e2a48bae2
Mistral-Nemo-Instruct-2407.Q4_K_M.gguf7.48 GBc9351b2cfbb70d1708a45e3364ef7cb17b8b6549b7c432687fc4423cf00af4a5
Mistral-Nemo-Instruct-2407.Q5_K_M.gguf8.73 GBf56b919141f9990324b8d2e023a1a27e6d018f3e2a3fd0d8472e87b57539e219
Mistral-Nemo-Instruct-2407.Q6_K.gguf10.1 GB7096f95b217d9f67f9e9418225038129980adc3f9570cc7bf3f678596a811c2b
Mistral-Nemo-Instruct-2407.Q8_0.gguf13.0 GBebda16db6c350a4dd7841a5b961d3c9f9f42005c8dc769e714aec6625a059083
Mistral-Nemo-Instruct-2407.f16.gguf24.5 GBb1a814774ba140c90621207301f8abc5f470bbead7994781021beb81051ca8c1
README.md3.26 KBc315f2efd326b99e5d6f4e0117d1e6634bb94c89b015f8376be1d8c901650ea8
config.json623 B11d36c89896b44021fe2d6654f9f877b94702561eb9d710471caa777fb5581ad
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
6ce5144b3e pinned now2026-11-15 03:26 UTC10 files · 74.7 GB

Use it

$ fw get unsloth/Mistral-Nemo-Instruct-2407-GGUF
# manifest sha256 c394345bf739… · 74.7 GB · 10 files
$ fw verify ./Mistral-Nemo-Instruct-2407-GGUF unsloth/Mistral-Nemo-Instruct-2407-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/Mistral-Nemo-Instruct-2407-GGUF.json --dir ./Mistral-Nemo-Instruct-2407-GGUF $ python3 fw.py verify ./Mistral-Nemo-Instruct-2407-GGUF ./unsloth__Mistral-Nemo-Instruct-2407-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Mistral-Nemo-Instruct-2407-GGUF --revision 6ce5144b3ed09c5cf26c7c127f7fb2e67de659d3 --local-dir ./Mistral-Nemo-Instruct-2407-GGUF
llama.cppDownload one GGUF variant (Mistral-Nemo-Instruct-2407.Q2_K, 4.79 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Mistral-Nemo-Instruct-2407-GGUF --include "Mistral-Nemo-Instruct-2407.Q2_K*" --local-dir ./Mistral-Nemo-Instruct-2407-GGUF $ llama-server -m ./Mistral-Nemo-Instruct-2407-GGUF/Mistral-Nemo-Instruct-2407.Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Mistral-Nemo-Instruct-2407-GGUF/Mistral-Nemo-Instruct-2407.Q2_K.gguf\n' > Modelfile $ ollama create mistral-nemo-instruct-2407-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
c315f2efd326b99e5d6f4e0117d1e6634bb94c89b015f8376be1d8c901650ea8
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.mistralSubject: Mistral-Nemo-Instruct-2407-GGUFDate: 2026-11-15Commit: 6ce5144Signed: 2DC28CC7B26A283B ✓
Upstream
unsloth/Mistral-Nemo-Instruct-2407-GGUF
Pinned commit
6ce5144b3ed09c5cf26c7c127f7fb2e67de659d3
Manifest
Mistral-Nemo-Instruct-2407-GGUF.json · .minisig
Manifest sha256
c394345bf7394a6ce81e2ea5ebac1a82239755cb27c25eef58fcc1ef6e49b924
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 03:26 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/Mistral-Nemo-Instruct-2407-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/Mistral-Nemo-Instruct-2407-GGUF.json.minisig $ minisign -Vm Mistral-Nemo-Instruct-2407-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Mistral-Nemo-Instruct-2407-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Mistral-Nemo-Instruct-2407-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/unsloth/Mistral-Nemo-Instruct-2407-GGUF

Related models

All of alt.freeweights.mistral →
From: bartowski <huggingface.co/bartowski>Subject: alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF
From: microsoft <huggingface.co/microsoft>Subject: chatbench-mistral-7b
From: NousResearch <huggingface.co/NousResearch>Subject: DeepHermes-3-Mistral-24B-Preview
From: mistralai <huggingface.co/mistralai>Subject: Devstral-Small-2-24B-Instruct-2512
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-4bit
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-6bit