CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.text / Jan-nano-GGUF
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.textSubject:

Jan-nano-GGUF

Date: 2026-11-15Commit: 58c721dSigned: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 67.8 GB in all. Published by unsloth under Apache-2.0.

text67.8GBJan-nano-GGUFggufpermissive
FactsParamsnot statedSize67.8 GBFormatsggufTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get unsloth/Jan-nano-GGUF
# manifest sha256 57d6643e5719… · 67.8 GB · 28 files
$ fw verify ./Jan-nano-GGUF unsloth/Jan-nano-GGUF
From sourceHosted (signed)unsloth/Jan-nano-GGUFLast check: 2026-11-15 05:00 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Jan-nano.

Works with

Run14Convert1Evaluate13Scan12Apps58

Convert with

ggml
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
67.8 GB
Weights
1.08 GB (smallest of 26 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
Apache-2.0 (permissive)
Files
28, each with a sha256
Publisher
unsloth
Added
2026-11-15
Section
alt.freeweights.text
Lineage

Original release from the publisher.

Base model: Menlo/Jan-nano

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:00 UTCpassed

Model card

From the publisher at commit 58c721d. Shown as plain text with links; images open at the publisher.

Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants.

https://github.com/unslothai/unsloth/ https://discord.gg/unsloth https://docs.unsloth.ai/basics/qwen3-how-to-run-and-fine-tune

Jan-Nano: A 4B MCP-Optimized DeepResearch Model#

GitHub

Image: Jan-Nano

Overview#

Jan-Nano is a compact 4-billion parameter language model specifically designed and trained for deep research tasks. This model has been optimized to work seamlessly with Model Context Protocol (MCP) servers, enabling efficient integration with various research tools and data sources.

Evaluation#

Jan-Nano has been evaluated on the SimpleQA benchmark using our MCP-based benchmark methodology, demonstrating strong performance for its model size:

Image: image/png

The evaluation was conducted using our MCP-based benchmark approach, which assesses the model's performance on SimpleQA tasks while leveraging its native MCP server integration capabilities. This methodology better reflects Jan-Nano's real-world performance as a tool-augmented research model, validating both its factual accuracy and its effectiveness in MCP-enabled environments.

How to Run Locally#

Image: Jan-Nano Demo

Jan-Nano is supported by Jan), an open-source ChatGPT alternative that runs entirely on your computer. Jan provides a user-friendly interface for running local AI models with full privacy and control.

Files

28 files · 67.8 GBWeights 1.08 GB (smallest of 26 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 28 files with their sha256
FileSizesha256
.gitattributes2.79 KBe3940060ed8e88e43f6a2ea35a604200da4dcbb7d8d81d344edc140547224d41
Jan-nano-BF16.gguf8.05 GB012226c75c16fcdae5f0297369df23e98f3fcbfe36bab2e2f1032a3f97444ce4
Jan-nano-IQ4_NL.gguf2.38 GB3edcff6f0752aec817d45678dcb912f204845d77628961cf65acacd3a8cf9874
Jan-nano-IQ4_XS.gguf2.27 GBa6fa13732460d51dd9cf91c18e7184f17bad2711ebfa9bab3225509381f02dbf
Jan-nano-Q2_K.gguf1.67 GB262256836f2df5ef76ba0a7a927aae4151d882a39914080200e8220a180c8c69
Jan-nano-Q2_K_L.gguf1.67 GB262256836f2df5ef76ba0a7a927aae4151d882a39914080200e8220a180c8c69
Jan-nano-Q3_K_M.gguf2.08 GBb0a6347739585cc79c92a711f34fe83fdb76b8ab6135b3462467e8eee259ec95
Jan-nano-Q3_K_S.gguf1.89 GB3f91ebcd4e008cdf86b6dfa1fb862690c15e4fda872a95e6e0f9a44e771615f4
Jan-nano-Q4_0.gguf2.38 GB550268573f878adb1c4603805efc0fdc2c4adf2f57bfa6bd7e09111c7b4dfa41
Jan-nano-Q4_1.gguf2.60 GB3169fd586789e90f2d31a1e2960def96b603a4efc2791ff59fa22c17ec34c015
Jan-nano-Q4_K_M.gguf2.50 GB5dcd9c20e8d5b2ae444e2cf747bd2ad968970095e017515927b4377159f0449d
Jan-nano-Q4_K_S.gguf2.38 GB7db2c1b18f634ff287668056fbc906d679acffa83b07df9da11742c57d13f879
Jan-nano-Q5_K_M.gguf2.89 GBcbaea3e7e2970629228741ad65c44d1117fdfc269930b18648defdf140567170
Jan-nano-Q5_K_S.gguf2.82 GBf3fb1f0312aacbcb351d13b347cf07e3739222008cf5bd5047d057f4c36765e6
Jan-nano-Q6_K.gguf3.31 GB5f86f050a0e832cae2321744104ec3ce32eb4712167e39c26954673dc749f197
Jan-nano-Q8_0.gguf4.28 GB3c168a9052c0e33fd02074a510cda6f185fccc30d1b0e57197b35cd6b4f1fa3a
Jan-nano-UD-IQ1_M.gguf1.14 GB4e97ac3e532854f29e7841037a0f088c0f058aae077f93529e828fe9555bd84e
Jan-nano-UD-IQ1_S.gguf1.08 GBd6dd27d54732a28616091edd829d1f994936152d4b0d2c0e8715875fbd622b1f
Jan-nano-UD-IQ2_M.gguf1.53 GBf0d6decf9e29a5f189c30d49b3310e7f22354d6fc14747e38c8114b4dd7d649e
Jan-nano-UD-IQ2_XXS.gguf1.26 GB01405854cceefc54e5ac3331639e2a16763c353fa06b13f00b989541ec208fc6
Jan-nano-UD-IQ3_XXS.gguf1.67 GBf83b92d39c3af5acdb29f54ff65a04e73e2ce3bc0f62ac7cd7500e3f678e341c
Jan-nano-UD-Q2_K_XL.gguf1.70 GB9cdd117366123808b3b861b7e92fe975405882a5ee45183e515c2bdeeed92dfa
Jan-nano-UD-Q3_K_XL.gguf2.13 GB9caf58dd7c8b9c61fb147699e2f0ce135fa5c13cfbaf88d5d51a394d0d27e250
Jan-nano-UD-Q4_K_XL.gguf2.55 GBb673dd7d361cdf6261a47624c7943804606aeae171e86d643ec6ebb4fc002fb2
Jan-nano-UD-Q5_K_XL.gguf2.91 GB607d8486a30058b79e4495c6efd7f3d0de7886058cf651921971e6b770605161
Jan-nano-UD-Q6_K_XL.gguf3.66 GBd6b8b14b326b01b6ce878a7d165e7fc58ecbdcb25df2e1fc9d246c61b623e7fc
Jan-nano-UD-Q8_K_XL.gguf5.06 GB5eabb93697bd9fcb58a0362974257a21cb34915b01056cba618bff7348ff7f2f
README.md2.57 KB21fa035a6066e4c5b7d9ba3ad6f6b54b04591738a6d31f34d457bb2eda12a9c9
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
58c721d228 pinned now2026-11-15 05:00 UTC28 files · 67.8 GB

Use it

$ fw get unsloth/Jan-nano-GGUF
# manifest sha256 57d6643e5719… · 67.8 GB · 28 files
$ fw verify ./Jan-nano-GGUF unsloth/Jan-nano-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/Jan-nano-GGUF.json --dir ./Jan-nano-GGUF $ python3 fw.py verify ./Jan-nano-GGUF ./unsloth__Jan-nano-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Jan-nano-GGUF --revision 58c721d228389c5256c8c18d562153fb177b8789 --local-dir ./Jan-nano-GGUF
llama.cppDownload one GGUF variant (Jan-nano-UD-IQ1_S, 1.08 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Jan-nano-GGUF --include "Jan-nano-UD-IQ1_S*" --local-dir ./Jan-nano-GGUF $ llama-server -m ./Jan-nano-GGUF/Jan-nano-UD-IQ1_S.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./Jan-nano-GGUF/Jan-nano-UD-IQ1_S.gguf\n' > Modelfile $ ollama create jan-nano-gguf -f Modelfile
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
21fa035a6066e4c5b7d9ba3ad6f6b54b04591738a6d31f34d457bb2eda12a9c9
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.textSubject: Jan-nano-GGUFDate: 2026-11-15Commit: 58c721dSigned: 2DC28CC7B26A283B ✓
Upstream
unsloth/Jan-nano-GGUF
Pinned commit
58c721d228389c5256c8c18d562153fb177b8789
Manifest
Jan-nano-GGUF.json · .minisig
Manifest sha256
57d6643e5719a20b8f9e64af138963e141b4cb47046f46dd65f7fc7b0518ddac
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:00 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/Jan-nano-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/Jan-nano-GGUF.json.minisig $ minisign -Vm Jan-nano-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

Menlo/Jan-nano · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/Jan-nano-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Jan-nano-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/unsloth/Jan-nano-GGUF

Related models

All of alt.freeweights.text →
From: laion <huggingface.co/laion>Subject: a2-rl-e2egit_large-50-32B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_mix_h2_language_proportional-65-8B