alt.freeweights.deepseek / deepseek-ai_DeepSeek-V3.1-GGUF

From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.deepseekSubject:

deepseek-ai_DeepSeek-V3.1-GGUF

Date: 2026-11-15Commit: a7ccff7Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 7.57 TB in all. Published by bartowski under MIT.

deepseek7.57TBdeepseek-ai_DeepSeek-V3.1-GGUFggufpermissive

FactsParamsnot statedSize7.57 TBFormatsggufTasktext generationLicenseMITFrom sourcepermissive

$ fw get bartowski/deepseek-ai_DeepSeek-V3.1-GGUF
# manifest sha256 76e417740cc4… · 7.57 TB · 210 files
$ fw verify ./deepseek-ai_DeepSeek-V3.1-GGUF bartowski/deepseek-ai_DeepSeek-V3.1-GGUF

From sourceHosted (signed)bartowski/deepseek-ai_DeepSeek-V3.1-GGUFLast check: 2026-11-15 04:43 UTC

Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of DeepSeek-V3.1.

Works with

Run14 Convert1 Evaluate13 Scan12 Apps58

Runs with

Ranked by fit to this model (gguf), then by GitHub stars.

Text Generation WebUI mistral.rs

Ollama

llama.cpp LocalAI

BitNet llamafile gpu-unlock KoboldCpp PocketPal AI llama-swap ik_llama.cpp

Show all 14

RamaLama Maid

Convert with

ggml

Evaluate with

Opik DeepEval Ragas lm-evaluation-harness OpenCompass SWE-bench

simple-evals TruLens HELM

LightEval

Evaluate Weave

Show all 13

Autoevals

Scan with

promptfoo garak Guardrails NeMo Guardrails Giskard DeepTeam AI Fairness 360 Fairlearn Detoxify MCP Scanner AgentDojo ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 7.57 TB
Weights: 1.01 GB (smallest of 24 GGUF variants)
Parameters: not stated
Formats: gguf
Task: text generation
License: MIT (permissive)
Files: 210, each with a sha256
Publisher: bartowski
Added: 2026-11-15
Section: alt.freeweights.deepseek

Lineage

Original release from the publisher.

Base model: deepseek-ai/DeepSeek-V3.1

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 04:43 UTC	passed

Model card

From the publisher at commit a7ccff7. Shown as plain text with links; images open at the publisher.

Llamacpp imatrix Quantizations of DeepSeek-V3.1 by deepseek-ai#

Using llama.cpp release b6214 for quantization.

Original model: https://huggingface.co/deepseek-ai/DeepSeek-V3.1

All quants made using imatrix option with dataset from here combined with a subset of combined_all_small.parquet from Ed Addario here

Run them in LM Studio

Run them directly with llama.cpp, or any other llama.cpp based project

Prompt format#

No prompt format found, check original model page

Download a file (not the whole branch) from below:#

Filename	Quant type	File Size	Split	Description
DeepSeek-V3.1-Q8_0.gguf	Q8_0	713.29GB	true	Extremely high quality, generally unneeded but max available quant.
DeepSeek-V3.1-Q6_K.gguf	Q6_K	552.45GB	true	Very high quality, near perfect, recommended.
DeepSeek-V3.1-Q5_K_M.gguf	Q5_K_M	478.34GB	true	High quality, recommended.
DeepSeek-V3.1-Q4_1.gguf	Q4_1	421.04GB	true	Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon.
DeepSeek-V3.1-Q4_K_M.gguf	Q4_K_M	409.23GB	true	Good quality, default size for most use cases, recommended.
DeepSeek-V3.1-Q4_K_S.gguf	Q4_K_S	394.15GB	true	Slightly lower quality with more space savings, recommended.
DeepSeek-V3.1-Q4_0.gguf	Q4_0	386.42GB	true	Legacy format, offers online repacking for ARM and AVX CPU inference.
DeepSeek-V3.1-IQ4_NL.gguf	IQ4_NL	380.48GB	true	Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference.
DeepSeek-V3.1-IQ4_XS.gguf	IQ4_XS	359.98GB	true	Decent quality, smaller than Q4_K_S with similar performance, recommended.
DeepSeek-V3.1-Q3_K_XL.gguf	Q3_K_XL	320.52GB	true	Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability.
DeepSeek-V3.1-Q3_K_L.gguf	Q3_K_L	319.71GB	true	Lower quality but usable, good for low RAM availability.
DeepSeek-V3.1-Q3_K_M.gguf	Q3_K_M	307.93GB	true	Low quality.
DeepSeek-V3.1-IQ3_M.gguf	IQ3_M	307.88GB	true	Medium-low quality, new method with decent performance comparable to Q3_K_M.
DeepSeek-V3.1-Q3_K_S.gguf	Q3_K_S	293.35GB	true	Low quality, not recommended.
DeepSeek-V3.1-IQ3_XS.gguf	IQ3_XS	277.15GB	true	Lower quality, new method with decent performance, slightly better than Q3_K_S.
DeepSeek-V3.1-IQ3_XXS.gguf	IQ3_XXS	267.63GB	true	Lower quality, new method with decent performance, comparable to Q3 quants.
DeepSeek-V3.1-Q2_K_L.gguf	Q2_K_L	238.74GB	true	Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable.
DeepSeek-V3.1-Q2_K.gguf	Q2_K	237.83GB	true	Very low quality but surprisingly usable.
DeepSeek-V3.1-IQ2_M.gguf	IQ2_M	215.04GB	true	Relatively low quality, uses SOTA techniques to be surprisingly usable.
DeepSeek-V3.1-IQ2_S.gguf	IQ2_S	189.63GB	true	Low quality, uses SOTA techniques to be usable.
DeepSeek-V3.1-IQ2_XS.gguf	IQ2_XS	188.41GB	true	Low quality, uses SOTA techniques to be usable.
DeepSeek-V3.1-IQ2_XXS.gguf	IQ2_XXS	164.06GB	true	Very low quality, uses SOTA techniques to be usable.
DeepSeek-V3.1-IQ1_M.gguf	IQ1_M	147.45GB	true	Extremely low quality, not recommended.

Embed/output weights#

Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.

Downloading using huggingface-cli#

Click to view download instructions

First, make sure you have hugginface-cli installed:

pip install -U "huggingface_hub[cli]"

Then, you can target the specific file you want:

huggingface-cli download bartowski/deepseek-ai_DeepSeek-V3.1-GGUF --include "deepseek-ai_DeepSeek-V3.1-Q4_K_M.gguf" --local-dir ./

If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:

huggingface-cli download bartowski/deepseek-ai_DeepSeek-V3.1-GGUF --include "deepseek-ai_DeepSeek-V3.1-Q8_0/*" --local-dir ./

You can either specify a new local-dir (deepseek-ai_DeepSeek-V3.1-Q8_0) or download them all in place (./)

ARM/AVX information#

Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.

Now, however, there is something called "online repacking" for weights. details in this PR. If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.

As of llama.cpp build b4282 you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.

Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to this PR which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.

Click to view Q4_0_X_X information (deprecated

I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.

Click to view benchmarks on an AVX2 system (EPYC7702)

model	size	params	backend	threads	test	t/s	% (vs Q4_0)
qwen2 3B Q4_0	1.70 GiB	3.09 B	CPU	64	pp512	204.03 ± 1.03	100%
qwen2 3B Q4_0	1.70 GiB	3.09 B	CPU	64	pp1024	282.92 ± 0.19	100%
qwen2 3B Q4_0	1.70 GiB	3.09 B	CPU	64	pp2048	259.49 ± 0.44	100%
qwen2 3B Q4_0	1.70 GiB	3.09 B	CPU	64	tg128	39.12 ± 0.27	100%
qwen2 3B Q4_0	1.70 GiB	3.09 B	CPU	64	tg256	39.31 ± 0.69	100%
qwen2 3B Q4_0	1.70 GiB	3.09 B	CPU	64	tg512	40.52 ± 0.03	100%
qwen2 3B Q4_K_M	1.79 GiB	3.09 B	CPU	64	pp512	301.02 ± 1.74	147%
qwen2 3B Q4_K_M	1.79 GiB	3.09 B	CPU	64	pp1024	287.23 ± 0.20	101%
qwen2 3B Q4_K_M	1.79 GiB	3.09 B	CPU	64	pp2048	262.77 ± 1.81	101%
qwen2 3B Q4_K_M	1.79 GiB	3.09 B	CPU	64	tg128	18.80 ± 0.99	48%
qwen2 3B Q4_K_M	1.79 GiB	3.09 B	CPU	64	tg256	24.46 ± 3.04	83%
qwen2 3B Q4_K_M	1.79 GiB	3.09 B	CPU	64	tg512	36.32 ± 3.59	90%
qwen2 3B Q4_0_8_8	1.69 GiB	3.09 B	CPU	64	pp512	271.71 ± 3.53	133%
qwen2 3B Q4_0_8_8	1.69 GiB	3.09 B	CPU	64	pp1024	279.86 ± 45.63	100%
qwen2 3B Q4_0_8_8	1.69 GiB	3.09 B	CPU	64	pp2048	320.77 ± 5.00	124%
qwen2 3B Q4_0_8_8	1.69 GiB	3.09 B	CPU	64	tg128	43.51 ± 0.05	111%
qwen2 3B Q4_0_8_8	1.69 GiB	3.09 B	CPU	64	tg256	43.35 ± 0.09	110%
qwen2 3B Q4_0_8_8	1.69 GiB	3.09 B	CPU	64	tg512	42.60 ± 0.31	105%

Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation

Which file should I choose?#

Click here for details

A great write up with charts showing various performances is provided by Artefact2 here

The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.

If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.

If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.

Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.

If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.

If you want to get more into the weeds, you can check out this extremely useful feature chart:

llama.cpp feature matrix

But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.

These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.

Credits#

Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.

Thank you ZeroWw for the inspiration to experiment with embed/output.

Thank you to LM Studio for sponsoring my work.

Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

Files

210 files · 7.57 TBWeights 1.01 GB (smallest of 24 GGUF variants). Sizes and sha256 from the signed manifest.

Show all 210 files with their sha256

File	Size	sha256
.gitattributes	26.6 KB	bf0a599abc71e567850386ad9a30cd1a838300d20815a45cca7f2dd69fa39aeb
README.md	13.4 KB	c1b618da1891d34d0f25b97145301657e74c17950ae6a0ad1152532a4a7550b1
deepseek-ai_DeepSeek-V3.1-IQ1_M/deepseek-ai_DeepSeek-V3.1-IQ1_M-00001-of-00004.gguf	39.8 GB	8c4d16c6765bb9175cbc6017941dd46b23c1fb576ce1f46cee5b5fd541b4c54b
deepseek-ai_DeepSeek-V3.1-IQ1_M/deepseek-ai_DeepSeek-V3.1-IQ1_M-00002-of-00004.gguf	39.7 GB	55eb0d50eca99de2180e3e6279e7813695cb897785fcf00b01f8522db4ad1a3f
deepseek-ai_DeepSeek-V3.1-IQ1_M/deepseek-ai_DeepSeek-V3.1-IQ1_M-00003-of-00004.gguf	39.6 GB	83b4fa0408c4c2b14d8a0c0042c1dd025aa08120aaa23604ed489b6d8e9833ce
deepseek-ai_DeepSeek-V3.1-IQ1_M/deepseek-ai_DeepSeek-V3.1-IQ1_M-00004-of-00004.gguf	28.3 GB	7e45734f553b2e86abaeefcfab895aeabfe526abfbdbebf1df0ba2cf3ca8d770
deepseek-ai_DeepSeek-V3.1-IQ2_M/deepseek-ai_DeepSeek-V3.1-IQ2_M-00001-of-00006.gguf	39.3 GB	a2cd9375e5afaf9265329b99d82ea5f14bc6b35754d0ead146801eaa2f461752
deepseek-ai_DeepSeek-V3.1-IQ2_M/deepseek-ai_DeepSeek-V3.1-IQ2_M-00002-of-00006.gguf	39.8 GB	036571c943699a3461cba025945e8da52aa02eef4073d59e1be96f66df1ad664
deepseek-ai_DeepSeek-V3.1-IQ2_M/deepseek-ai_DeepSeek-V3.1-IQ2_M-00003-of-00006.gguf	39.8 GB	a1ec11062cbba2eb1205a9988ea4aa77250741256c69e66c0af5afdacb477e60
deepseek-ai_DeepSeek-V3.1-IQ2_M/deepseek-ai_DeepSeek-V3.1-IQ2_M-00004-of-00006.gguf	39.7 GB	a081b07b764e3d1e3205ba6292cb9576b2417359a2858de375a59cbda7dff9dc
deepseek-ai_DeepSeek-V3.1-IQ2_M/deepseek-ai_DeepSeek-V3.1-IQ2_M-00005-of-00006.gguf	40.0 GB	e2847c4983b71915a8b7e335c92ba46c923497f2f8dcde23041962d495a2381b
deepseek-ai_DeepSeek-V3.1-IQ2_M/deepseek-ai_DeepSeek-V3.1-IQ2_M-00006-of-00006.gguf	16.4 GB	7b543f0ef3045f20fbb0c69bcdb9e7ebdad5ece19f31c917e8d8a7609062c669
deepseek-ai_DeepSeek-V3.1-IQ2_S/deepseek-ai_DeepSeek-V3.1-IQ2_S-00001-of-00005.gguf	39.9 GB	e93ccc72d601883940aea7c4c29890185b3fc31ba2acd3a201d7b65013e8e7c7
deepseek-ai_DeepSeek-V3.1-IQ2_S/deepseek-ai_DeepSeek-V3.1-IQ2_S-00002-of-00005.gguf	39.7 GB	f1026623528770d75cc6a62653cd0c0dc423b1e109c66598a2f2e29568639af9
deepseek-ai_DeepSeek-V3.1-IQ2_S/deepseek-ai_DeepSeek-V3.1-IQ2_S-00003-of-00005.gguf	39.8 GB	68a0a169173ec92351268cbcf9eb8aa44907ac3d943c842af7794cf6ff04521a
deepseek-ai_DeepSeek-V3.1-IQ2_S/deepseek-ai_DeepSeek-V3.1-IQ2_S-00004-of-00005.gguf	39.8 GB	3c4e94ae67bda66dd587d047c99b979a7d7f388799a04f6e6850e6ac4c6826e7
deepseek-ai_DeepSeek-V3.1-IQ2_S/deepseek-ai_DeepSeek-V3.1-IQ2_S-00005-of-00005.gguf	30.5 GB	897690381492ffe1dda43f00d9ecf8ea86e6c92e8d291776944df244d14802b6
deepseek-ai_DeepSeek-V3.1-IQ2_XS/deepseek-ai_DeepSeek-V3.1-IQ2_XS-00001-of-00005.gguf	39.5 GB	55b00e7641153658cba70b42788a7447f6527d1ba18a8cbb9c2a5fc595e55e51
deepseek-ai_DeepSeek-V3.1-IQ2_XS/deepseek-ai_DeepSeek-V3.1-IQ2_XS-00002-of-00005.gguf	39.5 GB	03ffba2ca08a1ed5b7b95f21a2d71e05fed8504714a5cf6c227d87b6fdbd77c3
deepseek-ai_DeepSeek-V3.1-IQ2_XS/deepseek-ai_DeepSeek-V3.1-IQ2_XS-00003-of-00005.gguf	39.5 GB	dc4c84ff641d48f53a4bfdb1a58e8458fd6c2494f36804dae1078c109ca1f7ed
deepseek-ai_DeepSeek-V3.1-IQ2_XS/deepseek-ai_DeepSeek-V3.1-IQ2_XS-00004-of-00005.gguf	39.5 GB	57170f3def5f7e5407842c63ecad4fe25f935ec227b906fb98416368fedae426
deepseek-ai_DeepSeek-V3.1-IQ2_XS/deepseek-ai_DeepSeek-V3.1-IQ2_XS-00005-of-00005.gguf	30.3 GB	eae311945fe91f35c8bfd5e6f965803b1b518532b4993bf1ef3f345319f79f21
deepseek-ai_DeepSeek-V3.1-IQ2_XXS/deepseek-ai_DeepSeek-V3.1-IQ2_XXS-00001-of-00005.gguf	39.8 GB	41df91adf7c15a97396b38cf9d57595d420bd0e8cfb92c6c4404e9e1b89a80e2
deepseek-ai_DeepSeek-V3.1-IQ2_XXS/deepseek-ai_DeepSeek-V3.1-IQ2_XXS-00002-of-00005.gguf	39.8 GB	7a5f933162ec1494a95361b6f94881b01145d1c63f89ebfe0c71db7a80accabd
deepseek-ai_DeepSeek-V3.1-IQ2_XXS/deepseek-ai_DeepSeek-V3.1-IQ2_XXS-00003-of-00005.gguf	39.9 GB	6cd921d8039211ea73a6e37802a4b39df613d9815d7579c0cfa5546334093c42
deepseek-ai_DeepSeek-V3.1-IQ2_XXS/deepseek-ai_DeepSeek-V3.1-IQ2_XXS-00004-of-00005.gguf	38.9 GB	edf2834687f76d6acc7f1abf7763f98300120b4668372045adcfa2cfba46234b
deepseek-ai_DeepSeek-V3.1-IQ2_XXS/deepseek-ai_DeepSeek-V3.1-IQ2_XXS-00005-of-00005.gguf	5.61 GB	077ad7b0ed3d6e8321039356c2dc99f081e694eebe42be32b30f3c94a6fdc6a9
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00001-of-00008.gguf	39.2 GB	ee4dc05a626b3ea4fef4a674e3d614d0567367e503793399414b1ba56b5702a8
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00002-of-00008.gguf	39.5 GB	a45fe31cad382f8d174d55d516ef51541a3cbdddb0396e0d3cc94f0a4e37f67b
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00003-of-00008.gguf	40.0 GB	098f7682afaf57a728b23b3f8b49dbfdcf8fa61e9625b7fbc6d567e21c2cf403
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00004-of-00008.gguf	39.4 GB	ff07a85e5c9711e5344d2d1c857611e7814b6f2fee8688b779f4d7bf1155e480
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00005-of-00008.gguf	38.4 GB	7de96081467058cf5b19df0f3d9d87203425b762f8d4f5c4d870beaef31e2b74
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00006-of-00008.gguf	39.4 GB	4910c4b5df60da3187266c6ee737b38dc8101a9c1384a429ac4f1f8bc7a87ed0
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00007-of-00008.gguf	38.9 GB	5372666ad4072e6c98c77d12ad2a61c3d80880accdfea06f418f0b08f5a592a9
deepseek-ai_DeepSeek-V3.1-IQ3_M/deepseek-ai_DeepSeek-V3.1-IQ3_M-00008-of-00008.gguf	33.0 GB	1b9c81572af79d0cad154968096c2f77c570483890fe514617adeab702b5648a
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00001-of-00008.gguf	39.4 GB	1c769cb44ff7971cb930ba76bc89c873263a4542effb5fff0b6781de56e2a08c
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00002-of-00008.gguf	38.9 GB	73813e9aa6765bf588a43efe5859882bde186411809592fdc2a9f1ea4efea33d
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00003-of-00008.gguf	39.0 GB	509c3161c947ecf25fde85e3ff0b5e51dc15a14dbacc2bd9f7201fee99c818fc
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00004-of-00008.gguf	38.8 GB	fda75b4b4ca15055eeb1ce4cd6fdb0ae8989e49a2e92f20f73528c34bd8de4d6
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00005-of-00008.gguf	38.9 GB	a2850dd38c9567db5a0d33f2aedd4bbb05408a6a3d29355afdad6b376712bad2
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00006-of-00008.gguf	39.0 GB	f160c7dd2f347f01a4b84d5f6565c54085d21f8f97854be357317c17551cc396
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00007-of-00008.gguf	39.9 GB	4db5626ae42aa5157e0c8731067293ba4cf46431890bf2bbdc5152f6fa5f78f8
deepseek-ai_DeepSeek-V3.1-IQ3_XS/deepseek-ai_DeepSeek-V3.1-IQ3_XS-00008-of-00008.gguf	3.27 GB	4117939421770e929593c19c6bfd6889b8ecea55d280dbd8bc95496af13fbfc7
deepseek-ai_DeepSeek-V3.1-IQ3_XXS/deepseek-ai_DeepSeek-V3.1-IQ3_XXS-00001-of-00007.gguf	39.3 GB	4cf75afbf2033743a5ec59b43d8aba031ef5b0b4efacfdafa0e516483144a55a
deepseek-ai_DeepSeek-V3.1-IQ3_XXS/deepseek-ai_DeepSeek-V3.1-IQ3_XXS-00002-of-00007.gguf	39.4 GB	92089fb1fb911fce566cbfbbc267b77207500ba5523fa3d821b8ae9ef4b64bca
deepseek-ai_DeepSeek-V3.1-IQ3_XXS/deepseek-ai_DeepSeek-V3.1-IQ3_XXS-00003-of-00007.gguf	39.5 GB	d77faf752aac11d78ac24e11d5d4478ef813ed30604c5ac51b428797625fe32c
deepseek-ai_DeepSeek-V3.1-IQ3_XXS/deepseek-ai_DeepSeek-V3.1-IQ3_XXS-00004-of-00007.gguf	39.5 GB	e1ae262c74423c85aecfb1921657e94590eb16fdf2a8843a7f27b9f8e2aa3732
deepseek-ai_DeepSeek-V3.1-IQ3_XXS/deepseek-ai_DeepSeek-V3.1-IQ3_XXS-00005-of-00007.gguf	39.4 GB	ffabda15aa749ead5a2163606792b3bb6923ab3bb7c77f8c0245edcb0c241295
deepseek-ai_DeepSeek-V3.1-IQ3_XXS/deepseek-ai_DeepSeek-V3.1-IQ3_XXS-00006-of-00007.gguf	39.7 GB	2587c27cab10ac5a2df32f56adba17afa6e5af52b31391f27e9ff825384e32af
deepseek-ai_DeepSeek-V3.1-IQ3_XXS/deepseek-ai_DeepSeek-V3.1-IQ3_XXS-00007-of-00007.gguf	31.0 GB	b3d443af6e66614ce568eb4f1dc241e6fe7c40a2227e406e141d839a64d1b0c9
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00001-of-00010.gguf	39.4 GB	23c7fefd98f1162964446996cb33d3762b1fa63f6b93b9ae43277032b2b1ce42
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00002-of-00010.gguf	39.1 GB	d3710664a3f599d4deb5b897136655641d719caf1963a47ee5a4013407d69759
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00003-of-00010.gguf	39.1 GB	a029ae9566018c8b9980b96060acb62d45e7f23b239b36e8f5952adb0861faad
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00004-of-00010.gguf	39.1 GB	5f377b58e4004c9af288320f7cba16f02010a555f66fe6ba47e3ae3c62cb5df2
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00005-of-00010.gguf	39.1 GB	378a11becea2ef27131f99284470633d92343ff9b4432380fa6143e3c58a5827
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00006-of-00010.gguf	39.1 GB	d1240f7ff2a0a821f166075594188995198685d1b115f6f54ac006627d76b602
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00007-of-00010.gguf	39.1 GB	b1e243f859668a54f04ba26ef5242e329099c8c94a3ecae8132544c5883791fa
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00008-of-00010.gguf	39.1 GB	c1055cf7f78bd197a6c2324e81600eddd89d5f1234c7efd682b3644de0331040
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00009-of-00010.gguf	39.1 GB	2374e4526778b9c4fe0124e262f64d650444095f5f0341dd4fabece45f5bc1a4
deepseek-ai_DeepSeek-V3.1-IQ4_NL/deepseek-ai_DeepSeek-V3.1-IQ4_NL-00010-of-00010.gguf	28.2 GB	e955ecc14b7122f4c429f2c995948cb0b703fb640ae3283caf888c53375ca406
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00001-of-00010.gguf	39.5 GB	fa8ee251d17518de6640a41da0c32ac3ecebf4ca8f6206f71bd48fa83c8b8ea3
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00002-of-00010.gguf	39.0 GB	ce7a7dc02523d292d330fdf18b5b67f76f34817ff9caa3c08e699f629bcf800c
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00003-of-00010.gguf	39.0 GB	79920a3b8c6a9d4c9bc42069f8b056837674e8c309a506490d2104898c7cb771
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00004-of-00010.gguf	39.1 GB	2a24858d9f0038cc9ebaefdc408e0831b725807d779d1ae92363bb4d553cc694
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00005-of-00010.gguf	39.0 GB	803f98a890572797f372358c89876f34f7d77873ac037677bccb9c6ace6874e8
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00006-of-00010.gguf	39.0 GB	2cb19dbacbf4089cecd7fbe101dd816225162fdeb3f9efcb392e46ff1d2c2c93
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00007-of-00010.gguf	39.1 GB	89570202e968481a5c49e630b32bd7b1bf61a01ad7d70e69cb2111c861f60772
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00008-of-00010.gguf	39.0 GB	7f00c7d361145ea546d15a378a7866acc50a705c5c3db6d4f0ada7a825fd1de7
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00009-of-00010.gguf	39.1 GB	9ec941a0e6e3c0fc073084de431b7744a3a2482b762c6cd93a3b5164b2199176
deepseek-ai_DeepSeek-V3.1-IQ4_XS/deepseek-ai_DeepSeek-V3.1-IQ4_XS-00010-of-00010.gguf	8.19 GB	295a17331bd6f6dcaa80a8f4c8f0d2a4d10103ee97a1682a2c258bbe3cad49eb
deepseek-ai_DeepSeek-V3.1-Q2_K/deepseek-ai_DeepSeek-V3.1-Q2_K-00001-of-00007.gguf	39.6 GB	6be161607ada56c5f049a4bf25173cc6a59c8e6a24eb25b97b497b1c72c19a1c
deepseek-ai_DeepSeek-V3.1-Q2_K/deepseek-ai_DeepSeek-V3.1-Q2_K-00002-of-00007.gguf	38.9 GB	7bbbc521eba0e1c12318e1c64cf5f0bd605a5607892dd316d3f42e49c896f08b
deepseek-ai_DeepSeek-V3.1-Q2_K/deepseek-ai_DeepSeek-V3.1-Q2_K-00003-of-00007.gguf	39.9 GB	18c39f00bd9c04f283ba406a431aec2df2fb9649bb3d4b2fdc503fe48fa09668
deepseek-ai_DeepSeek-V3.1-Q2_K/deepseek-ai_DeepSeek-V3.1-Q2_K-00004-of-00007.gguf	39.9 GB	58a5cfe5db0bfb2e55cc566635946ef643158e843b0c8c22823b698c794ffeb1
deepseek-ai_DeepSeek-V3.1-Q2_K/deepseek-ai_DeepSeek-V3.1-Q2_K-00005-of-00007.gguf	39.0 GB	116479029a465aa5dd8503866cd311514e104a2e523070845ac622acb7fd2930
deepseek-ai_DeepSeek-V3.1-Q2_K/deepseek-ai_DeepSeek-V3.1-Q2_K-00006-of-00007.gguf	39.3 GB	82f294093b93affc97409973194b4f3fa42bc3ac5628843aa3fd8ecd83b6b54e
deepseek-ai_DeepSeek-V3.1-Q2_K/deepseek-ai_DeepSeek-V3.1-Q2_K-00007-of-00007.gguf	1.25 GB	d625c55adf4e52a039385303ce82747461e3f587e63435c28478846596a1fae0
deepseek-ai_DeepSeek-V3.1-Q2_K_L/deepseek-ai_DeepSeek-V3.1-Q2_K_L-00001-of-00007.gguf	39.2 GB	241f307bd291dab99820d0aad4578dc517bc0e40dba2cf54eb5af8bb0138d117
deepseek-ai_DeepSeek-V3.1-Q2_K_L/deepseek-ai_DeepSeek-V3.1-Q2_K_L-00002-of-00007.gguf	39.0 GB	f195d1a1fc2d9e7ed2f00cb42974535fee1ec823df9c4c4eafb2393ae8f6b9ad
deepseek-ai_DeepSeek-V3.1-Q2_K_L/deepseek-ai_DeepSeek-V3.1-Q2_K_L-00003-of-00007.gguf	39.9 GB	0d9178751da8841dc5f7cfe3cac0254dce272057443e103038826ec45b0510fe
deepseek-ai_DeepSeek-V3.1-Q2_K_L/deepseek-ai_DeepSeek-V3.1-Q2_K_L-00004-of-00007.gguf	39.9 GB	91dee35841c4c9e511fa979410f1178bf59705e92a8bf541eb08111e660ec938
deepseek-ai_DeepSeek-V3.1-Q2_K_L/deepseek-ai_DeepSeek-V3.1-Q2_K_L-00005-of-00007.gguf	38.6 GB	498708a715ad403f84c7b6c0f58dc2e8a57f0c90eaf58597eaabcd26d344885e
deepseek-ai_DeepSeek-V3.1-Q2_K_L/deepseek-ai_DeepSeek-V3.1-Q2_K_L-00006-of-00007.gguf	39.6 GB	d2bcd067b9a94bc354e4c7a008863130b311415b734bdc55c7b3a59a79a5596c
deepseek-ai_DeepSeek-V3.1-Q2_K_L/deepseek-ai_DeepSeek-V3.1-Q2_K_L-00007-of-00007.gguf	2.50 GB	2c0a24add4f6f336f056225c7a16fdd4dc6da6b2ddfe850c92033a267b0867a4
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00001-of-00009.gguf	38.0 GB	446f74f2b880b114c0e475cffbd94b8c41333689035abe24b539593aac22d07c
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00002-of-00009.gguf	39.5 GB	c11a5cdeb703b860cf57169a57ae314f247a1b2112d96f39e0f0d4a78c201bed
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00003-of-00009.gguf	38.5 GB	71332a40fdefcf72694b5e63b91f7fb2232d49c74db13cc269a6dd66e155f9df
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00004-of-00009.gguf	39.6 GB	aefe696cb6e23b2650bfeef0f12146db263cdceb76c508d3940bd27bd601e3ae
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00005-of-00009.gguf	38.5 GB	bee1ce1390032391578353d8f18a95e4ec70a226ce33370ed7c9f8a0dd2f1b19
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00006-of-00009.gguf	39.5 GB	e067d715d44a12e2352836fa21b8a0ca69fcf9b3f04200da6e0b7a21b6cf6f0b
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00007-of-00009.gguf	38.6 GB	31367545e7716b51bac718d382f1a099a2dc95a58daee168e74c2e3553461551
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00008-of-00009.gguf	38.4 GB	016dbd1f2d5ca5cce8f3ccc7b19f8a8e405a50a8b041b477ce1403d63bafd512
deepseek-ai_DeepSeek-V3.1-Q3_K_L/deepseek-ai_DeepSeek-V3.1-Q3_K_L-00009-of-00009.gguf	9.24 GB	88f4c40e306d19cdb6c7a7c3cc8356e7f5fb10412c900a7d5c49b69a35b38757
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00001-of-00008.gguf	39.2 GB	4f1142971c83f1b2bf48839e443d105712029b258d3ed4a0b89dc27970356e41
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00002-of-00008.gguf	39.5 GB	c1f095f2300ef32afef44c0534933197cb07006a5086116d35509a923b49d498
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00003-of-00008.gguf	40.0 GB	06fdfb591775469c7f3295235247dc3490ce072f8b0d9cac753dfec9e2e50035
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00004-of-00008.gguf	39.4 GB	0fcc40ed15f811dfab39746d2744f0533879036da004f8eb27d15c4600b51092
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00005-of-00008.gguf	38.4 GB	1bc00e9ee4d87eb0a67637c5d84b1fcd7f4ce6898e33b39506fa9b3ceb852c57
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00006-of-00008.gguf	39.4 GB	d3598632b3ee3f5fb6f7a66b7e3ab7fcdd2d6b13270a36db75fa60265e9cc5a0
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00007-of-00008.gguf	38.9 GB	250bdaaba118a985601869e78bc409873b204c596af635d0cb401c8a7882df42
deepseek-ai_DeepSeek-V3.1-Q3_K_M/deepseek-ai_DeepSeek-V3.1-Q3_K_M-00008-of-00008.gguf	33.0 GB	1eab0c335936c4e2de04f6c333a89a6ab9d7c6a8316b45d602339941362c96f3
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00001-of-00008.gguf	39.0 GB	7ecd14b1dbba2beeda06e546153b6ac0346e8e7be41d74d7c34c64ee125bfa25
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00002-of-00008.gguf	38.5 GB	12a3d7a8feee0d31d89349180c7d9779f3d96dd20242897a8f003daf77bffc80
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00003-of-00008.gguf	38.4 GB	349150f9d2e272737f4dd3198ebf636ae686e8430504aa2de7a81a221c2b684b
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00004-of-00008.gguf	38.5 GB	184f8291244a31f637ac31c88e6a379d8f63f5a37d3e36b3bc9022b2c3e82a60
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00005-of-00008.gguf	38.5 GB	9e76b38e092c1ea103f2819cbad0386c27b338d158f17cbb7871adbfd5a38e5f
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00006-of-00008.gguf	38.4 GB	9ea359fba0ff55ceacbd08bcbffc807d36db844ce36fc8e803de161dba825ab7
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00007-of-00008.gguf	38.6 GB	d23179484d28bbcd15415ca7c054fd8e22b353ed7e783410f48a44584f0ab863
deepseek-ai_DeepSeek-V3.1-Q3_K_S/deepseek-ai_DeepSeek-V3.1-Q3_K_S-00008-of-00008.gguf	23.4 GB	854b43fe66385ef7399a73ff1cc0668fa491cb06c6965d6140307095a4249ed2
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00001-of-00009.gguf	38.8 GB	8fe98886dd829ae55f9434baeadcc4ee0c4364df0790cc2777adb34afdb0c906
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00002-of-00009.gguf	39.5 GB	c11a5cdeb703b860cf57169a57ae314f247a1b2112d96f39e0f0d4a78c201bed
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00003-of-00009.gguf	38.5 GB	71332a40fdefcf72694b5e63b91f7fb2232d49c74db13cc269a6dd66e155f9df
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00004-of-00009.gguf	39.6 GB	aefe696cb6e23b2650bfeef0f12146db263cdceb76c508d3940bd27bd601e3ae
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00005-of-00009.gguf	38.5 GB	bee1ce1390032391578353d8f18a95e4ec70a226ce33370ed7c9f8a0dd2f1b19
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00006-of-00009.gguf	39.5 GB	e067d715d44a12e2352836fa21b8a0ca69fcf9b3f04200da6e0b7a21b6cf6f0b
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00007-of-00009.gguf	38.6 GB	31367545e7716b51bac718d382f1a099a2dc95a58daee168e74c2e3553461551
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00008-of-00009.gguf	38.4 GB	016dbd1f2d5ca5cce8f3ccc7b19f8a8e405a50a8b041b477ce1403d63bafd512
deepseek-ai_DeepSeek-V3.1-Q3_K_XL/deepseek-ai_DeepSeek-V3.1-Q3_K_XL-00009-of-00009.gguf	9.24 GB	88f4c40e306d19cdb6c7a7c3cc8356e7f5fb10412c900a7d5c49b69a35b38757
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00001-of-00010.gguf	38.6 GB	6afcf7a7130198fa80b3af40babc7e89259c2ebfcf362b5b7288f5949dbb337e
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00002-of-00010.gguf	39.5 GB	39745fd4690f03010b05bd5bcd74d72018ba8b736f89a39c37b2ba7a404b2fa2
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00003-of-00010.gguf	39.5 GB	2e4ba58d9faab603a091b3edf9b64594db798696afa691f74d2932b568053ebb
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00004-of-00010.gguf	39.5 GB	ed0005acd5dec8d0ca3b14a710a108d8f52659c6a1d191c01d6b6eaf6db77442
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00005-of-00010.gguf	39.5 GB	d4d0bdd7f29e5296bec9835b624a2f6db9b167260eed6f5bd6bef192b99dae4d
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00006-of-00010.gguf	39.5 GB	866dd18aab4152283c6233304fd2e0d509b8824ec4c702656ef20a83b6bee6bc
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00007-of-00010.gguf	39.5 GB	ba54b75793eceac088ebeb97e77c0ed5ee86523617da892903c80fbf93c48e1e
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00008-of-00010.gguf	39.5 GB	f2328fb35d96775ab1a6447bce8cfef94d7d08871b0b9fa8d0109c101abcb4f5
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00009-of-00010.gguf	37.9 GB	c35071dfb57e9dbf50b8e043899ddba9680a3894056ce1178c1c3c88c026543e
deepseek-ai_DeepSeek-V3.1-Q4_0/deepseek-ai_DeepSeek-V3.1-Q4_0-00010-of-00010.gguf	33.6 GB	4180efabe05129ba1b31309552115911a2209ca42242a0719eb3dc4c4e4e48b7
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00001-of-00011.gguf	38.7 GB	f27c4f0194db87f0c9089764df8ca4c77f02e33be50cef516ae307e13b6ebd4b
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00002-of-00011.gguf	38.5 GB	21978ace5fac7fb9675c69d59ed52b09820d03d586155f737272665902cbc548
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00003-of-00011.gguf	38.4 GB	3fc812553695b86c5aff18ec08599f9ae0ae61c7e0956fb6378fede157a2eda0
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00004-of-00011.gguf	38.5 GB	066533bd0a8d99c47d6970d0b09f3b751114a4c7c41afe189698aea36b2d0699
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00005-of-00011.gguf	38.4 GB	9a037c3019540d18e25a2f54b16f6dd50ff1aa5670d284ba0f0fdbbdb57bc7c1
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00006-of-00011.gguf	38.4 GB	8f9b941a37593ecd5c793541ee4fdacb4cafd3de3d5afe5b517e92f0aea3eac4
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00007-of-00011.gguf	38.6 GB	3e157873fa53e95b93560f20e96d9359fcdf0347d0a56f298363834bced51aa7
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00008-of-00011.gguf	38.4 GB	e0182949ac16423099f064e3382ebe67f4302c9fc89a7fa544c5e0881df6f4bc
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00009-of-00011.gguf	38.4 GB	45b95e9e4ab9ba3ef04da48e7ecc6e547452ca5958abfa84bc9bfbd5e4573167
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00010-of-00011.gguf	38.6 GB	b5cc2630b6e828a0fc924a517fb56c7908bd8b2784c4df596749ba7257ba95fc
deepseek-ai_DeepSeek-V3.1-Q4_1/deepseek-ai_DeepSeek-V3.1-Q4_1-00011-of-00011.gguf	36.0 GB	5b0bcecd8a879918e5f4d9498eb8184643151de35e29044a13fb2f4a6ee41abe
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00001-of-00011.gguf	40.0 GB	f77f31853cfa520664f8ae1a9ddbe9d19cedfac7116fef2853aa348e2cc6874a
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00002-of-00011.gguf	39.9 GB	f168be50a9082828bbb96b01d9f98dd12213b930265ca10258dc8f06c65435fe
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00003-of-00011.gguf	39.0 GB	3ae48b147edb702b9eb2db1c55977b254631ebbaed2adcee9d2a530a29e0f9aa
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00004-of-00011.gguf	39.0 GB	f6def327ca90cbf23b6da868624285ffbc9d5bf85fd3f5d85bbe1a8a9c42c419
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00005-of-00011.gguf	38.8 GB	024c6cca6929a8d4ceb21b1404c31d41c86cd4c842220541091272fee7dbf57d
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00006-of-00011.gguf	39.0 GB	a93d2decc0141b9dae82847bffc8be17aedf9e06148997abc4a42e534f24ea8a
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00007-of-00011.gguf	38.0 GB	036554a1dcfb655f8dac50c8d0d7824d4000ed4e1281d4f4bb9d4e31eb7b4e88
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00008-of-00011.gguf	38.8 GB	dcf6c1d448bf2790b3721683cd4820b6922ce7d86d684a58d98680e9ada8246c
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00009-of-00011.gguf	39.9 GB	151629325f28b65cd00f7a31ef52412241623bafeee8a6ba4a71ba2d93c6d634
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00010-of-00011.gguf	39.7 GB	2c30e399a28df657854ac98acd565dcb61cbf88c653075b10ec67cacd808a630
deepseek-ai_DeepSeek-V3.1-Q4_K_M/deepseek-ai_DeepSeek-V3.1-Q4_K_M-00011-of-00011.gguf	17.1 GB	f4ef6fcd0c319ce2e61db587e1fc21f342ba4a6224832062a63cc089418275ed
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00001-of-00011.gguf	37.5 GB	698d4b6b6a3995497b2798e3865568549c7436f32a0803dfa10cee11a3ce7988
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00002-of-00011.gguf	38.3 GB	9b58b469bf093b2d33c9eba6eab745e428bc5bfad570bdb1c88d8889af10cef0
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00003-of-00011.gguf	37.9 GB	0767ef4fb967891fbd93908cc7124431b1105f1a7b9d8ac87baa2a7674db5af2
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00004-of-00011.gguf	37.9 GB	fc3a369cafcbeee100a2281e9f8ac0ceae09ba8f929595e740135def6100b595
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00005-of-00011.gguf	39.9 GB	711eb2bb8e539e233f027dd2bb20f0a5eb793d7c83e910101fd2460599d27e32
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00006-of-00011.gguf	37.9 GB	bcef00b817461149e0dfd24672f64523fcb33696cf952b1c5dfd478cf7c3bac8
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00007-of-00011.gguf	37.9 GB	3ea517214a9c8e5baad704b2b1180c5cbec05ea2983e498f05e28036bed63e4c
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00008-of-00011.gguf	37.4 GB	c530dbb75e512967da7edaa239ad69120bb0aa9d6ad62dc65cd715ef01a80bf0
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00009-of-00011.gguf	38.3 GB	a307681351dc25eaa80f8cb0ea8d6860aab1da573e8e758b334d49b844bf7522
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00010-of-00011.gguf	39.8 GB	3b61d79bbcdbf88cbd46bf43cf6f707dfe0db79708076fc149a7e4bf0dd4eb81
deepseek-ai_DeepSeek-V3.1-Q4_K_S/deepseek-ai_DeepSeek-V3.1-Q4_K_S-00011-of-00011.gguf	11.3 GB	94df24298aa39743f0e8ef935a6be4f53b22a7df074a48a8b5b145e60de415e6
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00001-of-00013.gguf	39.8 GB	469de86fb8c37f4754d852db3b274692cc080b8a04a24130c678ef00aa5bcbfc
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00002-of-00013.gguf	38.2 GB	0142471dd6a765171d2967d374e3ce613f47487ad58e5d4f651462ee68251d28
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00003-of-00013.gguf	38.0 GB	1b49443c4409b1408e21d44a1cb684c90eb4866787cd402deb9fcf01015fda8a
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00004-of-00013.gguf	38.1 GB	352a486660bd1236edf00395155098ec3fe709df979f7f58a5d589c8a90e80cd
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00005-of-00013.gguf	37.7 GB	0b589d84bf031358c99d1fc3dac4c00b2834c3a96801df3aee68d44caefd4c0f
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00006-of-00013.gguf	38.0 GB	3c613431819b2c3bfe6fa717c97ffa52d805a52a493a1ad4e0e54e95ca5602ef
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00007-of-00013.gguf	37.6 GB	c5771b4fd7912aa79e4903525313ef59dd3da9023567c2d19745a4feaa41df09
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00008-of-00013.gguf	38.2 GB	46cc06528aa54b9bfa7ba5582661c03f4170f190d2beff2064dc09669eb582bf
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00009-of-00013.gguf	37.5 GB	005823bb77de01e63363334cab4795e4f785d44aa625f2badab480afe2065539
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00010-of-00013.gguf	38.1 GB	4390eee9b319483f636381713e5e9a91a73c5b93f179e160b52471d02d371d88
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00011-of-00013.gguf	38.2 GB	8eda3f16d063fda449854ab77157bcca11aa31f44351d5d256d1918bd1148091
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00012-of-00013.gguf	39.5 GB	d698c809a4cabae9bb660dfdeaba1a19c561eca6f862e565d0e67a0050d78670
deepseek-ai_DeepSeek-V3.1-Q5_K_M/deepseek-ai_DeepSeek-V3.1-Q5_K_M-00013-of-00013.gguf	19.5 GB	08052064b0fc1e84bda5da672a8e7b191a25129b40aafee2648937386379fa99
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00001-of-00015.gguf	37.8 GB	7d8196de1372816b613a6171036ee56e7f2d5c9dd156de855ccd554fbc2ca058
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00002-of-00015.gguf	37.9 GB	e6c0e29322e47b84a2e975b011b5d33c734192956ab44107cbd51bdb0dde2a64
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00003-of-00015.gguf	37.9 GB	c9c3a681dc4ec0169c19bce5ea0dd52e1cc6e85bdc9fe5ca2f918707dc386463
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00004-of-00015.gguf	37.9 GB	168a438fa146838c4faed01d57d5043fb61777ac664f0286210ed8278dbcd3c8
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00005-of-00015.gguf	37.9 GB	a0b6e0ad73a96c355df7d1537a7015f439ea9800044954edb1413844a4989158
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00006-of-00015.gguf	37.9 GB	0becbc95eea1ab56a3b026d3566724d91477cb7d9b6ec75a44fd27b7b5a8678b
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00007-of-00015.gguf	37.9 GB	433d145b7cfbc1d564975652e4339be2facd11f76179e0685f25d1f67f47f9a6
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00008-of-00015.gguf	37.9 GB	68c57a0eb48a9bda2fc4a3c05177c569b71940f22893b5f6dac440333feea68f
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00009-of-00015.gguf	37.9 GB	5c70400d31062de425453aede52bf9f61fb51779b8b91071067a782ccd60e272
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00010-of-00015.gguf	37.9 GB	8954718b0a558923770d41131301e4294aa609c89286dc568306ae3a6e104642
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00011-of-00015.gguf	37.9 GB	7cf5a381629431c0d4ff6ccc98cc3baa0c66ed96439676df6b7e431a8ee700e6
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00012-of-00015.gguf	37.9 GB	fb191f13d88aa0ee4bb65fcb0f8805fe73551ade2350f64d0a6bb48ca01a93f4
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00013-of-00015.gguf	37.9 GB	57f5947b8291fed16a378a81d414dfdae1f7af63889313344422a5fdd90a2ae4
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00014-of-00015.gguf	37.9 GB	bc300b86fe544a92ae94883537d8a9696785a7375d736ecace16ff0557c0c174
deepseek-ai_DeepSeek-V3.1-Q6_K/deepseek-ai_DeepSeek-V3.1-Q6_K-00015-of-00015.gguf	22.0 GB	0b204606e25d60d56ba3d29b54b925db041455fa8b51819014df10e0debb146a
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00001-of-00020.gguf	36.5 GB	0c3797a5be58bb3a7cbdd1f6bf698f01e9c3ec60d0ddbef64bfa9a8001d542a5
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00002-of-00020.gguf	36.7 GB	bfd6e0c82a8f63e25480edf839e0d0ddde9cec5f6b0b566cc8bce609a0756810
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00003-of-00020.gguf	36.7 GB	c6ee55a7f1f5902c19b2ab6297be906a475ad40a4e323ccab43a40beea4900c4
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00004-of-00020.gguf	36.7 GB	6b00ecd324a48b3e6f911c0f18edad6bcf6b738e02a3369d7f78023b3e7631b9
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00005-of-00020.gguf	36.7 GB	bec526b66fb1e9f04116f8370e0b5ec22f139d72579b5de3c91d5531b5c30caa
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00006-of-00020.gguf	36.7 GB	905e97e584240a47aeb800ba580fb00098f7b065f7aca91b21ecbe3ec2f6d065
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00007-of-00020.gguf	36.7 GB	129658ce684e1958c86ba0c2ff4f6756c6c6518babaf4ee07485276252fd0293
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00008-of-00020.gguf	36.7 GB	fef6f79a8dab7964898590ee1a4bd99b58d693cd2ac0334034e35a566bda7607
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00009-of-00020.gguf	36.7 GB	9c0136fb6c26e2518d5b6b849f2fd28bb19ef2a078f7d06ac3edf107dced1c1a
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00010-of-00020.gguf	36.7 GB	195ce955d0cc3eff8049ff51ea1973acd561ef6eafd9f4ebdea9426fab1987f4
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00011-of-00020.gguf	36.7 GB	948f1ddfde9f0c2d8ac5a31c4feaecf5e77ae9ac5b83a9ae231cd7003fb738b8
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00012-of-00020.gguf	36.7 GB	e7fbcb13d3ff02f940d137a23f91e92c5a7f088bf0afd3b64ffa514c6d2699e6
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00013-of-00020.gguf	36.7 GB	2c0748df6bbce0934e0914f9f8d6c61c465d5be87c7086356586d8da122f9b90
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00014-of-00020.gguf	36.7 GB	605ee01d9bd39f5910dda2ca485e9a4c976150a09312f9fd5752fef1c4c2d960
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00015-of-00020.gguf	36.7 GB	3122350487854b6ce02f88689f72a69074be0e68e61a9cc36f4d76bd118b3c0e
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00016-of-00020.gguf	36.7 GB	f7125ae1b8e0b4c1fb5189ab6845f7b0e0c94a7e9c780c8148abb4d8525ee0b7
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00017-of-00020.gguf	36.7 GB	41c12f24b17b690d5b967f6f58c48546e02332f134361a6d53238761be224997
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00018-of-00020.gguf	36.7 GB	e6d9fe69b35fda4a2b54a0da56befcd938226831190e6a8ed390dc5fd3af73ab
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00019-of-00020.gguf	36.7 GB	7cc3fe0b6e55efe192fbe9495c46001538e8647a571eaa733a47a9c9fa34428c
deepseek-ai_DeepSeek-V3.1-Q8_0/deepseek-ai_DeepSeek-V3.1-Q8_0-00020-of-00020.gguf	16.2 GB	3515b75cb3e92f1e2d76771e084b976a2747e36e0aeda942e1323bbcdbf26925
deepseek-ai_DeepSeek-V3.1-imatrix.gguf	1.01 GB	9e8823d14da19e29fb44eb5bd5cfb4cea5850b72aef39968efd3c92ab8cd3247

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
a7ccff7723 pinned now	2026-11-15 04:43 UTC	210 files · 7.57 TB

Use it

$ fw get bartowski/deepseek-ai_DeepSeek-V3.1-GGUF
# manifest sha256 76e417740cc4… · 7.57 TB · 210 files
$ fw verify ./deepseek-ai_DeepSeek-V3.1-GGUF bartowski/deepseek-ai_DeepSeek-V3.1-GGUF

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/bartowski/deepseek-ai_DeepSeek-V3.1-GGUF.json --dir ./deepseek-ai_DeepSeek-V3.1-GGUF
$ python3 fw.py verify ./deepseek-ai_DeepSeek-V3.1-GGUF ./bartowski__deepseek-ai_DeepSeek-V3.1-GGUF.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/deepseek-ai_DeepSeek-V3.1-GGUF --revision a7ccff7723b7145b1e64c005100e91210eeb1ff9 --local-dir ./deepseek-ai_DeepSeek-V3.1-GGUF

llama.cppDownload one GGUF variant (deepseek-ai_DeepSeek-V3.1-imatrix, 1.01 GB), then serve it.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/deepseek-ai_DeepSeek-V3.1-GGUF --include "deepseek-ai_DeepSeek-V3.1-imatrix*" --local-dir ./deepseek-ai_DeepSeek-V3.1-GGUF
$ llama-server -m ./deepseek-ai_DeepSeek-V3.1-GGUF/deepseek-ai_DeepSeek-V3.1-imatrix.gguf

OllamaMake an Ollama model from the downloaded file.

$ printf 'FROM ./deepseek-ai_DeepSeek-V3.1-GGUF/deepseek-ai_DeepSeek-V3.1-imatrix.gguf\n' > Modelfile
$ ollama create deepseek-ai-deepseek-v3.1-gguf -f Modelfile

License

Name: MIT License
Id: MIT
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: Inherited from the base model deepseek-ai/DeepSeek-V3.1: the strictest license along the lineage applies. 2026-11-15
Text in: README.md
Text sha256: c1b618da1891d34d0f25b97145301657e74c17950ae6a0ad1152532a4a7550b1
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.deepseekSubject: deepseek-ai_DeepSeek-V3.1-GGUFDate: 2026-11-15Commit: a7ccff7Signed: 2DC28CC7B26A283B ✓

Upstream: bartowski/deepseek-ai_DeepSeek-V3.1-GGUF
Pinned commit: a7ccff7723b7145b1e64c005100e91210eeb1ff9
Manifest: deepseek-ai_DeepSeek-V3.1-GGUF.json · .minisig
Manifest sha256: 76e417740cc43006ba946a404ed3a66d35e982b462a7ff40776c6db5753ffa99
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 04:43 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/bartowski/deepseek-ai_DeepSeek-V3.1-GGUF.json
$ curl -O https://freeweights.allternit.com/manifests/bartowski/deepseek-ai_DeepSeek-V3.1-GGUF.json.minisig
$ minisign -Vm deepseek-ai_DeepSeek-V3.1-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

deepseek-ai/DeepSeek-V3.1 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/deepseek-ai_DeepSeek-V3.1-GGUF

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. deepseek-ai_DeepSeek-V3.1-GGUF.json. Provenance. Takedown history: none.

Source

huggingface.co/bartowski/deepseek-ai_DeepSeek-V3.1-GGUF

Related models

All of alt.freeweights.deepseek →

From: timm <huggingface.co/timm>Subject: deepseek_vit_412m.deepseek_v4_1_flash

From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-GGUF

From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-GGUF

From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-V3-0324-GGUF

From:

mlx-community <huggingface.co/mlx-community>Subject: deepseek-ai-DeepSeek-V4-Flash-8bit

From:

mlx-community <huggingface.co/mlx-community>Subject: DeepSeek-OCR-8bit