alt.freeweights.deepseek / DeepSeek-R1-GGUF
From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.deepseekSubject:

DeepSeek-R1-GGUF

Date: 2026-11-15Commit: aa476baSigned: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 7.93 TB in all. Published by bartowski under MIT.

deepseek7.93TBDeepSeek-R1-GGUFggufpermissive
FactsParamsnot statedSize7.93 TBFormatsggufTasktext generationLicenseMITFrom sourcepermissive
$ fw get bartowski/DeepSeek-R1-GGUF
# manifest sha256 60aab86b6e01… · 7.93 TB · 219 files
$ fw verify ./DeepSeek-R1-GGUF bartowski/DeepSeek-R1-GGUF
From sourceHosted (signed)bartowski/DeepSeek-R1-GGUFLast check: 2026-11-15 05:04 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of DeepSeek-R1.

Works with

Convert with

Overview

Size
7.93 TB
Weights
134 GB (smallest of 24 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
MIT (permissive)
Files
219, each with a sha256
Publisher
bartowski
Added
2026-11-15
Section
alt.freeweights.deepseek
Lineage

Original release from the publisher.

Base model: deepseek-ai/DeepSeek-R1

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:04 UTCpassed

Model card

From the publisher at commit aa476ba. Shown as plain text with links; images open at the publisher.

Llamacpp imatrix Quantizations of DeepSeek-R1#

Using llama.cpp release b4514 for quantization.

Original model: https://huggingface.co/deepseek-ai/DeepSeek-R1

Shout out to Arcee-AI for providing the compute to convert to BF16, which can be found here: https://huggingface.co/arcee-ai/DeepSeek-R1-bf16

All quants made using imatrix option with dataset from here

Run them in LM Studio

Prompt format#

<|begin▁of▁sentence|>{system_prompt}<|User|>{prompt}<|Assistant|>

Download a file (not the whole branch) from below:#

FilenameQuant typeFile SizeSplitDescription
DeepSeek-R1-Q8_0.ggufQ8_0713.29GBtrueExtremely high quality, generally unneeded but max available quant.
DeepSeek-R1-Q6_K.ggufQ6_K550.80GBtrueVery high quality, near perfect, recommended.
DeepSeek-R1-Q5_K_M.ggufQ5_K_M475.40GBtrueHigh quality, recommended.
DeepSeek-R1-Q5_K_S.ggufQ5_K_S461.81GBtrueHigh quality, recommended.
DeepSeek-R1-Q4_1.ggufQ4_1419.94GBtrueLegacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon.
DeepSeek-R1-Q4_K_M.ggufQ4_K_M404.43GBtrueGood quality, default size for most use cases, recommended.
DeepSeek-R1-Q4_K_S.ggufQ4_K_S380.00GBtrueSlightly lower quality with more space savings, recommended.
DeepSeek-R1-Q4_0.ggufQ4_0379.03GBtrueLegacy format, offers online repacking for ARM and AVX CPU inference.
DeepSeek-R1-IQ4_NL.ggufIQ4_NL378.07GBtrueSimilar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference.
DeepSeek-R1-IQ4_XS.ggufIQ4_XS357.13GBtrueDecent quality, smaller than Q4_K_S with similar performance, recommended.
DeepSeek-R1-Q3_K_XL.ggufQ3_K_XL348.26GBtrueUses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability.
DeepSeek-R1-Q3_K_L.ggufQ3_K_L347.45GBtrueLower quality but usable, good for low RAM availability.
DeepSeek-R1-Q3_K_M.ggufQ3_K_M319.20GBtrueLow quality.
DeepSeek-R1-IQ3_M.ggufIQ3_M292.09GBtrueMedium-low quality, new method with decent performance comparable to Q3_K_M.
DeepSeek-R1-Q3_K_S.ggufQ3_K_S289.08GBtrueLow quality, not recommended.
DeepSeek-R1-IQ3_XXS.ggufIQ3_XXS257.93GBtrueLower quality, new method with decent performance, comparable to Q3 quants.
DeepSeek-R1-Q2_K_L.ggufQ2_K_L244.93GBtrueUses Q8_0 for embed and output weights. Very low quality but surprisingly usable.
DeepSeek-R1-Q2_K.ggufQ2_K244.03GBtrueVery low quality but surprisingly usable.
DeepSeek-R1-IQ2_M.ggufIQ2_M217.43GBtrueRelatively low quality, uses SOTA techniques to be surprisingly usable.
DeepSeek-R1-IQ2_S.ggufIQ2_S197.00GBtrueLow quality, uses SOTA techniques to be usable.
DeepSeek-R1-IQ2_XS.ggufIQ2_XS195.09GBtrueLow quality, uses SOTA techniques to be usable.
DeepSeek-R1-IQ2_XXS.ggufIQ2_XXS174.43GBtrueVery low quality, uses SOTA techniques to be usable.
DeepSeek-R1-IQ1_M.ggufIQ1_M148.88GBtrueExtremely low quality, not recommended.
DeepSeek-R1-IQ1_S.ggufIQ1_S133.56GBtrueExtremely low quality, not recommended.

Embed/output weights#

Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.

Downloading using huggingface-cli#

Click to view download instructions

First, make sure you have hugginface-cli installed:

pip install -U "huggingface_hub[cli]"

Then, you can target the specific file you want:

huggingface-cli download bartowski/DeepSeek-R1-GGUF --include "DeepSeek-R1-Q4_K_M.gguf" --local-dir ./

If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:

huggingface-cli download bartowski/DeepSeek-R1-GGUF --include "DeepSeek-R1-Q8_0/*" --local-dir ./

You can either specify a new local-dir (DeepSeek-R1-Q8_0) or download them all in place (./)

ARM/AVX information#

Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.

Now, however, there is something called "online repacking" for weights. details in this PR. If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.

As of llama.cpp build b4282 you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.

Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to this PR which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.

Click to view Q4_0_X_X information (deprecated

I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.

Click to view benchmarks on an AVX2 system (EPYC7702)

modelsizeparamsbackendthreadstestt/s% (vs Q4_0)
qwen2 3B Q4_01.70 GiB3.09 BCPU64pp512204.03 ± 1.03100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64pp1024282.92 ± 0.19100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64pp2048259.49 ± 0.44100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64tg12839.12 ± 0.27100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64tg25639.31 ± 0.69100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64tg51240.52 ± 0.03100%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64pp512301.02 ± 1.74147%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64pp1024287.23 ± 0.20101%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64pp2048262.77 ± 1.81101%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64tg12818.80 ± 0.9948%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64tg25624.46 ± 3.0483%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64tg51236.32 ± 3.5990%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64pp512271.71 ± 3.53133%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64pp1024279.86 ± 45.63100%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64pp2048320.77 ± 5.00124%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64tg12843.51 ± 0.05111%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64tg25643.35 ± 0.09110%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64tg51242.60 ± 0.31105%

Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation

Which file should I choose?#

Click here for details

A great write up with charts showing various performances is provided by Artefact2 here

The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.

If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.

If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.

Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.

If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.

If you want to get more into the weeds, you can check out this extremely useful feature chart:

llama.cpp feature matrix

But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.

These I-quants can also be used on CPU and Apple Metal, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.

The I-quants are not compatible with Vulcan, which is also AMD, so if you have an AMD card double check if you're using the rocBLAS build or the Vulcan build. At the time of writing this, LM Studio has a preview with ROCm support, and other inference engines have specific builds for ROCm.

Credits#

Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.

Thank you ZeroWw for the inspiration to experiment with embed/output.

Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

Files

219 files · 7.93 TBWeights 134 GB (smallest of 24 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 219 files with their sha256
FileSizesha256
.gitattributes21.6 KBa06b491271bfbd517cc7be47e3be68cd5cbe7208d29174c860cb04a1034f37b6
DeepSeek-R1-IQ1_M/DeepSeek-R1-IQ1_M-00001-of-00004.gguf39.3 GB8f4c7def910f9901b8e02cc19dc389a12985ac0a504276a42254460b852d452a
DeepSeek-R1-IQ1_M/DeepSeek-R1-IQ1_M-00002-of-00004.gguf39.6 GBed3e839485b9b1f4b119c017e42c9b86848a3aa60e0f6e2d219590df05a8ab9f
DeepSeek-R1-IQ1_M/DeepSeek-R1-IQ1_M-00003-of-00004.gguf39.6 GB9584bc9e64bb6c4ee2ff8f121de29994b7d44edd87200254ab340f019a2375ee
DeepSeek-R1-IQ1_M/DeepSeek-R1-IQ1_M-00004-of-00004.gguf30.3 GB5f49e6a90b24aed3ab2a12b93d34523bc34752197dd4daff1274318ca802c72d
DeepSeek-R1-IQ1_S/DeepSeek-R1-IQ1_S-00001-of-00004.gguf39.3 GB2d1ee5e4f8792a4e91cb647d815b3c747e62b09cf184fa65650a593da0c4858d
DeepSeek-R1-IQ1_S/DeepSeek-R1-IQ1_S-00002-of-00004.gguf40.0 GBa7c8c36b6db8569f0388e998412094b4b57fe2c61ae66edc995fd1004621e308
DeepSeek-R1-IQ1_S/DeepSeek-R1-IQ1_S-00003-of-00004.gguf39.9 GB508996b990f6df387d97706fae36031a3c037535ca975bb0e6ba1988fd1c99af
DeepSeek-R1-IQ1_S/DeepSeek-R1-IQ1_S-00004-of-00004.gguf14.3 GBd5bb7201522db4327d8b704723b334236fdc6c00ad8e7d101a3c37865717321f
DeepSeek-R1-IQ2_M/DeepSeek-R1-IQ2_M-00001-of-00006.gguf39.6 GB492d118cc61c0786fc0e78175234acb8f6943e353e78c79c90cc76e4f210313f
DeepSeek-R1-IQ2_M/DeepSeek-R1-IQ2_M-00002-of-00006.gguf39.5 GB7240aa7de9f902ec540bdce0b604594b01ad44ebbd3e1ef158d61d62ee98bc96
DeepSeek-R1-IQ2_M/DeepSeek-R1-IQ2_M-00003-of-00006.gguf39.5 GB428daf6360e7b455519b9bc6e53777674df9d2d47ae84a52b237ca7179e21c43
DeepSeek-R1-IQ2_M/DeepSeek-R1-IQ2_M-00004-of-00006.gguf39.6 GB34fa3fc92e8cbaf1e15e461e3e3e69830790de3627e842ea627e9f0a0ef39b1a
DeepSeek-R1-IQ2_M/DeepSeek-R1-IQ2_M-00005-of-00006.gguf39.5 GB1054037af47d1c50c57c35e58abec3ecd4cae0f6db008fcd30aa6734d300672d
DeepSeek-R1-IQ2_M/DeepSeek-R1-IQ2_M-00006-of-00006.gguf19.7 GBdd3dc707aee4f84cdc222ddfb3a4ad807dded64881fd6890317cd9318e63f947
DeepSeek-R1-IQ2_S/DeepSeek-R1-IQ2_S-00001-of-00006.gguf39.6 GBf316ce1895c4d46a978ffd36ca65bcf8e719d9b2084705b67c25c1e306a018e7
DeepSeek-R1-IQ2_S/DeepSeek-R1-IQ2_S-00002-of-00006.gguf39.0 GBad4ddd908b0bea297d0ff95c44840e416d0560ec9ddbbd3a5c94abd8cfd9fa97
DeepSeek-R1-IQ2_S/DeepSeek-R1-IQ2_S-00003-of-00006.gguf39.1 GB5508c15745a4834ab1fe45f8f89fdd84643bfa116760e30d7a96c53eeff87a31
DeepSeek-R1-IQ2_S/DeepSeek-R1-IQ2_S-00004-of-00006.gguf39.1 GB0ab361e5765bb1f97da95cbef5f60dcaf094bedb1f2a1ebae08085bad57e7479
DeepSeek-R1-IQ2_S/DeepSeek-R1-IQ2_S-00005-of-00006.gguf39.0 GBb041babd63fcbfccbc7ae369800418afdf42c37f36f640f5e79ff772289a1fac
DeepSeek-R1-IQ2_S/DeepSeek-R1-IQ2_S-00006-of-00006.gguf1.09 GB1973380658f4af533cf2b85e1afec5ea51c49e606990cca036d5b4dd88e11fe4
DeepSeek-R1-IQ2_XS/DeepSeek-R1-IQ2_XS-00001-of-00005.gguf39.6 GBa884d531377876928c1e10c581c0fedd26565a62eca35165e408ad87359bc4bb
DeepSeek-R1-IQ2_XS/DeepSeek-R1-IQ2_XS-00002-of-00005.gguf40.0 GB3bda6cdd9be983c41211feb0d35829acb1da7a123eb27e599a87c841d4d08996
DeepSeek-R1-IQ2_XS/DeepSeek-R1-IQ2_XS-00003-of-00005.gguf40.0 GBfc8a909d0278818085686678ed79525c15bc7861772b14a4c365bbb961796c5f
DeepSeek-R1-IQ2_XS/DeepSeek-R1-IQ2_XS-00004-of-00005.gguf40.0 GBc8ec68c5f998ccbb81f96916ed851e859d5b900350f9da2d1e16c098c8574898
DeepSeek-R1-IQ2_XS/DeepSeek-R1-IQ2_XS-00005-of-00005.gguf35.5 GBe367b08c5b48aa7ada8da596ef481a1c7b9c544d519b57e380615d66925039f9
DeepSeek-R1-IQ2_XXS/DeepSeek-R1-IQ2_XXS-00001-of-00005.gguf39.6 GBb0ff95b9cc37f23d60ebb7f6743741c1a643f5f7b509ccea6553b76e09dfac2d
DeepSeek-R1-IQ2_XXS/DeepSeek-R1-IQ2_XXS-00002-of-00005.gguf39.7 GB18d03d0ee5010dada3fb0e321f1903ba01f8531690bbc362ba421e7c8e229f99
DeepSeek-R1-IQ2_XXS/DeepSeek-R1-IQ2_XXS-00003-of-00005.gguf39.6 GBb6747c267517195b7e13293d4258ba8549e3bfc69e4f81714fae865faabe8519
DeepSeek-R1-IQ2_XXS/DeepSeek-R1-IQ2_XXS-00004-of-00005.gguf39.6 GB25405cafc525ef9228d61cc909b05a5919b8939829c7830424b41b8b1d011584
DeepSeek-R1-IQ2_XXS/DeepSeek-R1-IQ2_XXS-00005-of-00005.gguf15.8 GBb113e231ed73789d4e34f70b601776abe5bbce44996398e6a4ef60b3d05d3a2e
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00001-of-00008.gguf38.9 GBf1f7baa85bab1de4c12dfc95d900d1d2b36d340a660599f7d17e8daba7b70214
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00002-of-00008.gguf39.7 GB79c4b31db09986dc7aecb84af8b0b1415cf4a087b68e759ecad3e39282995193
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00003-of-00008.gguf39.7 GB33cae2106858cfc28573cf1702d73d94337477e5f212838deea4a721d6632b0c
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00004-of-00008.gguf39.7 GB4dc09c78a2f30ee401e1213b5cb3260b6c5ccb1eefa37c445b34ccc609363875
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00005-of-00008.gguf39.7 GB5b89969f8a043805699ab57d123a571fcf411dd95ff25431d79910062676244b
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00006-of-00008.gguf39.7 GBc243b25c95e7713df5c962d0009f0d10a276b3be3fe4b1694e402358e347b384
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00007-of-00008.gguf39.7 GBc4f64b67b598fe9701969f74e2772d543ca83ece7968397f9bae406e395a36a9
DeepSeek-R1-IQ3_M/DeepSeek-R1-IQ3_M-00008-of-00008.gguf14.8 GBf77a2e3704e2b53c1424e06c1c2924190646a62c5600367ccfa26a2f40b78dbe
DeepSeek-R1-IQ3_XXS/DeepSeek-R1-IQ3_XXS-00001-of-00007.gguf38.6 GB9dbe93ac1b4fa512200d64dd9e45ea011a45dce53598244cf422a1b573542a88
DeepSeek-R1-IQ3_XXS/DeepSeek-R1-IQ3_XXS-00002-of-00007.gguf39.8 GB24baf0ae5f29788c19afa8e92bfbfc4e39fe1682729d0e3dc60b6c00735f67ab
DeepSeek-R1-IQ3_XXS/DeepSeek-R1-IQ3_XXS-00003-of-00007.gguf39.8 GB646853ae0bd0e63738f341524c1a940071538afb61bb3936a0062cf02934f2ed
DeepSeek-R1-IQ3_XXS/DeepSeek-R1-IQ3_XXS-00004-of-00007.gguf39.8 GBd3e0ffc6dcb3a74d047c5644c05de2e437110fdf326c9752642b7380740b4f99
DeepSeek-R1-IQ3_XXS/DeepSeek-R1-IQ3_XXS-00005-of-00007.gguf39.8 GB3cd7dc332871a035ec0ca583fc977193f3e77f22b265e40fac19fc7c6ea2c502
DeepSeek-R1-IQ3_XXS/DeepSeek-R1-IQ3_XXS-00006-of-00007.gguf39.8 GBffbaebcb8907453bddb87b6bffabe4b7412d3bf3f7546e93b99a0585f57da81a
DeepSeek-R1-IQ3_XXS/DeepSeek-R1-IQ3_XXS-00007-of-00007.gguf20.6 GBbff1fa386652e95ee8c10adcb0a2d1bc9ef3b6ae8f48c0053fe89d065591553d
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00001-of-00010.gguf39.0 GB05220ea3adbaa6b6a33332ed5f64c2baf4467c58c3922b58b90d86a0129f7774
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00002-of-00010.gguf38.9 GBb48c2b526e5c364ccaa80170570dabb6ff630e48707ba3a4be46cdcfc221de55
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00003-of-00010.gguf38.9 GB239ba72ec1f63ceff650299365139256438a1941fe307d159e9640812a793b43
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00004-of-00010.gguf38.9 GB179d4a1c5c4a9f397f28a3d62f1f6b50e76c0f76bd091a0a7faac16934af9a9d
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00005-of-00010.gguf38.9 GBed04e7e9c86de624153cccd7858c7481199c8c73663c42f6bc84808dc76deffd
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00006-of-00010.gguf38.9 GB988d1665333f1c2830f8b098c0a4960e6a23fb15f3e4d53340f1cff54c1e0a40
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00007-of-00010.gguf38.9 GB68c96e7ca87216946c5fa4f5acb788f2fb1ade544c840dba736ce87cd5001f71
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00008-of-00010.gguf38.9 GB95c2053b2110340018236aaccffd2a3e22fee9138db5edd2af564038fbd06a4f
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00009-of-00010.gguf38.9 GB2b63ef15dbf86ff8d02f528f3c17313f6aa61454bac7d9dc86f8564dae298a77
DeepSeek-R1-IQ4_NL/DeepSeek-R1-IQ4_NL-00010-of-00010.gguf28.0 GB1f54b55384b5e5db6a5699d743b0d9352eb768e31b91f55eb847fdca3e2e6eae
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00001-of-00010.gguf39.0 GBbb933ea9952eabef51b47dd0e76ddad464333677372ea69a1996df76eeb9724b
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00002-of-00010.gguf38.7 GB7aab609ac1205f1fa4d97c10e5bb07cc9794c559ce577bcef52428a77aaf9ec8
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00003-of-00010.gguf38.7 GBea6a53081866b8a56f9f748c222c16bdcbee81a821db3f8be50ff2557b6d383b
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00004-of-00010.gguf38.8 GB260b9bc7bf8578fbf0ae11397f7f8240b40688d29552ee4b82e790fb9458df0d
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00005-of-00010.gguf38.7 GBd9cac7ac6cca6286c5c06716ccfa3419dd8f571ba7fe4bf93b0f39e9d969d86c
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00006-of-00010.gguf38.7 GBa1fcf777a355e8fdbbb09b8620dc631e45a015044b3e1eea75e1295ca257a001
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00007-of-00010.gguf38.8 GBc3a16a1320a8ad318fc735518537c9644ce1f687d7f04452b230872de22f8ea0
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00008-of-00010.gguf38.7 GB959fc8bfaecbc61be759d24b939900d3bb6f10b58591fd640be1dff1e74cb0b0
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00009-of-00010.gguf38.7 GB3aadf64a7791afec1c624580631de6f1fc32fc12abb33e49fb9d9f1ed58986d4
DeepSeek-R1-IQ4_XS/DeepSeek-R1-IQ4_XS-00010-of-00010.gguf8.12 GB8fe68db5819f0c8ce733477dc40c4a14ce69e5beb886c6940a824986c925e9b2
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00001-of-00007.gguf39.4 GB1ba5be40ccb0180ae176d091740b1571b798bea7e5607fbdf5ceb38bdfc09214
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00002-of-00007.gguf39.2 GB6901aba450fa57b9be7d60be89f66651f21126cbbe135d07fc763177d53ed6cb
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00003-of-00007.gguf38.8 GBdf0e660cde94d919dd6855f46ffba0b43ed24fee384f58389b36430b445c07ab
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00004-of-00007.gguf38.9 GBf7cb95b5df88d2a22369c614976abc1f38c23ffceffe5a873f9abe170caef984
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00005-of-00007.gguf39.2 GBc7b4ab561eb6bd540142525e39c1c7ac0b1f74ae34b5da85719cd4ec8aec0eb1
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00006-of-00007.gguf38.8 GBdf3b6f6f692aff7b9f838eff9d5d027b110dc85b0803d0e0f0ab4e851f77c0d6
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00007-of-00007.gguf9.59 GB6de347b80731b92647664895f145e3d869f9bb179b17108cfa884b2256084d8e
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00001-of-00007.gguf39.0 GBa42373ee6017af6f11d44421de8d875b7a39fb326a2157cb3266590089d80813
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00002-of-00007.gguf38.9 GB70aae938fd41cddaa46180c5b007de3e801cda85b6b07b42f6d1ba0ff1eceff4
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00003-of-00007.gguf39.2 GBd9fb8392f05bac8295458f6fe62cf1cf70043fec6326a07731c44e08d246d536
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00004-of-00007.gguf38.8 GB557794ed8a0f9526b5af167e6138d47acf5ce3277ff6c816fdc18f674381f695
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00005-of-00007.gguf38.9 GBea56967480a9b89e0ef59b9aef77585139577f3443f2594d69dcee5a9658e047
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00006-of-00007.gguf39.2 GB2a7f2a7a93b55e4017c397bdc0763f7f3a7bae9b2068f96c653afec28e6cad88
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00007-of-00007.gguf10.8 GB2eb4f682138e92eb5a2daad628e2c2213bcc7a7590a8a1c101f5b604062ee359
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00001-of-00009.gguf37.9 GB2e9252a968da9328ec3514193d4fc0b6247ae40befba182bc7f4ee46c60650e8
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00002-of-00009.gguf39.9 GBa85df8bc043c55788953b2cfc7c05249502b956688735db78e4db2c397075cbc
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00003-of-00009.gguf37.5 GBd93de5dfe99a875e93a1f0564956ef5651f97186c64a6f7d3dde081e1d4cad83
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00004-of-00009.gguf39.9 GB7b0429aef6745f75c33e92cdb3c048272c4eaf12c1c32e98db2e66c9df5ab2b3
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00005-of-00009.gguf37.5 GB494b5ef0246110b2f57371f855e0052892915af34f2bbec7bba7a17e61b3bd87
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00006-of-00009.gguf39.9 GBd58ff58aa988e5d5ecd30c738a400cb39fc111fc7c2a1efacd9b2b7c80f447f4
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00007-of-00009.gguf37.5 GBcd14e70dc2aec90fdfd7119c0b62e89680b067e593a381a97193c088e0a34eb0
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00008-of-00009.gguf39.9 GBe9866cb87cfe947a168031d05773298793145733c701744a7ab7bf6f8563ad56
DeepSeek-R1-Q3_K_L/DeepSeek-R1-Q3_K_L-00009-of-00009.gguf37.3 GBbcff087e4cd65641f59dc5a0c14dcc4be55bf2575be81af7cd963af7d92ff717
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00001-of-00009.gguf38.7 GB85c178a322fa52adf9a10fa31f96d3e69bd810a44cd784c7ee8d8224dc636247
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00002-of-00009.gguf40.0 GB93a5d597b7c596b863f6c93e79de9cdb09cee2c34c167349e7a499da5e8aa8fc
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00003-of-00009.gguf38.3 GBcbdfd51400c2f5165a94551f65554915f5391d1a2930c7d560b5e3e12e6a6298
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00004-of-00009.gguf38.3 GBa7fc6a7bb46749684dd3cb5309acb5e1e4360e6c82a19dddbed364f25f1831a2
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00005-of-00009.gguf38.3 GBc0ad01c22cb94cf38eaaa307774b65926a6806cf950af4d727cb0c1d308e72b4
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00006-of-00009.gguf38.3 GB2339f96b8b1965f2c87dc5ce4469952aa62347fbe76a069a2c97eba5b1d1faef
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00007-of-00009.gguf38.3 GBaf1d313ad843ea23c72ada0fb281e28022f780946dcc044e1011df662a7d4108
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00008-of-00009.gguf38.3 GB32ac186bf80eb85d0fafd49b088828e6ab2742d3955c23d03fc6985dd16cbaaf
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00009-of-00009.gguf10.8 GBb6225b5610989f9e49e1048f8eb12c79d9a945304591e48dbf343a9fc21f4240
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00001-of-00008.gguf39.9 GB1baebd643aba4b53199ae4dec4e6affcb171a1897c3a2bc49ddf07b4973e2c66
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00002-of-00008.gguf39.6 GB8d3dde37004be7de015339d664af327ac8606eaa1c05a7f7932fa5101998bf6b
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00003-of-00008.gguf39.6 GBe5f92f60ef1e7337688dc3922f9405a0314ed4a44e31228958c901ded3393680
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00004-of-00008.gguf39.6 GB58794773cb38328a01ae276d611eb54b779c17b71f65fce2aa8c6f88fafbca68
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00005-of-00008.gguf39.6 GBed8eaed772e8f39341352aaeeb483450bf91614955843b9c9f65f4d3a6f5df8a
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00006-of-00008.gguf39.6 GB85ecca568bd0ff5243d2e9818538094c0dc98e9519ab365ee87dbf0dc5b3d322
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00007-of-00008.gguf39.6 GB56d7232c26db9b402c962052b6dddc4b3b46a6a92d99727fa9a7be3d3321f515
DeepSeek-R1-Q3_K_S/DeepSeek-R1-Q3_K_S-00008-of-00008.gguf11.5 GBe7da044c8b94f2818f409162ee6c5d6ff04b3d013d8d33b3753fe98fe435681d
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00001-of-00009.gguf38.8 GB60ff8f1f037ab24e180d41e8343cf410357d9298f3a1458fcc15a459c21149c3
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00002-of-00009.gguf39.9 GBa85df8bc043c55788953b2cfc7c05249502b956688735db78e4db2c397075cbc
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00003-of-00009.gguf37.5 GBd93de5dfe99a875e93a1f0564956ef5651f97186c64a6f7d3dde081e1d4cad83
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00004-of-00009.gguf39.9 GB7b0429aef6745f75c33e92cdb3c048272c4eaf12c1c32e98db2e66c9df5ab2b3
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00005-of-00009.gguf37.5 GB494b5ef0246110b2f57371f855e0052892915af34f2bbec7bba7a17e61b3bd87
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00006-of-00009.gguf39.9 GBd58ff58aa988e5d5ecd30c738a400cb39fc111fc7c2a1efacd9b2b7c80f447f4
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00007-of-00009.gguf37.5 GBcd14e70dc2aec90fdfd7119c0b62e89680b067e593a381a97193c088e0a34eb0
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00008-of-00009.gguf39.9 GBe9866cb87cfe947a168031d05773298793145733c701744a7ab7bf6f8563ad56
DeepSeek-R1-Q3_K_XL/DeepSeek-R1-Q3_K_XL-00009-of-00009.gguf37.3 GBbcff087e4cd65641f59dc5a0c14dcc4be55bf2575be81af7cd963af7d92ff717
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00001-of-00010.gguf40.0 GB08ee30f069f91a4e8e6440bfc3e016b4c2d650fe4139a9c0ce206e0b528e5f22
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00002-of-00010.gguf38.9 GB6599e5d46105f706e9e1ec511296a475c9d01770b95fca08f4923947815b0c1f
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00003-of-00010.gguf38.9 GB5f030f6fa3fd8b15daa40486d3ec0641e8158b6e6feb9f9db57a9a646a6970d7
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00004-of-00010.gguf38.9 GBcc2868ec4b9e0d96fabc2d98213c3230228a80ab984902df9eda8f7ce64c6f1f
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00005-of-00010.gguf38.9 GBf6348410cea8a9ba24eb14a6ede9acb53820f14a8666422dce52fbc2bedcd807
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00006-of-00010.gguf38.9 GB5b44c9381a4567a31705c9ee805f3b3140f7a6f446d157cd24213bd1370a23d7
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00007-of-00010.gguf38.9 GBf1d4c69d3c55366e16761e006d7ec6d9120c76edc9b7901a1b895feabf494093
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00008-of-00010.gguf38.9 GB95f88ab9e3b64ebacf9164983c6b759b935cf7710b50660eae82cca64424d78c
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00009-of-00010.gguf38.9 GBc90d6b9da5fd96b8860ebbd25e7c9a1cd32c5d18b5e00683d6f5487d6067c381
DeepSeek-R1-Q4_0/DeepSeek-R1-Q4_0-00010-of-00010.gguf28.0 GBa365800759b9600b1cbb4156d7f40919308df2f94beffd2e89d660976bdb86e1
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00001-of-00011.gguf38.5 GB0845497972b5645df5e35a7de7c2a57929cdfc0808af26545033f4d412de1a94
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00002-of-00011.gguf38.3 GB546e64c54795d4b4c514a979fa4ae61907ab1a97755c55d7868c60b3d502ddd3
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00003-of-00011.gguf38.4 GB5d910b7bbd08b5a8230e62ab5f6cd54f081c83bb655b85bb12d72e8ce131f2f4
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00004-of-00011.gguf38.5 GB34b122a2ee692d6cbec69f7b077c86fc99c040751620ba88a19680ace244758c
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00005-of-00011.gguf38.3 GBb6fe6e84a5c7c7ca7dd6219ff0076e123439d4563a7bd8084d3fd170720e9823
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00006-of-00011.gguf38.4 GB4f41ef13680cc02ca88b717d8964757e6e31c01d1654672293da3af2816716a8
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00007-of-00011.gguf38.5 GB554d87d3dc9c658797f3c3bf557d1b4845d2f69f55c36ec1fdb7cb2e2abc1931
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00008-of-00011.gguf38.3 GBa1490701bbf2f1a6d52e18f993027cb9cba06d4d694ece897ed688054b1bcad6
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00009-of-00011.gguf38.4 GBf6b299616a260dda4a734df366081e54bc8789bc68eb240de1e3b1c9efb9352b
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00010-of-00011.gguf38.5 GB48131f3088950e6848209c3052c034beb597919697f3d3436fdbc90be50bd2a9
DeepSeek-R1-Q4_1/DeepSeek-R1-Q4_1-00011-of-00011.gguf35.9 GBefe29898c6b0b6a8f85d0984e9eb51461e47fe483882760c2dac00799988345a
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00011.gguf38.8 GB9d22dd4035fa90197f547670c6b70db458caf998eecc08dcf9fea65f30dfc76f
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00002-of-00011.gguf38.6 GB7e27e3d1525eaa01c2cde87f56112bc762c590f219d9ba3674c6a7a92a8f7eb2
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00003-of-00011.gguf38.7 GBf5950800e05f320da3e84b41b5a7633412c23385668b26fafde3bf2aab6bb315
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00004-of-00011.gguf38.7 GB5e3d3d1815ca7a5be1e98bcda8678a8059e52e6ed33d1900ae303ffb5e73eafe
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00005-of-00011.gguf38.6 GBc57dbedbb9a249cda48d06f703f60d16aac22ff04159ead4970c3deb7b075e14
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00006-of-00011.gguf38.7 GB3fb4a12993b10d8545505292ea95b9a5f0503e1a7203db1e8c74e0b6a1316a3e
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00007-of-00011.gguf37.7 GB75553d4feb1bc98f1f51fe0d17d2747d8d893f00b259a822a8e933979a8f5642
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00008-of-00011.gguf38.6 GBfbdfe888966513f35da8de0b32682f3f28e86e22b9d6cbe84ae2f88d32874267
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00009-of-00011.gguf39.7 GB0abc88bdd0bd2fa983fc9d6a18dd06464790e9e2905078f6d63e78dd9a64b619
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00010-of-00011.gguf39.4 GB67696498cdecbef31c441d01db794cc49ee8627523e1cb23a89406532f2d5d7f
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00011-of-00011.gguf17.0 GB4501788ca41aa50a373dc07bc71668b3b8ab6415b4bec5d8b3c8ebd510694832
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00001-of-00010.gguf38.8 GBd030d43e9d6946515b9f2b8571475d48640064ae89672f63a27502845ba81cb3
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00002-of-00010.gguf38.9 GB6feb5a7ce9f43285164c7ac6e23c9181db1887e8308835ed9be58dc028e745cd
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00003-of-00010.gguf38.9 GBba9dfd82a94cb5e87d6c2f7cc8195e60a05266ea6f7a72012beaa0e0abefd155
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00004-of-00010.gguf38.9 GBdbfd13c2a270fae216ffc2522d5f32cfd57cd45df08dbce75922e4a891cc166b
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00005-of-00010.gguf38.9 GB1dfe9a2f3b9eddba1f2c420a30bbcd3e427a03b6cae62619f1cddc0b8fa0fecd
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00006-of-00010.gguf38.9 GB16a8b9560b509361f58325773db2ecb482f4727e12ad8e9dbae8ed2cdbd84dad
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00007-of-00010.gguf38.9 GBa2a87a2f89bf023baa7691c0068f1dbf7cc1b0e3abb2123a8cf634c499459237
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00008-of-00010.gguf38.9 GB3213b24ce923ef05c4073350e73665aff1075ab2f0dead743666192edd57881e
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00009-of-00010.gguf38.9 GBe8278bc990bda28aca98bd2f4886d38a36f5999dbb9e3b8982f0b445ade15042
DeepSeek-R1-Q4_K_S/DeepSeek-R1-Q4_K_S-00010-of-00010.gguf30.2 GB1cdcefd7e078f7183ca780cd7948c9fd1b6ec10798285426ea650f63788f5be6
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00001-of-00013.gguf39.1 GB18583cd5b29766f6dcfd2ea044b4d59695bd55b0584c2408a1fe53f1b876cf2a
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00002-of-00013.gguf37.5 GB3cc768b06835cd64b7f1bb7262c72efa121272ae9aa1044f28341748fdbc37e9
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00003-of-00013.gguf37.9 GB6c1451ad55924743e80be7df2676e0f934244adb4ae2d008721d183c5be871ab
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00004-of-00013.gguf38.0 GB99f14da6c88eca29c6bbf53053c8ce41da7062df0e390a58d57e79a0ad7d4b22
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00005-of-00013.gguf37.5 GBde9a589ccd7cf79342c62be158772733a717c6ee91d64df061b7ef26b1695657
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00006-of-00013.gguf37.9 GBe64916796668e8c2fb28d993fe473d75bcbcd16dda3c570034bfcdd67e4a4852
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00007-of-00013.gguf37.5 GB38ee8a99ca719b9617d48a396fb56494d4f514d48518aab904fedf832b9946c5
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00008-of-00013.gguf38.0 GB3a6cce3173f6299887b8d80e65ad3abfee1eb5c4b94d41a4a85fbf26a7c88cd9
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00009-of-00013.gguf40.0 GB8bfafaf5b9d30b21236b12b4c8ff610f8a513808e2555a4777ef7ef0a6b98cdb
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00010-of-00013.gguf38.0 GB7ee7a951fc4a3440f2648efbc0c1253ca17cfd30a6badde6b5b877100f687a3a
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00011-of-00013.gguf38.5 GBbb6398240deab3d22bf9ea65f32ec21605a45c7fcf8d4f9992531756b2288d66
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00012-of-00013.gguf39.0 GBac7e7520229baccec826815f2c8356c32aeac3d2a8cf44ed654c69e76f0a71d5
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00013-of-00013.gguf16.7 GB8eb746c681df9416a2d109fe04076569a7783e5cd6687eaedbb64e8cc7bee0e9
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00001-of-00012.gguf39.6 GB91d32201263f86edc9e6f79bff1b7fd8cd7b4c76eaaa075906344c1dd8b046d7
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00002-of-00012.gguf39.6 GB34a8386601e8f32548d14196fa366f28b172c40fb8ba63d4bf1b504a3020c83e
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00003-of-00012.gguf39.6 GB31f6ebda6c95e80552f15e0a9a33b2bc5b18a80988f43b37247b89688b9d61cf
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00004-of-00012.gguf39.6 GB999d58dc00f478f3ad45d0cbb3f9093e13bad74ba8de470115383197fb15d517
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00005-of-00012.gguf39.6 GB8e6716b691cefba53336bb7f82cc92f1410aac5d9ab145cbe79b7f8f40bd6540
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00006-of-00012.gguf39.6 GBbe2cb1745744ba46e8663b025d531158ad771a0b6acb21c39b94be833d60e1fa
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00007-of-00012.gguf39.6 GBb3d6fb040327d0906c5edb886a53ec1eeddb5fe086dca97891e8813284afae13
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00008-of-00012.gguf39.6 GB919d80d528a01eb2de04368a336b0fc1b33991d45dba0478d1c9ffd6532ff855
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00009-of-00012.gguf39.6 GB83547428f998bc9d9d7bd4a5aca01199e2d40d4285bc5b80df1ef29eb25b5993
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00010-of-00012.gguf39.6 GBa0f58d27b2b2c25bb88792b29806ebcb6cd05bb5e1c885549460897f34e9effb
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00011-of-00012.gguf39.6 GB88b5133b02794aedb135bd968ac5ded31f0f6248037a114f2d2ef94eb4943b5a
DeepSeek-R1-Q5_K_S/DeepSeek-R1-Q5_K_S-00012-of-00012.gguf26.3 GB5d763dbcb6ce1d5c8ce0db3f31d1ff52c5d7c964ec473af2a0156e117ee8abf3
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00001-of-00015.gguf37.6 GBca5a3ac3079f4f1944e3fa607c80c2ed7524427698b64a63da5a686bdae7a66e
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00002-of-00015.gguf37.8 GBb2a08da14f50f7d86cdaa78a45aab2f13e8bae01d8ca614dcaec9297e54a07a3
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00003-of-00015.gguf37.8 GB9e1bafaed0cf48f8568f93590fefa43f0f34174ad123c6978529b79d9b773a62
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00004-of-00015.gguf37.8 GBc9114cc7c8805b2b2ed9e7a6c60770477ab26a6067ee58960f322c8e185f624f
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00005-of-00015.gguf37.8 GB3e725b23d658c4eebd478f2c57707bdb2c4605c78a33a1501f8240f5612377b8
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00006-of-00015.gguf37.8 GB6fe4092be683f771776cfcb00410784fd7c34b4da01ce1cd7d43398863b74ad9
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00007-of-00015.gguf37.8 GB9a6c4ec08ab23eb18cd966b32cec4b44782e44e6d7c2df09639dd9c083d49665
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00008-of-00015.gguf37.8 GB96d1bb9abc69b7554829ccd7ad978ab10b63b0f752418f90deb08a888097285e
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00009-of-00015.gguf37.8 GBa05b9baed101d90f5585caf4ef20f17ee370aa1196bb4591e9aa8bb98b6a0e6f
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00010-of-00015.gguf37.8 GB02d07110227215418217860c4256728af719968775c6b39e7d17055fcbd7135f
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00011-of-00015.gguf37.8 GBaa22edc9708aa4bd5bb25bf6fd1da06575113e57132b3b61b818c7006caa424f
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00012-of-00015.gguf37.8 GBe328a563469928c51451b7aed0d6ccffbdca42c447d19d280c4b84724d980f6e
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00013-of-00015.gguf37.8 GB1dbad74301780e4a0c31921834e102a54578e1bc4a990ff4cccfd52c48617edd
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00014-of-00015.gguf37.8 GBe6ae69f47541694c6fb537d8b11946da0783dfb642476f48acd7011e228147bc
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00015-of-00015.gguf22.0 GB1f0f3ff027261b05b0e4128a6d1c6f4bc3b5f574d9ebfbc0cbf5df7e12621b61
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00001-of-00020.gguf36.5 GBf4d6d9cf05f5b5702e0210d811842bdfcf63dae34fe0c0b18e3d49d2afcb51af
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00002-of-00020.gguf36.7 GB1183eed6abc6ec787b0cbda2655088f1aafc17b00c0750b00f0dd60f5d1c3d45
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00003-of-00020.gguf36.7 GB439dbb7774f8a1ec72add0dd361d32ebd5630281aba58960adefdfbd2cd3b9a7
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00004-of-00020.gguf36.7 GB61af2077ea0bb11dcd088fc811ccc4ed12378bb09852a7afc8d60abadc7deb4f
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00005-of-00020.gguf36.7 GB7667529ce88aa7425c201e5f0d9a2215d01885230e1a195c9dad2a20af104493
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00006-of-00020.gguf36.7 GBbc67c389074a9fa7217273a12accd34a6a01cc1ded84973f8fbac038415a5c02
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00007-of-00020.gguf36.7 GB03550aba458c9a81fd9981c4d50807a6c791e44f10ee48caed30c258a74b07fa
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00008-of-00020.gguf36.7 GB2f7ac96004d60d0e47e26fca0be0b456c3a5d5038d2cb91570f47ee93f6f74e1
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00009-of-00020.gguf36.7 GBf674772868a4055824572a2e36fbbb8eb25cd029682f5f96c4a9e544aa4c74a8
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00010-of-00020.gguf36.7 GBd6fa9ad3d095b955b18c3ab41881d6fc3aa9de7e64b61338998154f3f2282c5c
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00011-of-00020.gguf36.7 GBc43f9b5ae474f3b0cf40dc3d7087bf354707c3b2bdeea6c17ecdfef012c03291
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00012-of-00020.gguf36.7 GBf8af918cd51b5ec4943ad6fd1d36574c7f4b0471d56711b9b43a675808f661bd
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00013-of-00020.gguf36.7 GB9e57b29317e06075e6765d8e40c340646feeb3835c28d6747c848579ae4d2e7c
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00014-of-00020.gguf36.7 GB75378576b2d236fdd247e68fda793730b5bcf60f85101a9c3ce2f8fdfd6e88f1
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00015-of-00020.gguf36.7 GB8ab4f8065d85dbefa1b3b8f81cc49b700ec2623d76f4f5d6783b007689de21ba
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00016-of-00020.gguf36.7 GBfaa8905b98bd4c8448d9403694f02b9cca3f46b923b0795367c17c784d8a84e8
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00017-of-00020.gguf36.7 GBd3753999e9d43f465498c49ad6d32dfc1b5f5ff0304d7057289d6bfc1da50e99
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00018-of-00020.gguf36.7 GBa702299be1b48e62ba6c2d845781019a1256008bcdf075abd1d92cf804f00def
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00019-of-00020.gguf36.7 GBfebb3075174d0f57c78c114b6927dbbbec3d3f186d376aef31f53353fa657e48
DeepSeek-R1-Q8_0/DeepSeek-R1-Q8_0-00020-of-00020.gguf16.2 GBef19d37e8d0a69712243137996e91e08c0130143835a009a0bc33c8c33360763
DeepSeek-R1.imatrix987 MBdad5e1db371589ecc1512f16b2ffb918694d00c557250bcf6f9f44379eddb758
README.md12.9 KB2d39dc4102b5f23247a5e83db98f903984cfaca19d260d9baec32ce87f61eb41
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
aa476ba46d pinned now2026-11-15 05:04 UTC219 files · 7.93 TB

Use it

$ fw get bartowski/DeepSeek-R1-GGUF
# manifest sha256 60aab86b6e01… · 7.93 TB · 219 files
$ fw verify ./DeepSeek-R1-GGUF bartowski/DeepSeek-R1-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/bartowski/DeepSeek-R1-GGUF.json --dir ./DeepSeek-R1-GGUF $ python3 fw.py verify ./DeepSeek-R1-GGUF ./bartowski__DeepSeek-R1-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/DeepSeek-R1-GGUF --revision aa476ba46d761caf58596b493e8f0c056c9d94c7 --local-dir ./DeepSeek-R1-GGUF
llama.cppDownload one GGUF variant (DeepSeek-R1-IQ1_S, 134 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/DeepSeek-R1-GGUF --include "DeepSeek-R1-IQ1_S/*" --local-dir ./DeepSeek-R1-GGUF $ llama-server -m ./DeepSeek-R1-GGUF/DeepSeek-R1-IQ1_S/DeepSeek-R1-IQ1_S-00001-of-00004.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./DeepSeek-R1-GGUF/DeepSeek-R1-IQ1_S/DeepSeek-R1-IQ1_S-00001-of-00004.gguf\n' > Modelfile $ ollama create deepseek-r1-gguf -f Modelfile

License

Name
MIT License
Id
MIT
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
2d39dc4102b5f23247a5e83db98f903984cfaca19d260d9baec32ce87f61eb41
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.deepseekSubject: DeepSeek-R1-GGUFDate: 2026-11-15Commit: aa476baSigned: 2DC28CC7B26A283B ✓
Upstream
bartowski/DeepSeek-R1-GGUF
Pinned commit
aa476ba46d761caf58596b493e8f0c056c9d94c7
Manifest
DeepSeek-R1-GGUF.json · .minisig
Manifest sha256
60aab86b6e011629d660f1c83eee7de5118ac3c2eed4a2aae3efcc81835c98a2
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:04 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/bartowski/DeepSeek-R1-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/bartowski/DeepSeek-R1-GGUF.json.minisig $ minisign -Vm DeepSeek-R1-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

deepseek-ai/DeepSeek-R1 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/DeepSeek-R1-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. DeepSeek-R1-GGUF.json. Provenance. Takedown history: none.
From: timm <huggingface.co/timm>Subject: deepseek_vit_412m.deepseek_v4_1_flash
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-V3-0324-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-V3.1-GGUF
From: mlx-community <huggingface.co/mlx-community>Subject: deepseek-ai-DeepSeek-V4-Flash-8bit