alt.freeweights.deepseek / DeepSeek-R1-0528-Qwen3-8B-GGUF
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.deepseekSubject:

DeepSeek-R1-0528-Qwen3-8B-GGUF

Date: 2026-11-14Commit: eb48357Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 138 GB in all. Published by unsloth under MIT.

deepseek138GBDeepSeek-R1-0528-Qwen3-8B-GGUFggufpermissive
FactsParamsnot statedSize138 GBFormatsggufTasktext generationLicenseMITFrom sourcepermissive
$ fw get unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
# manifest sha256 9689d3652754… · 138 GB · 32 files
$ fw verify ./DeepSeek-R1-0528-Qwen3-8B-GGUF unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
From sourceHosted (signed)unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUFLast check: 2026-11-14 21:32 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of DeepSeek-R1-0528-Qwen3-8B.

Works with

Convert with

Overview

Size
138 GB
Weights
2.27 GB (smallest of 26 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
MIT (permissive)
Files
32, each with a sha256
Publisher
unsloth
Added
2026-11-14
Section
alt.freeweights.deepseek
Lineage

Original release from the publisher.

Base model: deepseek-ai/DeepSeek-R1-0528-Qwen3-8B

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 21:32 UTCpassed

Model card

From the publisher at commit eb48357. Shown as plain text with links; images open at the publisher.

Learn how to run DeepSeek-R1-0528 correctly - Read our Guide.

See our collection for all versions of R1 including GGUF, 4-bit & 16-bit formats.

Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants.

https://github.com/unslothai/unsloth/ https://discord.gg/unsloth https://docs.unsloth.ai/basics/deepseek-r1-0528-how-to-run-locally

🐋 DeepSeek-R1-0528-Qwen3-8B Usage Guidelines#

  • For Ollama do ollama run hf.co/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF:Q4_K_XL - it'll auto get the correct chat template and all settings
  • Set the temperature between 0.5–0.7 (0.6 recommended) to reduce repetition and incoherence.
  • Set Top_P value of 0.95 (recommended)
  • R1-0528 uses the same chat template as the original R1 model:
<|begin▁of▁sentence|><|User|>What is 1+1?<|Assistant|>It's 2.<|end▁of▁sentence|><|User|>Explain more!<|Assistant|>
  • For llama.cpp / GGUF inference, you should skip the BOS since it’ll auto add it:
<|User|>What is 1+1?<|Assistant|>

DeepSeek-R1-0528 Model Card#

Image: DeepSeek-V3


Homepage Chat Hugging Face

Discord Wechat Twitter Follow

License

Paper Link👁️

1. Introduction#

The DeepSeek R1 model has undergone a minor version upgrade, with the current version being DeepSeek-R1-0528. In the latest update, DeepSeek R1 has significantly improved its depth of reasoning and inference capabilities by leveraging increased computational resources and introducing algorithmic optimization mechanisms during post-training. The model has demonstrated outstanding performance across various benchmark evaluations, including mathematics, programming, and general logic. Its overall performance is now approaching that of leading models, such as O3 and Gemini 2.5 Pro.

Image: image

Compared to the previous version, the upgraded model shows significant improvements in handling complex reasoning tasks. For instance, in the AIME 2025 test, the model’s accuracy has increased from 70% in the previous version to 87.5% in the current version. This advancement stems from enhanced thinking depth during the reasoning process: in the AIME test set, the previous model used an average of 12K tokens per question, whereas the new version averages 23K tokens per question.

Beyond its improved reasoning capabilities, this version also offers a reduced hallucination rate, enhanced support for function calling, and better experience for vibe coding.

2. Evaluation Results#

DeepSeek-R1-0528#

For all our models, the maximum generation length is set to 64K tokens. For benchmarks requiring sampling, we use a temperature of $0.6$, a top-p value of $0.95$, and generate 16 responses per query to estimate pass@1.

| Category | Benchmark (Metric) | DeepSeek R1 | DeepSeek R1 0528

|----------|----------------------------------|-----------------|---|

| General |

| | MMLU-Redux (EM) | 92.9 | 93.4 | | MMLU-Pro (EM) | 84.0 | 85.0 | | GPQA-Diamond (Pass@1) | 71.5 | 81.0 | | SimpleQA (Correct) | 30.1 | 27.8 | | FRAMES (Acc.) | 82.5 | 83.0 | | Humanity's Last Exam (Pass@1) | 8.5 | 17.7

| Code |

| | LiveCodeBench (2408-2505) (Pass@1) | 63.5 | 73.3 | | Codeforces-Div1 (Rating) | 1530 | 1930 | | SWE Verified (Resolved) | 49.2 | 57.6 | | Aider-Polyglot (Acc.) | 53.3 | 71.6

| Math |

| | AIME 2024 (Pass@1) | 79.8 | 91.4 | | AIME 2025 (Pass@1) | 70.0 | 87.5

| | HMMT 2025 (Pass@1) | 41.7 | 79.4 |

| | CNMO 2024 (Pass@1) | 78.8 | 86.9

| Tools |

| | BFCL_v3_MultiTurn (Acc) | - | 37.0 |

| | Tau-Bench (Pass@1) | - | 53.5(Airline)/63.9(Retail)

Note: We use Agentless framework to evaluate model performance on SWE-Verified. We only evaluate text-only prompts in HLE testsets. GPT-4.1 is employed to act user role in Tau-bench evaluation.

DeepSeek-R1-0528-Qwen3-8B#

Meanwhile, we distilled the chain-of-thought from DeepSeek-R1-0528 to post-train Qwen3 8B Base, obtaining DeepSeek-R1-0528-Qwen3-8B. This model achieves state-of-the-art (SOTA) performance among open-source models on the AIME 2024, surpassing Qwen3 8B by +10.0% and matching the performance of Qwen3-235B-thinking. We believe that the chain-of-thought from DeepSeek-R1-0528 will hold significant importance for both academic research on reasoning models and industrial development focused on small-scale models.

AIME 24AIME 25HMMT Feb 25GPQA DiamondLiveCodeBench (2408-2505)
Qwen3-235B-A22B85.781.562.571.166.5
Qwen3-32B81.472.9-68.4-
Qwen3-8B76.067.3-62.0-
Phi-4-Reasoning-Plus-14B81.378.053.669.3-
Gemini-2.5-Flash-Thinking-052082.372.064.282.862.3
o3-mini (medium)79.676.753.376.865.9
DeepSeek-R1-0528-Qwen3-8B86.076.361.561.160.5

3. Chat Website & API Platform#

You can chat with DeepSeek-R1 on DeepSeek's official website: chat.deepseek.com, and switch on the button "DeepThink"

We also provide OpenAI-Compatible API at DeepSeek Platform: platform.deepseek.com

4. How to Run Locally#

Please visit DeepSeek-R1 repository for more information about running DeepSeek-R1-0528 locally.

Compared to previous versions of DeepSeek-R1, the usage recommendations for DeepSeek-R1-0528 have the following changes:

  1. System prompt is supported now.
  2. It is not required to add "\<think\>\n" at the beginning of the output to force the model into thinking pattern.

The model architecture of DeepSeek-R1-0528-Qwen3-8B is identical to that of Qwen3-8B, but it shares the same tokenizer configuration as DeepSeek-R1-0528. This model can be run in the same manner as Qwen3-8B, but it is essential to ensure that all configuration files are sourced from our repository rather than the original Qwen3 project.

System Prompt#

In the official DeepSeek web/app, we use the same system prompt with a specific date.

该助手为DeepSeek-R1,由深度求索公司创造。
今天是{current date}。

For example,

该助手为DeepSeek-R1,由深度求索公司创造。
今天是2025年5月28日,星期一。
Temperature#

In our web and application environments, the temperature parameter $T_{model}$ is set to 0.6.

For file uploading, please follow the template to create prompts, where {file_name}, {file_content} and {question} are arguments.

file_template = \
"""[file name]: {file_name}
[file content begin]
{file_content}
[file content end]
{question}"""

For Web Search, {search_results}, {cur_date}, and {question} are arguments. For Chinese query, we use the prompt:

search_answer_zh_template = \
'''# 以下内容是基于用户发送的消息的搜索结果:
{search_results}
在我给你的搜索结果中,每个结果都是[webpage X begin]...[webpage X end]格式的,X代表每篇文章的数字索引。请在适当的情况下在句子末尾引用上下文。请按照引用编号[citation:X]的格式在答案中对应部分引用上下文。如果一句话源自多个上下文,请列出所有相关的引用编号,例如[citation:3][citation:5],切记不要将引用集中在最后返回引用编号,而是在答案对应部分列出。
在回答时,请注意以下几点:
- 今天是{cur_date}。
- 并非搜索结果的所有内容都与用户的问题密切相关,你需要结合问题,对搜索结果进行甄别、筛选。
- 对于列举类的问题(如列举所有航班信息),尽量将答案控制在10个要点以内,并告诉用户可以查看搜索来源、获得完整信息。优先提供信息完整、最相关的列举项;如非必要,不要主动告诉用户搜索结果未提供的内容。
- 对于创作类的问题(如写论文),请务必在正文的段落中引用对应的参考编号,例如[citation:3][citation:5],不能只在文章末尾引用。你需要解读并概括用户的题目要求,选择合适的格式,充分利用搜索结果并抽取重要信息,生成符合用户要求、极具思想深度、富有创造力与专业性的答案。你的创作篇幅需要尽可能延长,对于每一个要点的论述要推测用户的意图,给出尽可能多角度的回答要点,且务必信息量大、论述详尽。
- 如果回答很长,请尽量结构化、分段落总结。如果需要分点作答,尽量控制在5个点以内,并合并相关的内容。
- 对于客观类的问答,如果问题的答案非常简短,可以适当补充一到两句相关信息,以丰富内容。
- 你需要根据用户要求和回答内容选择合适、美观的回答格式,确保可读性强。
- 你的回答应该综合多个相关网页来回答,不能重复引用一个网页。
- 除非用户要求,否则你回答的语言需要和用户提问的语言保持一致。
# 用户消息为:
{question}'''

For English query, we use the prompt:

search_answer_en_template = \
'''# The following contents are the search results related to the user's message:
{search_results}
In the search results I provide to you, each result is formatted as [webpage X begin]...[webpage X end], where X represents the numerical index of each article. Please cite the context at the end of the relevant sentence when appropriate. Use the citation format [citation:X] in the corresponding part of your answer. If a sentence is derived from multiple contexts, list all relevant citation numbers, such as [citation:3][citation:5]. Be sure not to cluster all citations at the end; instead, include them in the corresponding parts of the answer.
When responding, please keep the following points in mind:
- Today is {cur_date}.
- Not all content in the search results is closely related to the user's question. You need to evaluate and filter the search results based on the question.
- For listing-type questions (e.g., listing all flight information), try to limit the answer to 10 key points and inform the user that they can refer to the search sources for complete information. Prioritize providing the most complete and relevant items in the list. Avoid mentioning content not provided in the search results unless necessary.
- For creative tasks (e.g., writing an essay), ensure that references are cited within the body of the text, such as [citation:3][citation:5], rather than only at the end of the text. You need to interpret and summarize the user's requirements, choose an appropriate format, fully utilize the search results, extract key information, and generate an answer that is insightful, creative, and professional. Extend the length of your response as much as possible, addressing each point in detail and from multiple perspectives, ensuring the content is rich and thorough.
- If the response is lengthy, structure it well and summarize it in paragraphs. If a point-by-point format is needed, try to limit it to 5 points and merge related content.
- For objective Q&A, if the answer is very brief, you may add one or two related sentences to enrich the content.
- Choose an appropriate and visually appealing format for your response based on the user's requirements and the content of the answer, ensuring strong readability.
- Your answer should synthesize information from multiple relevant webpages and avoid repeatedly citing the same webpage.
- Unless the user requests otherwise, your response should be in the same language as the user's question.
# The user's message is:
{question}'''

5. License#

This code repository is licensed under MIT License. The use of DeepSeek-R1 models is also subject to MIT License. DeepSeek-R1 series (including Base and Chat) supports commercial use and distillation.

6. Citation#

@misc{deepseekai2025deepseekr1incentivizingreasoningcapability,
      title={DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning}, 
      author={DeepSeek-AI},
      year={2025},
      eprint={2501.12948},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2501.12948}, 
}

7. Contact#

If you have any questions, please raise an issue or contact us at service@deepseek.com.

Files

32 files · 138 GBWeights 2.27 GB (smallest of 26 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 32 files with their sha256
FileSizesha256
.gitattributes3.52 KB9743e032bf3b674c1effe934d32d4e2c19da92e15a33a918cfb24cbe3456d91e
DeepSeek-R1-0528-Qwen3-8B-BF16.gguf16.4 GB0f9c0b8213d5db1dacf9db6f687bc1703de21e95b6bfd967e786151b660a4b50
DeepSeek-R1-0528-Qwen3-8B-IQ4_NL.gguf4.79 GB1354fe6231581b3f2803cf57edf66c0b030289e7b6d20dbdb232c3777d401c18
DeepSeek-R1-0528-Qwen3-8B-IQ4_XS.gguf4.58 GB111db362d89e14694a5b61838c81c3e46ddbf3150616038f999756148fb8db45
DeepSeek-R1-0528-Qwen3-8B-Q2_K.gguf3.28 GBe601b0c81f59977aacd84010527b5e213bdd69b3ead270c897907728d06f21ff
DeepSeek-R1-0528-Qwen3-8B-Q2_K_L.gguf3.43 GB66a4978f6bd36ea0742687df8d7376566522263b1551ca4c36b74f69300bb66d
DeepSeek-R1-0528-Qwen3-8B-Q3_K_M.gguf4.12 GB750c8e88c22ab8ef5f1acb6bb0eb10dc186a64b83c4e67dfe4d06a30a6fc8121
DeepSeek-R1-0528-Qwen3-8B-Q3_K_S.gguf3.77 GBa49513e04b6ba0e993e563e3804fa07795875740e9c98f5ec81bd79dc7251dfd
DeepSeek-R1-0528-Qwen3-8B-Q4_0.gguf4.79 GB3e577e87a79bae8f88687957343ae10f5cf68074997cbb531906bab47493fb4e
DeepSeek-R1-0528-Qwen3-8B-Q4_1.gguf5.25 GBa06b2a5256eaaeeb3f1b66d6a36c68bb8600d0ad5560ad7565218e0f4e5b10c0
DeepSeek-R1-0528-Qwen3-8B-Q4_K_M.gguf5.03 GBa86349a4180c4e6bb43f874c29c404fa2be3f90b15509bd6d86f697dba724ec1
DeepSeek-R1-0528-Qwen3-8B-Q4_K_S.gguf4.80 GB53bfc7a0ffaee79f599d9e3b001983a64d9a66b01857b643591e00c94988ea3d
DeepSeek-R1-0528-Qwen3-8B-Q5_K_M.gguf5.85 GB044519a2d9821f9a91fbc8bda4eb2333180842bf56845d130e71144c11a1140e
DeepSeek-R1-0528-Qwen3-8B-Q5_K_S.gguf5.72 GB448c03e0613c5b69ed2a77786a7f3aa7174341687e7845dbf2bbbf3ecac2af6b
DeepSeek-R1-0528-Qwen3-8B-Q6_K.gguf6.73 GBa012051e59aec617951defa167d3e3658196fe32a8842df4f2d1e2678b30ab40
DeepSeek-R1-0528-Qwen3-8B-Q8_0.gguf8.71 GB8d6f3bdd8853aa5af98412f2d001c4cc4d33e1ffb85a8361963e79b5573f4856
DeepSeek-R1-0528-Qwen3-8B-UD-IQ1_M.gguf2.39 GBfea814e8b92f8218440552a29ee46d3658104f04637b230f921dc0beaaf3fb7f
DeepSeek-R1-0528-Qwen3-8B-UD-IQ1_S.gguf2.27 GB8ca34f2a2aa450bcb35d431a299d7d364e0774d3c6e5acb6ec087cdb25c3d0d8
DeepSeek-R1-0528-Qwen3-8B-UD-IQ2_M.gguf3.11 GB9e21af64845a9e0877c57ae9ec6bdbccaebbfc97683c1f7a9cad61b3b691c5d5
DeepSeek-R1-0528-Qwen3-8B-UD-IQ2_XXS.gguf2.60 GB219e552c56b368062f391ba5185421393f39588dc98f5b2ae394f30c49da2306
DeepSeek-R1-0528-Qwen3-8B-UD-IQ3_XXS.gguf3.41 GBacf5dcbaa7960333e6275cae1f620eaa27f46399883f6aaf2986c152e1596544
DeepSeek-R1-0528-Qwen3-8B-UD-Q2_K_XL.gguf3.50 GBeebcb5b63392e2a9aa09224d77985f1b1b079061fbb590f2c61ee723ed26698e
DeepSeek-R1-0528-Qwen3-8B-UD-Q3_K_XL.gguf4.31 GB26e87e895ac974337af9926e5af9bd0978823b60b548079f26d70cc269f662ca
DeepSeek-R1-0528-Qwen3-8B-UD-Q4_K_XL.gguf5.12 GBd52981546abfe5777437f9cd6e5562c850bc0b288e651297f711cec442737f5c
DeepSeek-R1-0528-Qwen3-8B-UD-Q5_K_XL.gguf5.88 GB11ca11d652f16a46c714f7f006efe5761a699f29f76955687d2757c999112e02
DeepSeek-R1-0528-Qwen3-8B-UD-Q6_K_XL.gguf7.49 GB47db32273d3c0f94923557c752a04d2cbb141169671bb9033216bc2865d68a1b
DeepSeek-R1-0528-Qwen3-8B-UD-Q8_K_XL.gguf10.8 GBf9ea0157a701ed7bcdb51ba9461b9aba90189c9d60aa057f8b22b3d5145972d7
README.md16.9 KBa1963fb2f2fd3187ab4a008b5f9fc616bea2761fe5030d70ee1d0f563e1f7859
config.json911 B1f525f7c9716cfbff368e49778684f2cda2bb7e5e55917689e553870f41373ea
imatrix_unsloth.dat5.32 MB1430f7d2812ed9baded542047ec27930c18d1e6b7fad1b1fd9db1d33fcf0f1ca
params265 Bd26eca38227598d6dd83fe006a1df2508b377bf8a50aba91da64edab5ef2d95d
template556 Bc5ad996bda6eed4df6e3b605a9869647624851ac248209d22fd5e2c0cc1121d3
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
eb48357c17 pinned now manifest updated, same commit2026-11-14 21:32 UTC32 files · 138 GB
eb48357c172026-11-14 21:32 UTC32 files · 138 GB

Use it

$ fw get unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
# manifest sha256 9689d3652754… · 138 GB · 32 files
$ fw verify ./DeepSeek-R1-0528-Qwen3-8B-GGUF unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF.json --dir ./DeepSeek-R1-0528-Qwen3-8B-GGUF $ python3 fw.py verify ./DeepSeek-R1-0528-Qwen3-8B-GGUF ./unsloth__DeepSeek-R1-0528-Qwen3-8B-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF --revision eb48357c179d34dbf515983f798dfb8752a0f261 --local-dir ./DeepSeek-R1-0528-Qwen3-8B-GGUF
llama.cppDownload one GGUF variant (DeepSeek-R1-0528-Qwen3-8B-UD-IQ1_S, 2.27 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF --include "DeepSeek-R1-0528-Qwen3-8B-UD-IQ1_S*" --local-dir ./DeepSeek-R1-0528-Qwen3-8B-GGUF $ llama-server -m ./DeepSeek-R1-0528-Qwen3-8B-GGUF/DeepSeek-R1-0528-Qwen3-8B-UD-IQ1_S.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./DeepSeek-R1-0528-Qwen3-8B-GGUF/DeepSeek-R1-0528-Qwen3-8B-UD-IQ1_S.gguf\n' > Modelfile $ ollama create deepseek-r1-0528-qwen3-8b-gguf -f Modelfile

License

Name
MIT License
Id
MIT
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-14
Text in
README.md
Text sha256
a1963fb2f2fd3187ab4a008b5f9fc616bea2761fe5030d70ee1d0f563e1f7859
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.deepseekSubject: DeepSeek-R1-0528-Qwen3-8B-GGUFDate: 2026-11-14Commit: eb48357Signed: 2DC28CC7B26A283B ✓
Upstream
unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
Pinned commit
eb48357c179d34dbf515983f798dfb8752a0f261
Manifest
DeepSeek-R1-0528-Qwen3-8B-GGUF.json · .minisig
Manifest sha256
9689d365275405bbd421f3727ff43c8db4a59950b269760b016b43feefde9eb8
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 21:32 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF.json.minisig $ minisign -Vm DeepSeek-R1-0528-Qwen3-8B-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

deepseek-ai/DeepSeek-R1-0528-Qwen3-8B · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. DeepSeek-R1-0528-Qwen3-8B-GGUF.json. Provenance. Takedown history: none.
From: timm <huggingface.co/timm>Subject: deepseek_vit_412m.deepseek_v4_1_flash
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-V3-0324-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-V3.1-GGUF
From: mlx-community <huggingface.co/mlx-community>Subject: deepseek-ai-DeepSeek-V4-Flash-8bit