alt.freeweights.deepseek / DeepSeek-V3-0324-GGUF-UD
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.deepseekSubject:

DeepSeek-V3-0324-GGUF-UD

Date: 2026-11-15Commit: 407bf47Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 7.07 TB in all. Published by unsloth under MIT.

deepseek7.07TBDeepSeek-V3-0324-GGUF-UDggufpermissive
FactsParamsnot statedSize7.07 TBFormatsggufTasktext generationLicenseMITFrom sourcepermissive
$ fw get unsloth/DeepSeek-V3-0324-GGUF-UD
# manifest sha256 9063ea6456f2… · 7.07 TB · 159 files
$ fw verify ./DeepSeek-V3-0324-GGUF-UD unsloth/DeepSeek-V3-0324-GGUF-UD
From sourceHosted (signed)unsloth/DeepSeek-V3-0324-GGUF-UDLast check: 2026-11-15 04:58 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of DeepSeek-V3-0324.

Works with

Convert with

Overview

Size
7.07 TB
Weights
185 GB (smallest of 18 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
MIT (permissive)
Files
159, each with a sha256
Publisher
unsloth
Added
2026-11-15
Section
alt.freeweights.deepseek
Lineage

Original release from the publisher.

Base model: deepseek-ai/DeepSeek-V3-0324

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:58 UTCpassed

Model card

From the publisher at commit 407bf47. Shown as plain text with links; images open at the publisher.

Read our guide for detailed instructions on running DeepSeek-V3-0324 locally.

Unsloth Dynamic v2.0 achieves superior accuracy & outperforms other leading quant methods.

Unsloth's Dynamic Quants is selectively quantized, greatly improving accuracy over standard bits.

https://github.com/unslothai/unsloth/ https://discord.gg/unsloth https://docs.unsloth.ai/basics/tutorial-how-to-run-deepseek-v3-0324-locally

DeepSeek-V3-0324 Dynamic GGUF#

Our DeepSeek-V3-0324 GGUFs allow you to run the model in llama.cpp, LMStudio, Open WebUI and other inference frameworks.

Includes 1-4-bit Dynamic v2.0 versions:

MoE BitsTypeDisk SizeLinkDetails
1.78bit (prelim)IQ1_S192GBLinkdown_proj in MoE mixture of 2.06/1.78bit
1.93bit (prelim)IQ1_M200GBLinkdown_proj in MoE mixture of 2.06/1.93bit
2.42bitIQ2_XXS215GBLinkdown_proj in MoE all 2.42bit
2.71bitQ2_K_XL250GBLinkdown_proj in MoE mixture of 3.5/2.71bit
3.5bitQ3_K_XL296GBLinkdown_proj in MoE mixture of 4.5/3.5bit
4.5bitQ4_K_XL384GBLinkdown_proj in MoE mixture of 5.5/4.5bit

Prelim = preliminary - through our testing, they're generally fine but sometimes don't produce the best code and so more work/testing needs to be done. 2.71bit was found to be the best in terms of performance/size and produces code that is great and works well. 2.42bit was also found to pass all our tests.

So, for best results, use the 2.42-bit (IQ2_XXS) or 2.71-bit (Q2_K_XL) versions. Though not a must, try to have at least 180GB+ combined VRAM + RAM.

Thank you to the DeepSeek team for releasing their March update to the DeepSeek V3 models. Also thank you to bartowski for providing imatric V3 quants.

Finetune your own Reasoning model like R1 with Unsloth!#

We have a free Google Colab notebook for turning Llama 3.1 (8B) into a reasoning model: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-GRPO.ipynb

✨ Finetune for Free#

All notebooks are beginner friendly! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.

Unsloth supportsFree NotebooksPerformanceMemory use
GRPO with Phi-4 (14B)▶️ Start on Colab-GRPO.ipynb)2x faster80% less
Llama-3.2 (3B)▶️ Start on Colab-Conversational.ipynb)2.4x faster58% less
Llama-3.2 (11B vision)▶️ Start on Colab-Vision.ipynb)2x faster60% less
Qwen2 VL (7B)▶️ Start on Colab-Vision.ipynb)1.8x faster60% less
Qwen2.5 (7B)▶️ Start on Colab-Alpaca.ipynb)2x faster60% less
Llama-3.1 (8B)▶️ Start on Colab-Alpaca.ipynb)2.4x faster58% less
Phi-3.5 (mini)▶️ Start on Colab2x faster50% less
Gemma 2 (9B)▶️ Start on Colab-Alpaca.ipynb)2.4x faster58% less
Mistral (7B)▶️ Start on Colab-Conversational.ipynb)2.2x faster62% less

Image: DeepSeek-V3


Homepage Chat Hugging Face

Discord Wechat Twitter Follow

License

Features#

DeepSeek-V3-0324 demonstrates notable improvements over its predecessor, DeepSeek-V3, in several key aspects.

Image: Model Performance

Reasoning Capabilities#
  • Significant improvements in benchmark performance:
    • MMLU-Pro: 75.9 → 81.2 (+5.3)
    • GPQA: 59.1 → 68.4 (+9.3)
    • AIME: 39.6 → 59.4 (+19.8)
    • LiveCodeBench: 39.2 → 49.2 (+10.0)
Front-End Web Development#
  • Improved the executability of the code
  • More aesthetically pleasing web pages and game front-ends
Chinese Writing Proficiency#
  • Enhanced style and content quality:
    • Aligned with the R1 writing style
    • Better quality in medium-to-long-form writing
  • Feature Enhancements
    • Improved multi-turn interactive rewriting
    • Optimized translation quality and letter writing
Chinese Search Capabilities#
  • Enhanced report analysis requests with more detailed outputs
Function Calling Improvements#
  • Increased accuracy in Function Calling, fixing issues from previous V3 versions

Usage Recommendations#

System Prompt#

In the official DeepSeek web/app, we use the same system prompt with a specific date.

该助手为DeepSeek Chat,由深度求索公司创造。
今天是{current date}。

For example,

该助手为DeepSeek Chat,由深度求索公司创造。
今天是3月24日,星期一。
Temperature#

In our web and application environments, the temperature parameter $T_{model}$ is set to 0.3. Because many users use the default temperature 1.0 in API call, we have implemented an API temperature $T_{api}$ mapping mechanism that adjusts the input API temperature value of 1.0 to the most suitable model temperature setting of 0.3.

$$ T_{model} = T_{api} \times 0.3 \quad (0 \leq T_{api} \leq 1) $$

$$ T_{model} = T_{api} - 0.7 \quad (1 < T_{api} \leq 2) $$

Thus, if you call V3 via API, temperature 1.0 equals to the model temperature 0.3.

For file uploading, please follow the template to create prompts, where {file_name}, {file_content} and {question} are arguments.

file_template = \
"""[file name]: {file_name}
[file content begin]
{file_content}
[file content end]
{question}"""

For Web Search, {search_results}, {cur_date}, and {question} are arguments.

For Chinese query, we use the prompt:

search_answer_zh_template = \
'''# 以下内容是基于用户发送的消息的搜索结果:
{search_results}
在我给你的搜索结果中,每个结果都是[webpage X begin]...[webpage X end]格式的,X代表每篇文章的数字索引。请在适当的情况下在句子末尾引用上下文。请按照引用编号[citation:X]的格式在答案中对应部分引用上下文。如果一句话源自多个上下文,请列出所有相关的引用编号,例如[citation:3][citation:5],切记不要将引用集中在最后返回引用编号,而是在答案对应部分列出。
在回答时,请注意以下几点:
- 今天是{cur_date}。
- 并非搜索结果的所有内容都与用户的问题密切相关,你需要结合问题,对搜索结果进行甄别、筛选。
- 对于列举类的问题(如列举所有航班信息),尽量将答案控制在10个要点以内,并告诉用户可以查看搜索来源、获得完整信息。优先提供信息完整、最相关的列举项;如非必要,不要主动告诉用户搜索结果未提供的内容。
- 对于创作类的问题(如写论文),请务必在正文的段落中引用对应的参考编号,例如[citation:3][citation:5],不能只在文章末尾引用。你需要解读并概括用户的题目要求,选择合适的格式,充分利用搜索结果并抽取重要信息,生成符合用户要求、极具思想深度、富有创造力与专业性的答案。你的创作篇幅需要尽可能延长,对于每一个要点的论述要推测用户的意图,给出尽可能多角度的回答要点,且务必信息量大、论述详尽。
- 如果回答很长,请尽量结构化、分段落总结。如果需要分点作答,尽量控制在5个点以内,并合并相关的内容。
- 对于客观类的问答,如果问题的答案非常简短,可以适当补充一到两句相关信息,以丰富内容。
- 你需要根据用户要求和回答内容选择合适、美观的回答格式,确保可读性强。
- 你的回答应该综合多个相关网页来回答,不能重复引用一个网页。
- 除非用户要求,否则你回答的语言需要和用户提问的语言保持一致。

# 用户消息为:
{question}'''

For English query, we use the prompt:

search_answer_en_template = \
'''# The following contents are the search results related to the user's message:
{search_results}
In the search results I provide to you, each result is formatted as [webpage X begin]...[webpage X end], where X represents the numerical index of each article. Please cite the context at the end of the relevant sentence when appropriate. Use the citation format [citation:X] in the corresponding part of your answer. If a sentence is derived from multiple contexts, list all relevant citation numbers, such as [citation:3][citation:5]. Be sure not to cluster all citations at the end; instead, include them in the corresponding parts of the answer.
When responding, please keep the following points in mind:
- Today is {cur_date}.
- Not all content in the search results is closely related to the user's question. You need to evaluate and filter the search results based on the question.
- For listing-type questions (e.g., listing all flight information), try to limit the answer to 10 key points and inform the user that they can refer to the search sources for complete information. Prioritize providing the most complete and relevant items in the list. Avoid mentioning content not provided in the search results unless necessary.
- For creative tasks (e.g., writing an essay), ensure that references are cited within the body of the text, such as [citation:3][citation:5], rather than only at the end of the text. You need to interpret and summarize the user's requirements, choose an appropriate format, fully utilize the search results, extract key information, and generate an answer that is insightful, creative, and professional. Extend the length of your response as much as possible, addressing each point in detail and from multiple perspectives, ensuring the content is rich and thorough.
- If the response is lengthy, structure it well and summarize it in paragraphs. If a point-by-point format is needed, try to limit it to 5 points and merge related content.
- For objective Q&A, if the answer is very brief, you may add one or two related sentences to enrich the content.
- Choose an appropriate and visually appealing format for your response based on the user's requirements and the content of the answer, ensuring strong readability.
- Your answer should synthesize information from multiple relevant webpages and avoid repeatedly citing the same webpage.
- Unless the user requests otherwise, your response should be in the same language as the user's question.

# The user's message is:
{question}'''

How to Run Locally#

The model structure of DeepSeek-V3-0324 is exactly the same as DeepSeek-V3. Please visit DeepSeek-V3 repo for more information about running this model locally.

This model supports features such as function calling, JSON output, and FIM completion. For instructions on how to construct prompts to use these features, please refer to DeepSeek-V2.5 repo.

NOTE: Hugging Face's Transformers has not been directly supported yet.

License#

This repository and the model weights are licensed under the MIT License.

Citation#

@misc{deepseekai2024deepseekv3technicalreport,
      title={DeepSeek-V3 Technical Report}, 
      author={DeepSeek-AI},
      year={2024},
      eprint={2412.19437},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2412.19437}, 
}

Contact#

If you have any questions, please raise an issue or contact us at service@deepseek.com.

Files

159 files · 7.07 TBWeights 185 GB (smallest of 18 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 159 files with their sha256
FileSizesha256
.gitattributes15.9 KB870778ebf9dadca63f24999126e1a1d1dd75ef7442973c9dc136b38642a4181c
BF16/DeepSeek-V3-0324-BF16-00001-of-00030.gguf43.9 GB4d4ebea4d6308c15b37a8648de4a65bf304e1303d132622e3b65d56ac6a1eec5
BF16/DeepSeek-V3-0324-BF16-00002-of-00030.gguf46.0 GB697a9a1f329f975e129ce4d60fa502757dfd8c2987c4c5b8bdb43a70713e4cfb
BF16/DeepSeek-V3-0324-BF16-00003-of-00030.gguf46.0 GB5a49ed22b5d58419994a034f5e06fff60600ca11bb4d0c7455270220782e1fd0
BF16/DeepSeek-V3-0324-BF16-00004-of-00030.gguf46.0 GB63ef7ed3dc06b89b0143790318d39ea24a3c65814294f1ea9d3648eb44bdae56
BF16/DeepSeek-V3-0324-BF16-00005-of-00030.gguf46.0 GB88e32f72533c453fefb016e4b54819d6015ae987a5a2b55ad055a0071313910e
BF16/DeepSeek-V3-0324-BF16-00006-of-00030.gguf46.0 GBefd7a41faeab94279f9f5ebe46239f9a97b94b667d6cd30c19b6ec9fd822e642
BF16/DeepSeek-V3-0324-BF16-00007-of-00030.gguf46.0 GB3a9dce63d9d09b9483d159c7478ec89977011447996377ada7603ae03afe99a3
BF16/DeepSeek-V3-0324-BF16-00008-of-00030.gguf46.0 GBc3aa3f1f01ff273ba81d00e266a0e180f129d59a1c484c31b091a897e5793ba0
BF16/DeepSeek-V3-0324-BF16-00009-of-00030.gguf46.0 GB5344c081284debf0bc12bb9403cb3ffe30efba9d7605e1d135ee698e5f19d07a
BF16/DeepSeek-V3-0324-BF16-00010-of-00030.gguf46.0 GBd586632e3bc2d2055bad2773d58371bc72f7965d65607e9c23d639860ee1792d
BF16/DeepSeek-V3-0324-BF16-00011-of-00030.gguf46.0 GBd1ce7661052d3bfc50e0cdb864dc8adb3de6d1d0039fd66f1bc74b6810b5ecbd
BF16/DeepSeek-V3-0324-BF16-00012-of-00030.gguf46.0 GB16aaf5cf800c4a709d125b4bbc9c74614875afd1688e1aa497078fde3d3d619d
BF16/DeepSeek-V3-0324-BF16-00013-of-00030.gguf46.0 GB49bc24d06b97fdf44b022cc0b9955acb176a30c55ab54a2cfbd8b44cebaa39f1
BF16/DeepSeek-V3-0324-BF16-00014-of-00030.gguf46.0 GBb2b5caf621c755f9e2f4f3b0f3c11c41366833201bbe2c8d04a0f692a6ca3f2a
BF16/DeepSeek-V3-0324-BF16-00015-of-00030.gguf46.0 GB13a9879c6f4ca8ef9cfcbb21f55239ed9311ca4e5840ca784bad18c9021cc349
BF16/DeepSeek-V3-0324-BF16-00016-of-00030.gguf46.0 GBf2391a98be744947b2d23205eab14b4a050e6ddbf4be0038c6a3755d5288309f
BF16/DeepSeek-V3-0324-BF16-00017-of-00030.gguf46.0 GB67012220b02eb3532c0ec9f80cbea2a4dc55416638555aaf63f01bbf70f40d81
BF16/DeepSeek-V3-0324-BF16-00018-of-00030.gguf46.0 GBdfbea010475fbfe796a6a1f092f56257ccc3709e8ea304d7fe5c82417dd24956
BF16/DeepSeek-V3-0324-BF16-00019-of-00030.gguf46.0 GB6c358b95c9d31b1e9f7563433000de0bae37f9732328a35beecd31abb87e44a7
BF16/DeepSeek-V3-0324-BF16-00020-of-00030.gguf46.0 GBbb33489d57f8780cc39af65846c4c4ee5f7c7a6b7c333aa1485b3a54faef1ad5
BF16/DeepSeek-V3-0324-BF16-00021-of-00030.gguf46.0 GB604b64d9cf945356aa831b0cc1df54d3b4564523260b2895f24f2778fbadd640
BF16/DeepSeek-V3-0324-BF16-00022-of-00030.gguf46.0 GBa8512c97aa6697a54202ee016bf47d01124290e3c31969df720f4c17b812cc7f
BF16/DeepSeek-V3-0324-BF16-00023-of-00030.gguf46.0 GB1d121c25243a804fd2ce4982dc3e62d8e4579dd73256fb9e4164b384071f84d0
BF16/DeepSeek-V3-0324-BF16-00024-of-00030.gguf46.0 GBdd73868c76580fdcb20057abadf1ef5bc8d3f3b235a0b54208e3854faaaeef2f
BF16/DeepSeek-V3-0324-BF16-00025-of-00030.gguf46.0 GB15fb88edbdf3f72d3c2f1e6b9d7e5d51716c7b392297785ac4a77c731be58315
BF16/DeepSeek-V3-0324-BF16-00026-of-00030.gguf46.0 GB6447a2a48865c9184264d281a64ca402fec815a14901d0ac0ec2b58b071adde6
BF16/DeepSeek-V3-0324-BF16-00027-of-00030.gguf46.0 GB8924ac7413b16dc21cef277a0fe317a11f582f1c1c637f99bfe1eb5b1471391f
BF16/DeepSeek-V3-0324-BF16-00028-of-00030.gguf46.0 GBf17d73bd37b10ab5b2ad2a857641f45ac6bd6e6111dbfcb44099cee61d7cc46b
BF16/DeepSeek-V3-0324-BF16-00029-of-00030.gguf47.9 GB2166803709e367a3c463434ccc19d352e950de796accfcd85564a9660cb66dd5
BF16/DeepSeek-V3-0324-BF16-00030-of-00030.gguf7.52 GB2ca3f0fc46e62389fd6aa019680df674b6236294147c0f61fa4783a4b1b08e5b
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00001-of-00008.gguf49.9 GB3aaeb7464d0355ade45ec2950f4be815b09ec83663c334e8a9bcfd29f9747a3b
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00002-of-00008.gguf49.7 GB243cf9b94cfe4f192e0cd15859978b36011b56b591ff2b74b20e5b2ae1d20180
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00003-of-00008.gguf49.6 GB7251fc103bf82e9449b653122536d40f33413556a466ec1738095506c680314d
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00004-of-00008.gguf49.7 GB2977a84ccbb6b6014607721db510d995bf79c2278c52b3e2384acb5feb75cff8
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00005-of-00008.gguf49.7 GB02f373425ae3e29425f7ae4ee0dbbeadf16b0a4bfb3b25e32f6b3a68be959e0c
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00006-of-00008.gguf49.6 GB9d50a7551e38eff84227c9eb0bb23d311dd29e4bd6566adc05c1e58318302614
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00007-of-00008.gguf49.7 GBa3c836edadb0a155dc7ca80895bd80c35defac44f5efa423b18e8f9a38285dc3
IQ4_NL/DeepSeek-V3-0324-IQ4_NL-00008-of-00008.gguf30.2 GB854ab9facef92beca2bcbbba4dd15f2fd9589a3dacedc955e870f8a15da4eefa
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00001-of-00008.gguf49.2 GB1504b5b4c8cbc188bfd604b69debd1516ed488f9489fa7add1998164885504d3
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00002-of-00008.gguf49.0 GB6354f46ee9a29c04ecfa653de73ac2cd4f3ff61f8fd03e74ea6e2dd83d5c2dce
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00003-of-00008.gguf49.0 GB8b25eb8be9ffaf3a00b2aa13964adb35f2b14dd4c1b5b950d93323ffd6bf2dec
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00004-of-00008.gguf49.0 GB90634ee6ad8d9c9596f5e57739b964431581e683a7dcd09c4c826d9326e896e8
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00005-of-00008.gguf49.0 GB7e98d44a0f414c147cbf84c713a9e4d036171054031f78616c8227df29bfa250
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00006-of-00008.gguf49.0 GB2073ff201437aea15ec8bc567267a1feefa715755cd3adc973cf66566a54965a
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00007-of-00008.gguf49.0 GB87540da64d63dd5a7981c6b64ba5542ccc6a571a549ce7cc3183410d6fda4ba4
IQ4_XS/DeepSeek-V3-0324-IQ4_XS-00008-of-00008.gguf14.3 GB1380a9e4734aea5698f96364d69989fbf5b25dae33b6aa97a52da9f8dfb090a1
Q2_K/DeepSeek-V3-0324-Q2_K-00001-of-00005.gguf49.5 GB1b0efd0c19a31962c4537ac1eec5334d5ac56247b253865035dd825603bbbebc
Q2_K/DeepSeek-V3-0324-Q2_K-00002-of-00005.gguf48.6 GB148826fdad4d6b215fd44eddfaeb3d09ceec5235803afaf2cd3cc9e53734305a
Q2_K/DeepSeek-V3-0324-Q2_K-00003-of-00005.gguf48.9 GB120f321df326116e78432ed3f822f82c775cd8213c3de40a7b9e74c74ed54031
Q2_K/DeepSeek-V3-0324-Q2_K-00004-of-00005.gguf49.0 GB20312efa809f5cc700025428ddf1e52b64a5f54d3e91c5e67bbc5888afb7b0a2
Q2_K/DeepSeek-V3-0324-Q2_K-00005-of-00005.gguf48.5 GB979bfd59c7ea0798ca717216fea51872e2db8a99ce0b87dda3348dd87702a0a8
Q2_K_L/DeepSeek-V3-0324-Q2_K_L-00001-of-00005.gguf49.7 GBa0a124c8bfa0b5763991151853f48df8a7d03a8d67187a57ad98e1f06a8fde14
Q2_K_L/DeepSeek-V3-0324-Q2_K_L-00002-of-00005.gguf48.6 GB148826fdad4d6b215fd44eddfaeb3d09ceec5235803afaf2cd3cc9e53734305a
Q2_K_L/DeepSeek-V3-0324-Q2_K_L-00003-of-00005.gguf48.9 GB120f321df326116e78432ed3f822f82c775cd8213c3de40a7b9e74c74ed54031
Q2_K_L/DeepSeek-V3-0324-Q2_K_L-00004-of-00005.gguf49.0 GB20312efa809f5cc700025428ddf1e52b64a5f54d3e91c5e67bbc5888afb7b0a2
Q2_K_L/DeepSeek-V3-0324-Q2_K_L-00005-of-00005.gguf48.5 GB979bfd59c7ea0798ca717216fea51872e2db8a99ce0b87dda3348dd87702a0a8
Q3_K_M/DeepSeek-V3-0324-Q3_K_M-00001-of-00007.gguf49.7 GBf643ad8b47063528b1655b5160c8a1a15509356b6722d2af0f9fb43338171f17
Q3_K_M/DeepSeek-V3-0324-Q3_K_M-00002-of-00007.gguf49.3 GB8a53d5c3753f7cbb8ff201697cb34ee5e703495749aac930bb63e8ea4d3a44b1
Q3_K_M/DeepSeek-V3-0324-Q3_K_M-00003-of-00007.gguf49.3 GB2fe9b84dcca769c47880a48891a86e98256bce0c1fdb3c4ce132ff0d589ddfd5
Q3_K_M/DeepSeek-V3-0324-Q3_K_M-00004-of-00007.gguf49.3 GB53149aa0d68269624813fa1bad2296b7361948889cb6945337f4329099ad9b4d
Q3_K_M/DeepSeek-V3-0324-Q3_K_M-00005-of-00007.gguf49.3 GB92b7274317d9b4620686951638a1a9198f34c7540a103abbef86dc74468e6340
Q3_K_M/DeepSeek-V3-0324-Q3_K_M-00006-of-00007.gguf49.3 GBb9d64585122b458e9815a739c2639f19b4c7795bfc09800803de674cf19fd652
Q3_K_M/DeepSeek-V3-0324-Q3_K_M-00007-of-00007.gguf23.5 GB3d158a9f755f80ac0efe3d97f9f849adfd289b322f7d2a5442aec900631f9bf7
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00001-of-00009.gguf48.4 GBa98c5dae9ebf26d2660903c2d8735e4046bc936a8757573df1a4eb3ee095ef92
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00002-of-00009.gguf49.5 GB592d9d0240696167b3fb9604a9b625dfbde81cfc59e93070a1299567d42b6890
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00003-of-00009.gguf49.6 GB26a5424840be49148d97ee2b7cad8650c65ec690be704314c438f3d7c6dcef58
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00004-of-00009.gguf48.3 GBbcae0215baa6a77b4afe0b002be19562071e2320979218a824341bba3ea71cbe
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00005-of-00009.gguf49.5 GBf082961c762349e5f6a76852b96e8189dd91606fc82c3fc0b4e9a4ea4f45739a
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00006-of-00009.gguf48.3 GB85156006c4355ee3693dbb7e779f4d1e9f26b62c39489ec2629eee909d4f0ab8
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00007-of-00009.gguf49.5 GB8bf35c0c2ce532a2380204af42442e5c72c272c2f51e310f7916608cc1fc15b4
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00008-of-00009.gguf47.0 GB092e8122b4ec7f08be64a6c8e0cdfee6e685da30858faaeb92dfdf3bb12d64fc
Q4_K_M/DeepSeek-V3-0324-Q4_K_M-00009-of-00009.gguf14.8 GB79f0507f44979a2db6c4b9fa236320fb40174c0d26c0dbbe2319bdf286feaaa9
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00001-of-00010.gguf49.6 GB41f6aed1aaf51f42db6bf80e90474bcc4dde86f056d72de7cceda37fa7d30bc1
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00002-of-00010.gguf48.5 GBbf690c0520473f77e9c404879f85bb6e80bab38b4b2bf7800f6b72297b558078
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00003-of-00010.gguf48.5 GBae69d6358c0b9190ee2557bee8728329f499a510075a9342bda4d13d1ed207fa
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00004-of-00010.gguf48.5 GB60dbd5d9f4ed040b8b9a069bc295abdfda269d4917558172a4ddee082e9a4a31
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00005-of-00010.gguf48.5 GB54fa37074f1a438b406754ef016b29a4d1bdfb52c87be8cfd39cd4deebda1a65
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00006-of-00010.gguf48.5 GB8a84b52ecf45266e68511500a70fec46831476ac34bde0cd2d14008a6797d62c
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00007-of-00010.gguf48.5 GB983dab76eb954211a902691ed98b05a7ad71b83be99a645144434af2e7f2351b
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00008-of-00010.gguf48.5 GB9724e40358706b9e80094bfe8849c5cefdbd7726cd2d983ee08f0c3f93e25271
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00009-of-00010.gguf47.4 GBaffbf2fc8c4f524d712bd0a37f0e0a849d8af188ae75b2c26db736157c76b7b9
Q5_K_M/DeepSeek-V3-0324-Q5_K_M-00010-of-00010.gguf38.9 GB5bf690cda3898615c8eb519836c55b2ae09aeeab90046790178fd41d54a2700e
Q6_K/DeepSeek-V3-0324-Q6_K-00001-of-00012.gguf47.1 GBd722762a489118ce0e8f700761c767874da40456abe9a7473304f5c68fb679c1
Q6_K/DeepSeek-V3-0324-Q6_K-00002-of-00012.gguf47.2 GB8d0ac5f53708f60a6873e31e18f3f72c9c608a1506a87aff2e80396bcf6a1d6a
Q6_K/DeepSeek-V3-0324-Q6_K-00003-of-00012.gguf47.2 GB5e155a3adf4172610ff623818492a3cfb777ffad75b4e4dd1671bb7a143a7a4d
Q6_K/DeepSeek-V3-0324-Q6_K-00004-of-00012.gguf47.2 GBb093232b4b02341e72b03ef85e88367c18ba5c39c0aaffdcef6707e438f8636f
Q6_K/DeepSeek-V3-0324-Q6_K-00005-of-00012.gguf47.2 GBc7cf56899810a17afb8790358390ad163bc09190831722b28171b599beb6c639
Q6_K/DeepSeek-V3-0324-Q6_K-00006-of-00012.gguf47.2 GBd9373f1afb362e8b5fc952eb33d9523ef13b7e3eb312c212e81aee20f3771114
Q6_K/DeepSeek-V3-0324-Q6_K-00007-of-00012.gguf47.2 GB34d76051701af8ef5fe4e866a364bcfe3ef31c84a21351e6b78eabba182c14f4
Q6_K/DeepSeek-V3-0324-Q6_K-00008-of-00012.gguf47.2 GB25d1f1ec40964567465250936a7bedf4f6ce99fd4e9465fda57a95a67e223f64
Q6_K/DeepSeek-V3-0324-Q6_K-00009-of-00012.gguf47.2 GB63d70910213b361bc80b39365b5f448b6d190d879d1bf41f11d065e5cd123282
Q6_K/DeepSeek-V3-0324-Q6_K-00010-of-00012.gguf47.2 GB1b27bb66d9d835a6afba987e8457e6371b2546699dbbaaa5b387b9ede4e3e75a
Q6_K/DeepSeek-V3-0324-Q6_K-00011-of-00012.gguf47.2 GBdac3209bf37338f1b06ab541cf270b1647258404290f7544b23a542522422f29
Q6_K/DeepSeek-V3-0324-Q6_K-00012-of-00012.gguf31.4 GBba01a2631cdc13b19b02cc710b87d01a50d921cdbb7e7a6dbd85e45f81005958
Q8_0/DeepSeek-V3-0324-Q8_0-00001-of-00015.gguf47.8 GB1afbe0190decddea2f580f8740f762488de9497ecef3edfa151f324fc33a6e52
Q8_0/DeepSeek-V3-0324-Q8_0-00002-of-00015.gguf48.9 GB0b1bfbc9e9c89c28c6da73ece313f24b560ef213ffe1006a406cb1967869f993
Q8_0/DeepSeek-V3-0324-Q8_0-00003-of-00015.gguf48.9 GB17ce0ad4f4d42a983c33896c0ae4842c050e0a07aba77f6ab881310008ea39b3
Q8_0/DeepSeek-V3-0324-Q8_0-00004-of-00015.gguf48.9 GBc7d176c22b65c01617de3b2e20c1345ddc5a4ff022849164cae049936030f577
Q8_0/DeepSeek-V3-0324-Q8_0-00005-of-00015.gguf48.9 GB2c2a6ddd9a5032684eeaba770f9dd4c36273b761032dc0d6ae1d0789f78e2706
Q8_0/DeepSeek-V3-0324-Q8_0-00006-of-00015.gguf48.9 GB30fc82c9e00dc68706416dac550a3cd4a6d7f99bad4570f0d354c3ccf184f209
Q8_0/DeepSeek-V3-0324-Q8_0-00007-of-00015.gguf48.9 GB5ccc333a0ae3119211ca27c0b6e51cef0c7c9bbb883e2921af1b8c7cf3b93941
Q8_0/DeepSeek-V3-0324-Q8_0-00008-of-00015.gguf48.9 GB656df00622d261fd9b0ee475dc81bdbc946fc986067b00758b74596ecb271915
Q8_0/DeepSeek-V3-0324-Q8_0-00009-of-00015.gguf48.9 GBe941220573985c7e16136109002636d58df89eb702e2c19b050585bfcd3362a6
Q8_0/DeepSeek-V3-0324-Q8_0-00010-of-00015.gguf48.9 GB77bd70615c8d39057cb1b0c171376f6dfd3fb2ec46570cdcc5f0090b665a4483
Q8_0/DeepSeek-V3-0324-Q8_0-00011-of-00015.gguf48.9 GBe7eeba7372f474ccb283a74984491cf392121004cc971c33e9489779b6106e5a
Q8_0/DeepSeek-V3-0324-Q8_0-00012-of-00015.gguf48.9 GBb41d1d000f38d2a1e87298d6c07c26124c4961b02ff6dbaeeec940998a7a0156
Q8_0/DeepSeek-V3-0324-Q8_0-00013-of-00015.gguf48.9 GBd2bb51f12f13b9c8a3ccb15f8b91a3f68bf3312ea3e2ec0cab7800f05b23c734
Q8_0/DeepSeek-V3-0324-Q8_0-00014-of-00015.gguf48.9 GBda6b0a8501ffdbf53fb1042bd1d707ec717c417a99d89d649b3b1107d5e4928a
Q8_0/DeepSeek-V3-0324-Q8_0-00015-of-00015.gguf29.4 GB4a032a54d0e19a087397f597dbcf092ae8cbde4113e40672debff1d81336a40e
README.md17.5 KBd868412a15fb6d2fdeb75b93fcb9e6c717340f63e2d396ab9032f985cc0a3250
UD-IQ1_M/DeepSeek-V3-0324-UD-IQ1_M-00001-of-00005.gguf49.6 GB124b69ccaa59cc31db8eda745a7d8b7f5053ef83fae6216269c2080db5a4f607
UD-IQ1_M/DeepSeek-V3-0324-UD-IQ1_M-00002-of-00005.gguf49.6 GB02c99b6918d5b6c78bed4416d53f287e3c334f2fbcc8512250ff13450daf027d
UD-IQ1_M/DeepSeek-V3-0324-UD-IQ1_M-00003-of-00005.gguf48.7 GB537c106b50bc1f0089257fd711dd3440a4a7f719fd58accc63db340af795a8fa
UD-IQ1_M/DeepSeek-V3-0324-UD-IQ1_M-00004-of-00005.gguf48.8 GB24176d299a0964f1f74ba19fb64c9b576848d97e7ab0d5d19dd2a965d0d344f7
UD-IQ1_M/DeepSeek-V3-0324-UD-IQ1_M-00005-of-00005.gguf3.97 GB6ff96da2efa622074949ea20951f0841b49ceb3a3bf2ffc47c913ed4038ab321
UD-IQ1_S/DeepSeek-V3-0324-UD-IQ1_S-00001-of-00004.gguf49.7 GB97cf2e6be0387b527c48d16cd6adfb180581e15983827e3544a262ac1d0944d0
UD-IQ1_S/DeepSeek-V3-0324-UD-IQ1_S-00002-of-00004.gguf49.4 GB5b15d6c21e0006c287a2c7f27198913aed2d641135c229936ccd7be7baa571a0
UD-IQ1_S/DeepSeek-V3-0324-UD-IQ1_S-00003-of-00004.gguf49.7 GB5d8e30090b5293ac7ca67a1779bbc201fe5abbf2290a4ade4705055c2ddca272
UD-IQ1_S/DeepSeek-V3-0324-UD-IQ1_S-00004-of-00004.gguf36.4 GB71350eaf0daa75d202b1cad6a2a4a84ed3b6340d688a1fdfac328f1f3ac5e359
UD-IQ2_M/DeepSeek-V3-0324-UD-IQ2_M-00001-of-00005.gguf49.4 GBd4157cf3226aa3edd07de8f1962d6f2387fcb5d626cd898c53b0077954cf658d
UD-IQ2_M/DeepSeek-V3-0324-UD-IQ2_M-00002-of-00005.gguf49.3 GB9254752e175f48f89fe5b6e6be5d88d2a38c0797e133fd8a07bc28477434e083
UD-IQ2_M/DeepSeek-V3-0324-UD-IQ2_M-00003-of-00005.gguf49.2 GB0e1e736f773a82988d607ddc3c303b2718107e82918743b336587105bceab58e
UD-IQ2_M/DeepSeek-V3-0324-UD-IQ2_M-00004-of-00005.gguf49.6 GB2e03f65fb5eba037a56fa075831b6858baa6136658030567974b20b25e6d329c
UD-IQ2_M/DeepSeek-V3-0324-UD-IQ2_M-00005-of-00005.gguf30.2 GB324de3c96fbecd8bc95e21827b69728af3e59c392b3807bd0730b4f58f4505f5
UD-IQ2_XXS/DeepSeek-V3-0324-UD-IQ2_XXS-00001-of-00005.gguf48.7 GB7efe7d10e1a1f1704eac2b8024ac71c4b403eb13feff1788a7c240b762212f6c
UD-IQ2_XXS/DeepSeek-V3-0324-UD-IQ2_XXS-00002-of-00005.gguf49.8 GB25694a2a0229f47cb9319a259b213d8210e8a897047d13fcbd6f71cfa78df4b5
UD-IQ2_XXS/DeepSeek-V3-0324-UD-IQ2_XXS-00003-of-00005.gguf49.9 GBa804367507445e4c50645ed133360de476b01ea4d6a94063a0c0e0120e854e68
UD-IQ2_XXS/DeepSeek-V3-0324-UD-IQ2_XXS-00004-of-00005.gguf50.0 GB919398ddc20bd8e5d07b9966b9f7f140f663088e46b1252c946efaa5ccce7146
UD-IQ2_XXS/DeepSeek-V3-0324-UD-IQ2_XXS-00005-of-00005.gguf17.6 GB3ded1bf0e608ea3a434c1ccf8d6d7bf69306c505ac34e42f1ea8ac00e89546e9
UD-IQ3_XXS/DeepSeek-V3-0324-UD-IQ3_XXS-00001-of-00006.gguf49.2 GB41505a7c35e71a02e221d86b9e379dfc8fa5cb31de9c49ffed0443714b356541
UD-IQ3_XXS/DeepSeek-V3-0324-UD-IQ3_XXS-00002-of-00006.gguf48.4 GB143ecd2541351f35d0a141d9e6aa8d5d724a7f036a31c3c826db3a689dbb3c1a
UD-IQ3_XXS/DeepSeek-V3-0324-UD-IQ3_XXS-00003-of-00006.gguf49.9 GB949b8e960ffac3c69f936e4beef6aaed8100e957bf3bca060f66f5b5b816297d
UD-IQ3_XXS/DeepSeek-V3-0324-UD-IQ3_XXS-00004-of-00006.gguf49.2 GBc8349c10dd23145d6b18dd53d19d1c4e259d9c5634110a7b96f15479a7311a23
UD-IQ3_XXS/DeepSeek-V3-0324-UD-IQ3_XXS-00005-of-00006.gguf49.1 GB339619fcf03e7540f7df61ef6d2aee460f029a85ce590cd11b038b0cf249c968
UD-IQ3_XXS/DeepSeek-V3-0324-UD-IQ3_XXS-00006-of-00006.gguf27.4 GB28b7a2f646a97601d1cf609e4b6cff956fbc1841fa01d72c316da36f33625d8e
UD-Q2_K_XL/DeepSeek-V3-0324-UD-Q2_K_XL-00001-of-00006.gguf48.9 GB4025dea6e9bef202854f5c754f640e80fb48e5eb562afe22d3b8442438babb38
UD-Q2_K_XL/DeepSeek-V3-0324-UD-Q2_K_XL-00002-of-00006.gguf49.5 GB9d69e082b873f146417d96b8e8039089b3f3f9d922be094148bfc5b352dbaa7e
UD-Q2_K_XL/DeepSeek-V3-0324-UD-Q2_K_XL-00003-of-00006.gguf49.1 GB68d7d131560361933905e9e254ecdf20d535024261e7aeb6e8ef01d76044980e
UD-Q2_K_XL/DeepSeek-V3-0324-UD-Q2_K_XL-00004-of-00006.gguf49.4 GBf1bb2d5492e0b168ef68b68ec7560b1ee9dde3f68526fbadee9985d444162c42
UD-Q2_K_XL/DeepSeek-V3-0324-UD-Q2_K_XL-00005-of-00006.gguf48.9 GB2230d59fc04643e5e1da99318ecb945e4b3d8bc635b302153a292e66a7bfcd8b
UD-Q2_K_XL/DeepSeek-V3-0324-UD-Q2_K_XL-00006-of-00006.gguf4.62 GB45dd14a557686b4f552fc2802dc24cdd99b9bea031a90b1bb5372f66b093084d
UD-Q3_K_XL/DeepSeek-V3-0324-UD-Q3_K_XL-00001-of-00007.gguf48.2 GB305db356eef405cb7a5fdd9d37e9aaac99dd08c720cf5bfc8afed79151f37953
UD-Q3_K_XL/DeepSeek-V3-0324-UD-Q3_K_XL-00002-of-00007.gguf48.7 GB673e8ca50d15880de1379856e2c48fc2430257068cb09dfe95e7b2dfd518ce74
UD-Q3_K_XL/DeepSeek-V3-0324-UD-Q3_K_XL-00003-of-00007.gguf49.9 GB40a1788d55699b45aedd9727cf8caeb7bac8d52af6d7566f2befa9ddf59545f5
UD-Q3_K_XL/DeepSeek-V3-0324-UD-Q3_K_XL-00004-of-00007.gguf48.8 GB115d6a662617c76424674fd47e23f260d2770a37a05a532d8a6372d5b2371a61
UD-Q3_K_XL/DeepSeek-V3-0324-UD-Q3_K_XL-00005-of-00007.gguf48.8 GB116ac610edd3ff2598c84691554b7d40d87d466f9124e93e0b80c88d1f290196
UD-Q3_K_XL/DeepSeek-V3-0324-UD-Q3_K_XL-00006-of-00007.gguf48.6 GBe91b036b5fd587dc622ef267f5d4c63e1dc6c7187a85da2222576f907e7fb282
UD-Q3_K_XL/DeepSeek-V3-0324-UD-Q3_K_XL-00007-of-00007.gguf3.25 GB47972de9487b5889c3e8f885f16a9218d1b7a25126b1d09fb8abf0521e329e02
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00001-of-00008.gguf48.8 GB433e6c0da815595137e6de4ecc755ee7a782e5edd503295ba0a3e711a56d6190
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00002-of-00008.gguf48.5 GB95b3a7cfe00102e9b68fd9d4ae64e065758ae1c23b8a5317943d7272231f6e83
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00003-of-00008.gguf48.0 GBe77c3f6f6ec96579e14ec881ba4e5eaa8d74caeae03fe3a5468e504250563cf6
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00004-of-00008.gguf49.8 GB4af4efcb6e3302e0c873b34036e0509afdd4e0f15c88dbea28f9b4029f829c3f
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00005-of-00008.gguf48.1 GB5f8fd90682d756d575f02a23fe049804a43bfe0c802242bfc2a7d313e5eefd9b
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00006-of-00008.gguf48.6 GBed304127a934ceb4d2ac2872e7cb15a9e279c84694a0536bc384584a54809d78
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00007-of-00008.gguf49.7 GB72ff53159ec475629098154bdabf924ba639b2036f94a7413ad4ff466ac0feab
UD-Q4_K_XL/DeepSeek-V3-0324-UD-Q4_K_XL-00008-of-00008.gguf42.5 GBf0d65ce05e2f0ec8215d16861c1a9ece2d863549a54497c60d171be4065d4930
config.json1.73 KB4422016f41c506339e0510a32812a63da554dc9febd5f1368e7240ded14e4a27
imatrix_unsloth.dat987 MB44f83207eb8d309d77bd0f6e5cbe29aa297484c21f4d8742238d51fff1933391
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
407bf47c2d pinned now2026-11-15 04:58 UTC159 files · 7.07 TB

Use it

$ fw get unsloth/DeepSeek-V3-0324-GGUF-UD
# manifest sha256 9063ea6456f2… · 7.07 TB · 159 files
$ fw verify ./DeepSeek-V3-0324-GGUF-UD unsloth/DeepSeek-V3-0324-GGUF-UD
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/DeepSeek-V3-0324-GGUF-UD.json --dir ./DeepSeek-V3-0324-GGUF-UD $ python3 fw.py verify ./DeepSeek-V3-0324-GGUF-UD ./unsloth__DeepSeek-V3-0324-GGUF-UD.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/DeepSeek-V3-0324-GGUF-UD --revision 407bf47c2d68d92fa45dbde09e0e4d514214872b --local-dir ./DeepSeek-V3-0324-GGUF-UD
llama.cppDownload one GGUF variant (UD-IQ1_S, 185 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/DeepSeek-V3-0324-GGUF-UD --include "UD-IQ1_S/*" --local-dir ./DeepSeek-V3-0324-GGUF-UD $ llama-server -m ./DeepSeek-V3-0324-GGUF-UD/UD-IQ1_S/DeepSeek-V3-0324-UD-IQ1_S-00001-of-00004.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./DeepSeek-V3-0324-GGUF-UD/UD-IQ1_S/DeepSeek-V3-0324-UD-IQ1_S-00001-of-00004.gguf\n' > Modelfile $ ollama create deepseek-v3-0324-gguf-ud -f Modelfile

License

Name
MIT License
Id
MIT
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
d868412a15fb6d2fdeb75b93fcb9e6c717340f63e2d396ab9032f985cc0a3250
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.deepseekSubject: DeepSeek-V3-0324-GGUF-UDDate: 2026-11-15Commit: 407bf47Signed: 2DC28CC7B26A283B ✓
Upstream
unsloth/DeepSeek-V3-0324-GGUF-UD
Pinned commit
407bf47c2d68d92fa45dbde09e0e4d514214872b
Manifest
DeepSeek-V3-0324-GGUF-UD.json · .minisig
Manifest sha256
9063ea6456f2c1fb690e2abab29a2f95774cda39937a0ff789cdb20d75397fc5
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:58 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/DeepSeek-V3-0324-GGUF-UD.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/DeepSeek-V3-0324-GGUF-UD.json.minisig $ minisign -Vm DeepSeek-V3-0324-GGUF-UD.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

deepseek-ai/DeepSeek-V3-0324 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/DeepSeek-V3-0324-GGUF-UD
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. DeepSeek-V3-0324-GGUF-UD.json. Provenance. Takedown history: none.
From: timm <huggingface.co/timm>Subject: deepseek_vit_412m.deepseek_v4_1_flash
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-V3-0324-GGUF
From: bartowski <huggingface.co/bartowski>Subject: deepseek-ai_DeepSeek-V3.1-GGUF
From: mlx-community <huggingface.co/mlx-community>Subject: deepseek-ai-DeepSeek-V4-Flash-8bit