alt.freeweights.glm / zai-org_GLM-4.7-GGUF
From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.glmSubject:

zai-org_GLM-4.7-GGUF

Date: 2026-11-15Commit: c47ba45Signed: 2DC28CC7B26A283B ✓

Text generation model. Gguf weights, 4.60 TB in all. Published by bartowski under MIT.

glm4.60TBzai-org_GLM-4.7-GGUFggufpermissive
FactsParamsnot statedSize4.60 TBFormatsggufTasktext generationLicenseMITFrom sourcepermissive
$ fw get bartowski/zai-org_GLM-4.7-GGUF
# manifest sha256 68a122801d3a… · 4.60 TB · 133 files
$ fw verify ./zai-org_GLM-4.7-GGUF bartowski/zai-org_GLM-4.7-GGUF
From sourceHosted (signed)bartowski/zai-org_GLM-4.7-GGUFLast check: 2026-11-15 05:04 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of GLM-4.7.

Works with

Convert with

Overview

Size
4.60 TB
Weights
688 MB (smallest of 27 GGUF variants)
Parameters
not stated
Formats
gguf
Task
text generation
License
MIT (permissive)
Files
133, each with a sha256
Publisher
bartowski
Added
2026-11-15
Section
alt.freeweights.glm
Lineage

Original release from the publisher.

Base model: zai-org/GLM-4.7

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:04 UTCpassed

Model card

From the publisher at commit c47ba45. Shown as plain text with links; images open at the publisher.

Llamacpp imatrix Quantizations of GLM-4.7 by zai-org#

Using llama.cpp release b7475 for quantization.

Original model: https://huggingface.co/zai-org/GLM-4.7

All quants made using imatrix option with dataset from here combined with a subset of combined_all_small.parquet from Ed Addario here

Run them in LM Studio

Run them directly with llama.cpp, or any other llama.cpp based project

Prompt format#

[gMASK]<sop><|system|>{system_prompt}<|user|>{prompt}<|assistant|><think>

Download a file (not the whole branch) from below:#

FilenameQuant typeFile SizeSplitDescription
GLM-4.7-Q8_0.ggufQ8_0380.97GBtrueExtremely high quality, generally unneeded but max available quant.
GLM-4.7-Q6_K.ggufQ6_K294.83GBtrueVery high quality, near perfect, recommended.
GLM-4.7-Q5_K_M.ggufQ5_K_M255.28GBtrueHigh quality, recommended.
GLM-4.7-Q5_K_S.ggufQ5_K_S247.44GBtrueHigh quality, recommended.
GLM-4.7-Q4_1.ggufQ4_1225.19GBtrueLegacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon.
GLM-4.7-Q4_K_L.ggufQ4_K_L219.10GBtrueUses Q8_0 for embed and output weights. Good quality, recommended.
GLM-4.7-Q4_K_M.ggufQ4_K_M218.52GBtrueGood quality, default size for most use cases, recommended.
GLM-4.7-Q4_K_S.ggufQ4_K_S210.78GBtrueSlightly lower quality with more space savings, recommended.
GLM-4.7-Q4_0.ggufQ4_0206.49GBtrueLegacy format, offers online repacking for ARM and AVX CPU inference.
GLM-4.7-IQ4_NL.ggufIQ4_NL203.60GBtrueSimilar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference.
GLM-4.7-IQ4_XS.ggufIQ4_XS192.68GBtrueDecent quality, smaller than Q4_K_S with similar performance, recommended.
GLM-4.7-Q3_K_XL.ggufQ3_K_XL171.26GBtrueUses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability.
GLM-4.7-Q3_K_L.ggufQ3_K_L170.58GBtrueLower quality but usable, good for low RAM availability.
GLM-4.7-Q3_K_M.ggufQ3_K_M164.95GBtrueLow quality.
GLM-4.7-IQ3_M.ggufIQ3_M164.76GBtrueMedium-low quality, new method with decent performance comparable to Q3_K_M.
GLM-4.7-Q3_K_S.ggufQ3_K_S157.32GBtrueLow quality, not recommended.
GLM-4.7-IQ3_XS.ggufIQ3_XS148.69GBtrueLower quality, new method with decent performance, slightly better than Q3_K_S.
GLM-4.7-IQ3_XXS.ggufIQ3_XXS142.73GBtrueLower quality, new method with decent performance, comparable to Q3 quants.
GLM-4.7-Q2_K_L.ggufQ2_K_L128.38GBtrueUses Q8_0 for embed and output weights. Very low quality but surprisingly usable.
GLM-4.7-Q2_K.ggufQ2_K127.62GBtrueVery low quality but surprisingly usable.
GLM-4.7-IQ2_M.ggufIQ2_M115.50GBtrueRelatively low quality, uses SOTA techniques to be surprisingly usable.
GLM-4.7-IQ2_S.ggufIQ2_S102.31GBtrueLow quality, uses SOTA techniques to be usable.
GLM-4.7-IQ2_XS.ggufIQ2_XS101.50GBtrueLow quality, uses SOTA techniques to be usable.
GLM-4.7-IQ2_XXS.ggufIQ2_XXS88.79GBtrueVery low quality, uses SOTA techniques to be usable.
GLM-4.7-IQ1_M.ggufIQ1_M80.02GBtrueExtremely low quality, not recommended.
GLM-4.7-IQ1_S.ggufIQ1_S76.77GBtrueExtremely low quality, not recommended.

Embed/output weights#

Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.

Downloading using huggingface-cli#

Click to view download instructions

First, make sure you have hugginface-cli installed:

pip install -U "huggingface_hub[cli]"

Then, you can target the specific file you want:

huggingface-cli download bartowski/zai-org_GLM-4.7-GGUF --include "zai-org_GLM-4.7-Q4_K_M.gguf" --local-dir ./

If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:

huggingface-cli download bartowski/zai-org_GLM-4.7-GGUF --include "zai-org_GLM-4.7-Q8_0/*" --local-dir ./

You can either specify a new local-dir (zai-org_GLM-4.7-Q8_0) or download them all in place (./)

ARM/AVX information#

Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.

Now, however, there is something called "online repacking" for weights. details in this PR. If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.

As of llama.cpp build b4282 you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.

Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to this PR which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.

Click to view Q4_0_X_X information (deprecated

I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.

Click to view benchmarks on an AVX2 system (EPYC7702)

modelsizeparamsbackendthreadstestt/s% (vs Q4_0)
qwen2 3B Q4_01.70 GiB3.09 BCPU64pp512204.03 ± 1.03100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64pp1024282.92 ± 0.19100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64pp2048259.49 ± 0.44100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64tg12839.12 ± 0.27100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64tg25639.31 ± 0.69100%
qwen2 3B Q4_01.70 GiB3.09 BCPU64tg51240.52 ± 0.03100%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64pp512301.02 ± 1.74147%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64pp1024287.23 ± 0.20101%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64pp2048262.77 ± 1.81101%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64tg12818.80 ± 0.9948%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64tg25624.46 ± 3.0483%
qwen2 3B Q4_K_M1.79 GiB3.09 BCPU64tg51236.32 ± 3.5990%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64pp512271.71 ± 3.53133%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64pp1024279.86 ± 45.63100%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64pp2048320.77 ± 5.00124%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64tg12843.51 ± 0.05111%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64tg25643.35 ± 0.09110%
qwen2 3B Q4_0_8_81.69 GiB3.09 BCPU64tg51242.60 ± 0.31105%

Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation

Which file should I choose?#

Click here for details

A great write up with charts showing various performances is provided by Artefact2 here

The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.

If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.

If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.

Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.

If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.

If you want to get more into the weeds, you can check out this extremely useful feature chart:

llama.cpp feature matrix

But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.

These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.

Credits#

Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.

Thank you ZeroWw for the inspiration to experiment with embed/output.

Thank you to LM Studio for sponsoring my work.

Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

Files

133 files · 4.60 TBWeights 688 MB (smallest of 27 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 133 files with their sha256
FileSizesha256
.gitattributes14.7 KBdc973aa33d79b2eb1998f52c83eb00071c8400c8ed718e2f48409e6178c6a8da
README.md13.3 KB59342a94eb94e55850305c48cc97d0842580278adbddeda328077ae9d20aeaba
zai-org_GLM-4.7-IQ1_M/zai-org_GLM-4.7-IQ1_M-00001-of-00003.gguf39.8 GB23bbb582719073bccde9a4a7cd2601b4675cd29bd50f89945a62aeb374fd1463
zai-org_GLM-4.7-IQ1_M/zai-org_GLM-4.7-IQ1_M-00002-of-00003.gguf40.0 GBfdbb9227f69e7c27a696190d843863ddbc768654297c499d1c52f47ddec78053
zai-org_GLM-4.7-IQ1_M/zai-org_GLM-4.7-IQ1_M-00003-of-00003.gguf255 MB2ddf54d579939c929a37bdafb9aad2fb2bee196c7bd09bfdd44259405a655ceb
zai-org_GLM-4.7-IQ1_S/zai-org_GLM-4.7-IQ1_S-00001-of-00002.gguf39.9 GB45e8f0a6f6ad6b477bb20e4c5d2de62bc02f630765eadd294111814ac48979c1
zai-org_GLM-4.7-IQ1_S/zai-org_GLM-4.7-IQ1_S-00002-of-00002.gguf36.8 GBb90321873acb93eabf15196cde39f2adf63c358ba0513c0e8132afe2612d1401
zai-org_GLM-4.7-IQ2_M/zai-org_GLM-4.7-IQ2_M-00001-of-00003.gguf40.0 GBaf5c10269864bbe01151bc0ae7252dda68ad0d6b7360227f9f9fd006d7d7e36a
zai-org_GLM-4.7-IQ2_M/zai-org_GLM-4.7-IQ2_M-00002-of-00003.gguf40.0 GB80f1b25f494977fb35cae6b44d2dd8c8fb6f88b8dcb56cd3b8493d2b040338cd
zai-org_GLM-4.7-IQ2_M/zai-org_GLM-4.7-IQ2_M-00003-of-00003.gguf35.6 GBa99fc795addcab8bb2273a36ad33536e34b41ba04cb60fc6c458c81b67c6ed1a
zai-org_GLM-4.7-IQ2_S/zai-org_GLM-4.7-IQ2_S-00001-of-00003.gguf40.0 GB952efef0ac076a89e4b06ab4888ed0b3162532714b846ac93ac29af2f975d945
zai-org_GLM-4.7-IQ2_S/zai-org_GLM-4.7-IQ2_S-00002-of-00003.gguf39.8 GBd2df12822695fea065a669ba057ee3578bb92301c9022be507a29abe13c0df28
zai-org_GLM-4.7-IQ2_S/zai-org_GLM-4.7-IQ2_S-00003-of-00003.gguf22.6 GB963add829af2f5b8cdfad6e6c5cae958fdec3e35163bd72bff6f2122bf4c981e
zai-org_GLM-4.7-IQ2_XS/zai-org_GLM-4.7-IQ2_XS-00001-of-00003.gguf40.0 GB85e01f52a69eb6d857bcb298d55173c0f59d4cfa38a7409e499d26ec053dfcbf
zai-org_GLM-4.7-IQ2_XS/zai-org_GLM-4.7-IQ2_XS-00002-of-00003.gguf39.8 GB6ce484e88cde276f2d8f0bad727557cbd141e635af20cc76d5a0242933b477c9
zai-org_GLM-4.7-IQ2_XS/zai-org_GLM-4.7-IQ2_XS-00003-of-00003.gguf21.7 GB14eb502fa8c5955ecf7fee8a58911ae423258d675bcd078bfbda229418a18303
zai-org_GLM-4.7-IQ2_XXS/zai-org_GLM-4.7-IQ2_XXS-00001-of-00003.gguf40.0 GB066a3343a339987c7844e3d593788c44fdbbea9f3e79c72e570160e376107845
zai-org_GLM-4.7-IQ2_XXS/zai-org_GLM-4.7-IQ2_XXS-00002-of-00003.gguf40.0 GB72da01ba0bc21d235588590fa9fbd9988daafd04d6f9591bc83333364cc7cbdc
zai-org_GLM-4.7-IQ2_XXS/zai-org_GLM-4.7-IQ2_XXS-00003-of-00003.gguf8.86 GB4fe28dece70ab8af908caf0476568956b7744848abb6b826bfd7c17578668119
zai-org_GLM-4.7-IQ3_M/zai-org_GLM-4.7-IQ3_M-00001-of-00005.gguf39.5 GBe0384e3c95352a6e67b2116bfaa37c97fff26e04e5539c29da19cd2ab35a2659
zai-org_GLM-4.7-IQ3_M/zai-org_GLM-4.7-IQ3_M-00002-of-00005.gguf39.6 GB90e1e75e30d5cd2aae83de32fd488181b701f07b3150efd213bc8b26f4c65c0d
zai-org_GLM-4.7-IQ3_M/zai-org_GLM-4.7-IQ3_M-00003-of-00005.gguf39.8 GB12c5377c044d9f28ea30aaeff9222fcfdaa44a374bd4fbce8b7fc08e1995c190
zai-org_GLM-4.7-IQ3_M/zai-org_GLM-4.7-IQ3_M-00004-of-00005.gguf39.6 GBedf5b25ceca40b8b40de16577d1669558052ac2f1c14799e4151bb75ce421dc1
zai-org_GLM-4.7-IQ3_M/zai-org_GLM-4.7-IQ3_M-00005-of-00005.gguf6.30 GB43ec4ec2bf8d09b9a43080ea65b4203a7554d73cab81cd5f2d44c8ef039766a7
zai-org_GLM-4.7-IQ3_XS/zai-org_GLM-4.7-IQ3_XS-00001-of-00004.gguf39.9 GB189bc76890a9abd7fd95fef619e5173c9ae6ed4d8f70512e41077c4c3287941c
zai-org_GLM-4.7-IQ3_XS/zai-org_GLM-4.7-IQ3_XS-00002-of-00004.gguf40.0 GB674bdfce28718b12ce2e92cce1b9e590124bee32758565dd036f1be66b17f2b5
zai-org_GLM-4.7-IQ3_XS/zai-org_GLM-4.7-IQ3_XS-00003-of-00004.gguf40.0 GB4ca2fe4d1de5b221203642ee2e4da893938ba8a6405a07b949403d4107eabebd
zai-org_GLM-4.7-IQ3_XS/zai-org_GLM-4.7-IQ3_XS-00004-of-00004.gguf28.8 GBa60aca59689b14a943274e1ddb77583d569d32e6a73715523346bc81b32b246c
zai-org_GLM-4.7-IQ3_XXS/zai-org_GLM-4.7-IQ3_XXS-00001-of-00004.gguf39.7 GBa0a47232ab40fa572f4e915807984abf70e100d5f0552950c429f1eecd8d1c24
zai-org_GLM-4.7-IQ3_XXS/zai-org_GLM-4.7-IQ3_XXS-00002-of-00004.gguf40.0 GB804fa3518160328453417d0d24956fd8f5ad096a748e930f9378bbc6ab3e409e
zai-org_GLM-4.7-IQ3_XXS/zai-org_GLM-4.7-IQ3_XXS-00003-of-00004.gguf39.9 GB6343ee9d42d0e289fefde735551e9a81ed9a8192315f505ce457ceb83dde9ed8
zai-org_GLM-4.7-IQ3_XXS/zai-org_GLM-4.7-IQ3_XXS-00004-of-00004.gguf23.1 GB28f49fdb594a2caa0dee0d170db8219e190686937c023477875325f14841da7e
zai-org_GLM-4.7-IQ4_NL/zai-org_GLM-4.7-IQ4_NL-00001-of-00006.gguf39.8 GB7cc65a2164f7fcc16e60b73917d6b401f100cf44ccf6f9aab1c5dc9a5cb19455
zai-org_GLM-4.7-IQ4_NL/zai-org_GLM-4.7-IQ4_NL-00002-of-00006.gguf39.4 GB32ffbb4fbb363e713d438a7997e6d9ac80c4129e2ad6e168037b18ba5770f7d1
zai-org_GLM-4.7-IQ4_NL/zai-org_GLM-4.7-IQ4_NL-00003-of-00006.gguf39.5 GBfde3553217ed99bcb4833e01e59025c16d3db3b34e22f3210eaf670a9ba92b24
zai-org_GLM-4.7-IQ4_NL/zai-org_GLM-4.7-IQ4_NL-00004-of-00006.gguf39.5 GBa8af47d5a5951f2cccf85fa4038f60f1f3c243acaf0f744925d5b5dc7cb72202
zai-org_GLM-4.7-IQ4_NL/zai-org_GLM-4.7-IQ4_NL-00005-of-00006.gguf39.5 GBd20baf4568048fd4eda2ec03a4c1cf1f0fae9a4fb00cd7be050afc424919f5d9
zai-org_GLM-4.7-IQ4_NL/zai-org_GLM-4.7-IQ4_NL-00006-of-00006.gguf6.10 GBf386439327030d5b7e1454a5873f3b2bef28ba4bd69307e153e7f7f6105466d8
zai-org_GLM-4.7-IQ4_XS/zai-org_GLM-4.7-IQ4_XS-00001-of-00005.gguf39.8 GB038d1b774f485fd142bb68033859b91d1e42c13e896565e8fe5dda98d814ae38
zai-org_GLM-4.7-IQ4_XS/zai-org_GLM-4.7-IQ4_XS-00002-of-00005.gguf39.4 GB240e71cdce97dcb4a8a93ac446673cbbaa378c45b8ba521e8a4e6efe9ae4de3a
zai-org_GLM-4.7-IQ4_XS/zai-org_GLM-4.7-IQ4_XS-00003-of-00005.gguf39.4 GBf0c2bf13d0b415b8e584b14b9fd861d727e2fa90f06c96a2a8d90416840948f4
zai-org_GLM-4.7-IQ4_XS/zai-org_GLM-4.7-IQ4_XS-00004-of-00005.gguf39.4 GB162cc0267804d05f1839db9bbb63b52bc25a0467295ec960828d14e548891911
zai-org_GLM-4.7-IQ4_XS/zai-org_GLM-4.7-IQ4_XS-00005-of-00005.gguf34.6 GB8551fe9d7a56ed7554a418507cc5530be893b521c47f9f6806334e34bcbd6efa
zai-org_GLM-4.7-Q2_K/zai-org_GLM-4.7-Q2_K-00001-of-00004.gguf39.9 GB06c61a5479bb3bd986739d85973d291ef7163eefb0640eee68918b37f427bdae
zai-org_GLM-4.7-Q2_K/zai-org_GLM-4.7-Q2_K-00002-of-00004.gguf39.9 GB1255d486ccb352f957f1fc77ba9a64a03a681a047b823265a721fb38011d30be
zai-org_GLM-4.7-Q2_K/zai-org_GLM-4.7-Q2_K-00003-of-00004.gguf40.0 GB736e84d7a7c05122a4a852c15d38d74d0a6495cabcd0a93228488647528e3ec7
zai-org_GLM-4.7-Q2_K/zai-org_GLM-4.7-Q2_K-00004-of-00004.gguf7.86 GB5bf65a2114c18187f6a9ab4e73c623b8f534590395ea2e92a75b8d5c58e9a124
zai-org_GLM-4.7-Q2_K_L/zai-org_GLM-4.7-Q2_K_L-00001-of-00004.gguf39.7 GB661ddbb227338be9d210e4c17a1cd77003473234038cf01328431d67eaf50940
zai-org_GLM-4.7-Q2_K_L/zai-org_GLM-4.7-Q2_K_L-00002-of-00004.gguf39.9 GBe5e879602d6200b6ac8708f1e56802e6af8f022cac29921ef651586f411b7e75
zai-org_GLM-4.7-Q2_K_L/zai-org_GLM-4.7-Q2_K_L-00003-of-00004.gguf39.5 GB74b197150a0838b916b8bac70db41130f19766d8a9376cbd45bbcf430531cb83
zai-org_GLM-4.7-Q2_K_L/zai-org_GLM-4.7-Q2_K_L-00004-of-00004.gguf9.26 GBbf4b2386f84d548c9d3e0cf25c4a8ccba09726b43182d9961c94df547c3c3c11
zai-org_GLM-4.7-Q3_K_L/zai-org_GLM-4.7-Q3_K_L-00001-of-00005.gguf39.7 GB7360afd902a21204af4daab3c3bdf40b9a50abfb64f2747b0b236cba21bad072
zai-org_GLM-4.7-Q3_K_L/zai-org_GLM-4.7-Q3_K_L-00002-of-00005.gguf39.8 GB0223d25d250bfa285ac66bd3fedfcfd11f596be9751fc718113b1126b10f1b18
zai-org_GLM-4.7-Q3_K_L/zai-org_GLM-4.7-Q3_K_L-00003-of-00005.gguf39.8 GBa06f204e2eb4a122814d0f04e91b2fe543da310920affb9e45d18f06b2c75227
zai-org_GLM-4.7-Q3_K_L/zai-org_GLM-4.7-Q3_K_L-00004-of-00005.gguf39.8 GBc770ec47c90e0f2c23db3cc4bddef49178a041f0e846871121c8a791cfe15fb5
zai-org_GLM-4.7-Q3_K_L/zai-org_GLM-4.7-Q3_K_L-00005-of-00005.gguf11.4 GB12d35369c6fce2d63821adfd157c5cda5ff98dc0b045ea616670176177ccb650
zai-org_GLM-4.7-Q3_K_M/zai-org_GLM-4.7-Q3_K_M-00001-of-00005.gguf39.6 GBe5bd3316f0318a90a46a7a45b3a5f2b7a5d981f372cd960ea18d354f0cb62beb
zai-org_GLM-4.7-Q3_K_M/zai-org_GLM-4.7-Q3_K_M-00002-of-00005.gguf39.7 GBc20b3d1ab9ba907a287737bc69a53566ca0f110795b53eeb89b98e4e6d482043
zai-org_GLM-4.7-Q3_K_M/zai-org_GLM-4.7-Q3_K_M-00003-of-00005.gguf39.8 GB44bda90a3adfc2c659ddcaa97c47aafa5e56e02bc357db05e66256a256fccc7f
zai-org_GLM-4.7-Q3_K_M/zai-org_GLM-4.7-Q3_K_M-00004-of-00005.gguf39.6 GB93ee7c0e8f01b14f79909cb2a403c380ae1f0db09b1510db197b442668dab4df
zai-org_GLM-4.7-Q3_K_M/zai-org_GLM-4.7-Q3_K_M-00005-of-00005.gguf6.30 GB56c59403008a8349d706d512756e245a19ebb5af63fdfd654d2bb0d6819e807f
zai-org_GLM-4.7-Q3_K_S/zai-org_GLM-4.7-Q3_K_S-00001-of-00004.gguf39.5 GBb3802aa5a175fa52c1db06430d57e5a0f0aa6dadf26c64987224936ec9ac924c
zai-org_GLM-4.7-Q3_K_S/zai-org_GLM-4.7-Q3_K_S-00002-of-00004.gguf39.6 GBc08d28292705b8f223be8d37a03c22a71bc272e24a8857ac3508424e9ac4a820
zai-org_GLM-4.7-Q3_K_S/zai-org_GLM-4.7-Q3_K_S-00003-of-00004.gguf39.6 GBcadfabf1dace0190264c581f91b10c29de2712f8f8aa1b699083fc8b6b88a4b4
zai-org_GLM-4.7-Q3_K_S/zai-org_GLM-4.7-Q3_K_S-00004-of-00004.gguf38.6 GB0f89010c4f7efa9d0d4afcf769306e2e1a392093ca8abd6c2b003919f9498442
zai-org_GLM-4.7-Q3_K_XL/zai-org_GLM-4.7-Q3_K_XL-00001-of-00005.gguf39.8 GBcb31956fae1dd76729f4deb849f22bc995aae3ed37fff8629dcc09d6b4cd839a
zai-org_GLM-4.7-Q3_K_XL/zai-org_GLM-4.7-Q3_K_XL-00002-of-00005.gguf39.8 GBf0b14221b8776534ae590bbab37adc5de5180244ad5b68602787992029cee172
zai-org_GLM-4.7-Q3_K_XL/zai-org_GLM-4.7-Q3_K_XL-00003-of-00005.gguf39.8 GBe9ee23ebeeb063c35d475e66d3e2ae573834afe500af9fcd0be8694fa238e87f
zai-org_GLM-4.7-Q3_K_XL/zai-org_GLM-4.7-Q3_K_XL-00004-of-00005.gguf39.8 GB43cebef310752189cbea5a7d032f99645fdf99c1ea3ccd8a505870bd59d9d1e0
zai-org_GLM-4.7-Q3_K_XL/zai-org_GLM-4.7-Q3_K_XL-00005-of-00005.gguf12.0 GBd13e0b2d95c96a4b494108ec304f28772e3a96a957922d88590e01a55d1e20bc
zai-org_GLM-4.7-Q4_0/zai-org_GLM-4.7-Q4_0-00001-of-00006.gguf39.9 GBebb21983c48473fccb3728f777b38da6e5c01c2d7843e3a2900693b2c27183a1
zai-org_GLM-4.7-Q4_0/zai-org_GLM-4.7-Q4_0-00002-of-00006.gguf39.8 GB96f73132ec4e44122bb5cb15576646fd4b46b54b0112652b90e2d1c6e5d5962a
zai-org_GLM-4.7-Q4_0/zai-org_GLM-4.7-Q4_0-00003-of-00006.gguf39.7 GB329e867a0ac75446e2868d4d8f4c520eeaac6f7355232b9c1c189e25ff6d1732
zai-org_GLM-4.7-Q4_0/zai-org_GLM-4.7-Q4_0-00004-of-00006.gguf39.7 GB48935faef9b3bf2001417493427d5172815e0b96ff6267dab9a8bcea604321db
zai-org_GLM-4.7-Q4_0/zai-org_GLM-4.7-Q4_0-00005-of-00006.gguf39.6 GB90bffbc958d17d614adfdf0b88e37317cda5b3983bd7d976670a0e6e4fb37d8e
zai-org_GLM-4.7-Q4_0/zai-org_GLM-4.7-Q4_0-00006-of-00006.gguf7.75 GB4cd7d013c93948c3228489064c6e5332830f9141904397fdd68977361a3bc249
zai-org_GLM-4.7-Q4_1/zai-org_GLM-4.7-Q4_1-00001-of-00006.gguf39.7 GBd201b97aa91cbffa0c97c0986811b7300da5d0c60988e36e0b27154c47032fd1
zai-org_GLM-4.7-Q4_1/zai-org_GLM-4.7-Q4_1-00002-of-00006.gguf39.5 GB8d17f5376079eec4dea651e34c72d8505985fb980bec85cd96dab8aa5495566e
zai-org_GLM-4.7-Q4_1/zai-org_GLM-4.7-Q4_1-00003-of-00006.gguf39.5 GB89d36a621773cc64fd4a338182708c6140fd7bd4007c4376b2d6060be58eaf13
zai-org_GLM-4.7-Q4_1/zai-org_GLM-4.7-Q4_1-00004-of-00006.gguf39.5 GB93de8db7be272ccb3002274807409dbd4a8e87364d32bf0ffe3b59e4712351a7
zai-org_GLM-4.7-Q4_1/zai-org_GLM-4.7-Q4_1-00005-of-00006.gguf39.5 GB71efa928b4e01701e2ea6e35f4dcceadee16f8cdf8f423518304ac239bca5c4b
zai-org_GLM-4.7-Q4_1/zai-org_GLM-4.7-Q4_1-00006-of-00006.gguf27.3 GBa6d2755daec2693fe8424ef8349068be853cf718b79d14bda07abb21f0d5bde2
zai-org_GLM-4.7-Q4_K_L/zai-org_GLM-4.7-Q4_K_L-00001-of-00006.gguf39.9 GB6b60d162f01c01bc5c53964bc889e82df5d8b3db7c315a8ce7fef767166f1388
zai-org_GLM-4.7-Q4_K_L/zai-org_GLM-4.7-Q4_K_L-00002-of-00006.gguf40.0 GB6fbe12ee2c509b64047fd05f0271422a90d19e1ee0cea3381fe8db67917628df
zai-org_GLM-4.7-Q4_K_L/zai-org_GLM-4.7-Q4_K_L-00003-of-00006.gguf39.6 GB808db194a2ce25383d386643627f9683be5f25d8a6048e0c88ab2108e431930b
zai-org_GLM-4.7-Q4_K_L/zai-org_GLM-4.7-Q4_K_L-00004-of-00006.gguf40.0 GBf2a76d706301e16ef44d68882e5338dcb23207ca5616588fe0423609dbb27547
zai-org_GLM-4.7-Q4_K_L/zai-org_GLM-4.7-Q4_K_L-00005-of-00006.gguf39.4 GB83630a98c36aef54e230ce5d20acf7897318af240e0a01f469e5938413252b66
zai-org_GLM-4.7-Q4_K_L/zai-org_GLM-4.7-Q4_K_L-00006-of-00006.gguf20.3 GBb4d9e2534bac2cb6216119cce9b41cbc10c784ef7be807115d37dee1da99a328
zai-org_GLM-4.7-Q4_K_M/zai-org_GLM-4.7-Q4_K_M-00001-of-00006.gguf40.0 GB102010356f58e3ae2cb85ceafda451e8184647d11aa78a7fd52c4e522f24eb4c
zai-org_GLM-4.7-Q4_K_M/zai-org_GLM-4.7-Q4_K_M-00002-of-00006.gguf40.0 GBd46499a3a4268c02d1ab0ee02c5e46016d148f826399f2d7faf85688f9cc3aad
zai-org_GLM-4.7-Q4_K_M/zai-org_GLM-4.7-Q4_K_M-00003-of-00006.gguf40.0 GBa4ace19b89a8837418832031f3200b24b1b266dfee3a3590f5c1c3aa49d6e840
zai-org_GLM-4.7-Q4_K_M/zai-org_GLM-4.7-Q4_K_M-00004-of-00006.gguf39.6 GB89140a2bf1e47ee9b616e0406618d894aa0596cc8b8efeb1879288c4eeb428f5
zai-org_GLM-4.7-Q4_K_M/zai-org_GLM-4.7-Q4_K_M-00005-of-00006.gguf39.4 GB404c415e7a2d5c32458641ad1e7742a98a6abb3a4e90ac59dd26dfff12896d4c
zai-org_GLM-4.7-Q4_K_M/zai-org_GLM-4.7-Q4_K_M-00006-of-00006.gguf19.6 GB1972d90fb250b8aec109bc9c9befa87fa1ce1908c4406bd92a12de5960e8af19
zai-org_GLM-4.7-Q4_K_S/zai-org_GLM-4.7-Q4_K_S-00001-of-00006.gguf39.5 GBb0a425144e3f18158d68c951884026224283d42238d1abf6b1718f095da52f24
zai-org_GLM-4.7-Q4_K_S/zai-org_GLM-4.7-Q4_K_S-00002-of-00006.gguf39.6 GB803dabe127229f91373f93ca787ed5e7eddb56a2ebe984a06427aa6e567262e7
zai-org_GLM-4.7-Q4_K_S/zai-org_GLM-4.7-Q4_K_S-00003-of-00006.gguf39.6 GB8b3541de353b145dd5abf783e6bf2a05a2f27691cd46791b6f1a53ad2873d13d
zai-org_GLM-4.7-Q4_K_S/zai-org_GLM-4.7-Q4_K_S-00004-of-00006.gguf39.7 GBd23acbc40c6c316846155865907cab21c28702382866810087324931943826cf
zai-org_GLM-4.7-Q4_K_S/zai-org_GLM-4.7-Q4_K_S-00005-of-00006.gguf39.6 GB36b0b784e634cc423129ac151cf2f076dcdfed2f239cf412f1167f03a14c1204
zai-org_GLM-4.7-Q4_K_S/zai-org_GLM-4.7-Q4_K_S-00006-of-00006.gguf12.8 GBfc698d51afff10d5a78d2c433efc01ce35912b7a317492ec06cfce14a7fe3c56
zai-org_GLM-4.7-Q5_K_M/zai-org_GLM-4.7-Q5_K_M-00001-of-00007.gguf39.2 GB079a693d88d0eedc16dd2dffc296ab3cd54caf503d8ce0a95b6ba7a1d45beb56
zai-org_GLM-4.7-Q5_K_M/zai-org_GLM-4.7-Q5_K_M-00002-of-00007.gguf39.8 GBf0b77802b9457b88e1c41f40c35225d7dc9ebe32dce7b489bc433e0a6bd2a6be
zai-org_GLM-4.7-Q5_K_M/zai-org_GLM-4.7-Q5_K_M-00003-of-00007.gguf39.8 GB9eb612262f324d2f50f10f365110c720c468bb442607011652f1c41b010ebb19
zai-org_GLM-4.7-Q5_K_M/zai-org_GLM-4.7-Q5_K_M-00004-of-00007.gguf39.9 GB8f5d660a152d7632451c5f6d2012f08e3e9fccc7b5b26aba78c57eb03dab02a7
zai-org_GLM-4.7-Q5_K_M/zai-org_GLM-4.7-Q5_K_M-00005-of-00007.gguf39.8 GBae5694ff9581e24abd887f2c2ddac9820888f1728cafab0a7075501a5abba434
zai-org_GLM-4.7-Q5_K_M/zai-org_GLM-4.7-Q5_K_M-00006-of-00007.gguf39.6 GB73e9832aebe20377602fc158d527ce6d8fdda15c74ce39e218dc2ff84cd439a6
zai-org_GLM-4.7-Q5_K_M/zai-org_GLM-4.7-Q5_K_M-00007-of-00007.gguf17.3 GB0610da1ba291d81af12ed0b8af5291232deb10c8965147ea924760c050db831b
zai-org_GLM-4.7-Q5_K_S/zai-org_GLM-4.7-Q5_K_S-00001-of-00007.gguf40.0 GBd59dafd1dece21ea9ad789cb29fd5b0afe34d0434437a9072f56243332d23d91
zai-org_GLM-4.7-Q5_K_S/zai-org_GLM-4.7-Q5_K_S-00002-of-00007.gguf39.8 GB7e9bacb68985084913a442ee82e964c37297fe72a6528027c8ed4708f4e3771a
zai-org_GLM-4.7-Q5_K_S/zai-org_GLM-4.7-Q5_K_S-00003-of-00007.gguf39.9 GB2a64c89708b4c1aaaf9a1f4b3e0bb3feefda131431663e1ec99cfff08e9cee25
zai-org_GLM-4.7-Q5_K_S/zai-org_GLM-4.7-Q5_K_S-00004-of-00007.gguf39.9 GB297a352debefb192cd72ce1ed679c9c8e9e9294d599c910fbf83a44434f88fac
zai-org_GLM-4.7-Q5_K_S/zai-org_GLM-4.7-Q5_K_S-00005-of-00007.gguf39.8 GB5050e129b167411d75ffad7e59b4670fc40bd20ea64bfb49477c51f6744ff75d
zai-org_GLM-4.7-Q5_K_S/zai-org_GLM-4.7-Q5_K_S-00006-of-00007.gguf39.9 GBe9bcd9321a9cf5c62a4ba7a9ac03330ddff0604dde69fb51912122af020723ff
zai-org_GLM-4.7-Q5_K_S/zai-org_GLM-4.7-Q5_K_S-00007-of-00007.gguf8.29 GBfb72716fcaff35e98cbc44e4cae9a5e466f3ec4ca8f14a59621334f8c1bb4f22
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00001-of-00008.gguf39.9 GB75ec3a4410d8016c5ccc8707f647f0097b41ca1fb1b70b359dd52bbf6977025d
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00002-of-00008.gguf40.0 GBd197f3b90f24ba574bdc80df9407cb61021bbc55f295ce3d730e047d53f06352
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00003-of-00008.gguf40.0 GB2ca7a8758d438df25f767c31b47a59224af792d4a8645884e1d6d139c4546d61
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00004-of-00008.gguf39.9 GBe9736dc2a261e2c337e8860061f4f55c9dbf83b67073545155ead878919ebd97
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00005-of-00008.gguf40.0 GB3e56f865eb5a24e0c7dd9ad7cca6905da0657105e30676b8d0147a3154b826db
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00006-of-00008.gguf40.0 GB60a4cc60ef8a07e56dc89ea245a30110fb2f4be865549d69eea4b4ae532a30cb
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00007-of-00008.gguf39.9 GB74fdca96f45041fddfa66d3d1208bff7186d31c3682efdf4174c44a0b0d8b926
zai-org_GLM-4.7-Q6_K/zai-org_GLM-4.7-Q6_K-00008-of-00008.gguf15.3 GB576eaa7faf07c7efe3e38698fda6686016d82f490ca6e41411b8765fa555978c
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00001-of-00010.gguf39.0 GBd72d340e1316295c8c0144b40fbbca06b5e8833447c94b303bdc85921060f206
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00002-of-00010.gguf39.1 GBdd11c163abe4122b6803905d3a2c3ac4ca00f42962de8e1a6509f2c1c2e39b63
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00003-of-00010.gguf39.0 GB6ed4f1023ecba7cc8054bfc498902eceee8f2f54827e6cbbc20d14d15c90ebba
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00004-of-00010.gguf39.0 GB42621b11094296c366b584d779587f7071d1e5bd97c2bb2bbe59c02f8d856e7e
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00005-of-00010.gguf39.1 GBd14454b5a22717f0fbd6678cb568f6b6ef5f6a8525cbe0f3803209432a1c0192
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00006-of-00010.gguf39.0 GBf81d9d430a08e67ff0933f0e9b245fe9e10a8395702246a2480437fa3d11b756
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00007-of-00010.gguf39.0 GBb30f80a8292a7be5cffbd3f9eabbfe0b2931efdd3b98019e777f4ee8c22548cb
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00008-of-00010.gguf39.1 GB0eb16c5cf42ff7efb7a85790655a5bfaa93b5ca13a4f1f69aa7dafa045340415
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00009-of-00010.gguf39.0 GB05dfb3dc29ded68ab9938f426285354cacf52d39e26adf89a9e9308c7e48d0a3
zai-org_GLM-4.7-Q8_0/zai-org_GLM-4.7-Q8_0-00010-of-00010.gguf29.5 GBad890d25c8e5c7d4828b15f9e8134206e21a231d24fd55b7b2aa53930865552c
zai-org_GLM-4.7-imatrix.gguf688 MBeb55e30f05180b31c99dcb773b0cd547a06773d81ec30d898eff9c83746dae00
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
c47ba45730 pinned now2026-11-15 05:04 UTC133 files · 4.60 TB

Use it

$ fw get bartowski/zai-org_GLM-4.7-GGUF
# manifest sha256 68a122801d3a… · 4.60 TB · 133 files
$ fw verify ./zai-org_GLM-4.7-GGUF bartowski/zai-org_GLM-4.7-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/bartowski/zai-org_GLM-4.7-GGUF.json --dir ./zai-org_GLM-4.7-GGUF $ python3 fw.py verify ./zai-org_GLM-4.7-GGUF ./bartowski__zai-org_GLM-4.7-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/zai-org_GLM-4.7-GGUF --revision c47ba4573051e4a5146879669a8a95743b5302a4 --local-dir ./zai-org_GLM-4.7-GGUF
llama.cppDownload one GGUF variant (zai-org_GLM-4.7-imatrix, 688 MB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/zai-org_GLM-4.7-GGUF --include "zai-org_GLM-4.7-imatrix*" --local-dir ./zai-org_GLM-4.7-GGUF $ llama-server -m ./zai-org_GLM-4.7-GGUF/zai-org_GLM-4.7-imatrix.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./zai-org_GLM-4.7-GGUF/zai-org_GLM-4.7-imatrix.gguf\n' > Modelfile $ ollama create zai-org-glm-4.7-gguf -f Modelfile

License

Name
MIT License
Id
MIT
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
59342a94eb94e55850305c48cc97d0842580278adbddeda328077ae9d20aeaba
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: bartowski <huggingface.co/bartowski>Newsgroups: alt.freeweights.glmSubject: zai-org_GLM-4.7-GGUFDate: 2026-11-15Commit: c47ba45Signed: 2DC28CC7B26A283B ✓
Upstream
bartowski/zai-org_GLM-4.7-GGUF
Pinned commit
c47ba4573051e4a5146879669a8a95743b5302a4
Manifest
zai-org_GLM-4.7-GGUF.json · .minisig
Manifest sha256
68a122801d3a343a3af33345890c7947b528933b2bb1b21da592efbc5da60005
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:04 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/bartowski/zai-org_GLM-4.7-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/bartowski/zai-org_GLM-4.7-GGUF.json.minisig $ minisign -Vm zai-org_GLM-4.7-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

zai-org/GLM-4.7 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download bartowski/zai-org_GLM-4.7-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. zai-org_GLM-4.7-GGUF.json. Provenance. Takedown history: none.
From: bartowski <huggingface.co/bartowski>Subject: arcee-ai_GLM-4-32B-Base-32K-GGUF
From: ggml-org <huggingface.co/ggml-org>Subject: AutoGLM-Phone-9B-GGUF
From: zai-org <huggingface.co/zai-org>Subject: cogagent-chat-hf
From: zai-org <huggingface.co/zai-org>Subject: CogView3-Plus-3B
From: zai-org <huggingface.co/zai-org>Subject: cogvlm-base-490-hf
From: laion <huggingface.co/laion>Subject: dev_set_part1_10k_glm_4_7_traces_jupiter