alt.freeweights.gemma / gemma-4-31B-it-MLX-6bit
From: lmstudio-community <huggingface.co/lmstudio-community>Newsgroups: alt.freeweights.gemmaSubject:

gemma-4-31B-it-MLX-6bit

Date: 2026-11-14Commit: 0bf6bb9Signed: 2DC28CC7B26A283B ✓

Image text to text model with 31.3B parameters. Safetensors weights, 26.1 GB in all. Published by lmstudio-community under Apache-2.0.

31.3B params26.1GBgemma-4-31B-it-MLX-6bitsafetensorspermissive
FactsParams31.3BSize26.1 GBFormatssafetensorsTaskimage text to textLicenseApache-2.0From sourcepermissive
$ fw get lmstudio-community/gemma-4-31B-it-MLX-6bit
# manifest sha256 a0321b34ca93… · 26.1 GB · 14 files
$ fw verify ./gemma-4-31B-it-MLX-6bit lmstudio-community/gemma-4-31B-it-MLX-6bit
From sourceHosted (signed)lmstudio-community/gemma-4-31B-it-MLX-6bitLast check: 2026-11-14 21:29 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of gemma-4-31B-it.

Works with

Overview

Size
26.1 GB
Weights
26.1 GB (safetensors)
Parameters
31.3B
Formats
safetensors
Task
image text to text
License
Apache-2.0 (permissive)
Files
14, each with a sha256
Publisher
lmstudio-community
Added
2026-11-14
Section
alt.freeweights.gemma
Lineage

Original release from the publisher.

Base model: google/gemma-4-31B-it

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 21:29 UTCpassed

Model card

From the publisher at commit 0bf6bb9. Shown as plain text with links; images open at the publisher.

💫 Community Model> gemma-4-31B-it by google#

👾 LM Studio Community models highlights program. Highlighting new & noteworthy models by the community. Join the conversation on Discord.

Model creator: google

Original model: gemma-4-31B-it

MLX quantization: provided by LM Studio team using mlx_vlm

Technical Details#

6-bit quantized version of gemma-4-31B-it using MLX, optimized for Apple Silicon.

Special thanks#

🙏 Special thanks to the Apple Machine Learning Research team for creating MLX.

Disclaimers#

LM Studio is not the creator, originator, or owner of any Model featured in the Community Model Program. Each Community Model is created and provided by third parties. LM Studio does not endorse, support, represent or guarantee the completeness, truthfulness, accuracy, or reliability of any Community Model. You understand that Community Models can produce content that might be offensive, harmful, inaccurate or otherwise inappropriate, or deceptive. Each Community Model is the sole responsibility of the person or entity who originated such Model. LM Studio may not monitor or control the Community Models and cannot, and does not, take responsibility for any such Model. LM Studio disclaims all warranties or guarantees about the accuracy, reliability or benefits of the Community Models. LM Studio further disclaims any warranty that the Community Model will meet your requirements, be secure, uninterrupted or available at any time or location, or error-free, viruses-free, or that any errors will be corrected, or otherwise. You will be solely responsible for any damage resulting from your use of or access to the Community Models, your downloading of any Community Model, or use of any other Community Model provided by or through LM Studio.

Files

14 files · 26.1 GBWeights 26.1 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 14 files with their sha256
FileSizesha256
.gitattributes1.57 KB34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
README.md2.27 KBce2b09dcd9fea315164eeaaa5299c021ad7555f64b94fb888995679de74a0a2c
chat_template.jinja18.7 KBae53464bf3be25802b3a5b37def7fd89667067d7577049b3b2d74c4d8de4c6d4
config.json6.05 KB62121a95e4185b9121a621540c03e690771125686e1435ab3234f1ff5ed79bec
generation_config.json208 Bd4226bbe3117d2d253ba4609720ba82c6c4ce4627a9a6ae05387c78983ac03de
model-00001-of-00005.safetensors5.28 GBcf93fd546d528276c4d39bbd2a1bab02e52f3d45d8cf074908fa21b3fde8d049
model-00002-of-00005.safetensors5.29 GB3749aac35308c00d060a7dbd1550fc1803f288014f9ed9783b9e5bfa6a771052
model-00003-of-00005.safetensors5.35 GB0eb9a1a5dbe8bd96a8bc07699139b3b59a3de64f764ecbf6c6902907658e8b25
model-00004-of-00005.safetensors5.34 GB4cac47262791ce244cb6294158220dbf3a3ef8b1025359d96d41ae6227324009
model-00005-of-00005.safetensors4.83 GB961e6ad16812b0032de0a5b2b96149d93fb6a4145e30bf94beda131f9728ba39
model.safetensors.index.json205 KB4b7fb00db892277bfacf7380598f36df5f95c7ed05b23fc08dc7ee4c5488ca33
processor_config.json1.34 KBdaf597419c03cb3f20ac4f894cef7e4ab4a56dd07fef5131aa82ceffa1693fd2
tokenizer.json32.2 MBcc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f
tokenizer_config.json22.9 KBf92e806c6accb2057a5d96ef46599bcb384b4a08e636098d0a42d3d904b0d22c
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
0bf6bb95e5 pinned now manifest updated, same commit2026-11-14 21:29 UTC14 files · 26.1 GB
0bf6bb95e52026-11-14 21:29 UTC14 files · 26.1 GB

Use it

$ fw get lmstudio-community/gemma-4-31B-it-MLX-6bit
# manifest sha256 a0321b34ca93… · 26.1 GB · 14 files
$ fw verify ./gemma-4-31B-it-MLX-6bit lmstudio-community/gemma-4-31B-it-MLX-6bit
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/lmstudio-community/gemma-4-31B-it-MLX-6bit.json --dir ./gemma-4-31B-it-MLX-6bit $ python3 fw.py verify ./gemma-4-31B-it-MLX-6bit ./lmstudio-community__gemma-4-31B-it-MLX-6bit.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download lmstudio-community/gemma-4-31B-it-MLX-6bit --revision 0bf6bb95e5775255b20a2724c0ee6156ba91501f --local-dir ./gemma-4-31B-it-MLX-6bit
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForImageTextToText, AutoProcessor processor = AutoProcessor.from_pretrained("lmstudio-community/gemma-4-31B-it-MLX-6bit", revision="0bf6bb95e5775255b20a2724c0ee6156ba91501f") model = AutoModelForImageTextToText.from_pretrained("lmstudio-community/gemma-4-31B-it-MLX-6bit", revision="0bf6bb95e5775255b20a2724c0ee6156ba91501f", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve lmstudio-community/gemma-4-31B-it-MLX-6bit --revision 0bf6bb95e5775255b20a2724c0ee6156ba91501f

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-14
Text in
README.md
Text sha256
ce2b09dcd9fea315164eeaaa5299c021ad7555f64b94fb888995679de74a0a2c
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: lmstudio-community <huggingface.co/lmstudio-community>Newsgroups: alt.freeweights.gemmaSubject: gemma-4-31B-it-MLX-6bitDate: 2026-11-14Commit: 0bf6bb9Signed: 2DC28CC7B26A283B ✓
Upstream
lmstudio-community/gemma-4-31B-it-MLX-6bit
Pinned commit
0bf6bb95e5775255b20a2724c0ee6156ba91501f
Manifest
gemma-4-31B-it-MLX-6bit.json · .minisig
Manifest sha256
a0321b34ca933abd4f3a2a55ce2b3c8d545bc60dbabde8f881b79c05b65f2b9a
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 21:29 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/lmstudio-community/gemma-4-31B-it-MLX-6bit.json $ curl -O https://freeweights.allternit.com/manifests/lmstudio-community/gemma-4-31B-it-MLX-6bit.json.minisig $ minisign -Vm gemma-4-31B-it-MLX-6bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

google/gemma-4-31B-it · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download lmstudio-community/gemma-4-31B-it-MLX-6bit
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. gemma-4-31B-it-MLX-6bit.json. Provenance. Takedown history: none.
From: laion <huggingface.co/laion>Subject: Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r128
From: laion <huggingface.co/laion>Subject: Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r64
From: laion <huggingface.co/laion>Subject: Alexandria-Gemma-4-12B-it-Qwen27-Knowledge-Units-LoRA-r128
From: laion <huggingface.co/laion>Subject: Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r128
From: laion <huggingface.co/laion>Subject: Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r64
From: laion <huggingface.co/laion>Subject: Alexandria-Gemma-4-E4B-it-Qwen27-Knowledge-Units-LoRA-r128