alt.freeweights.olmo / Olmo-3.1-32B-Instruct-MLX-4bit
From: lmstudio-community <huggingface.co/lmstudio-community>Newsgroups: alt.freeweights.olmoSubject:

Olmo-3.1-32B-Instruct-MLX-4bit

Date: 2026-11-15Commit: a76cbe1Signed: 2DC28CC7B26A283B ✓

Text generation model with 32.2B parameters. Safetensors weights, 18.1 GB in all. Published by lmstudio-community under Apache-2.0.

32.2B params18.1GBOlmo-3.1-32B-Instruct-MLX-4bitsafetensorspermissive
FactsParams32.2BSize18.1 GBFormatssafetensorsTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit
# manifest sha256 4a8e5c9e6e4c… · 18.1 GB · 12 files
$ fw verify ./Olmo-3.1-32B-Instruct-MLX-4bit lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit
From sourceHosted (signed)lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bitLast check: 2026-11-15 05:12 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Olmo-3.1-32B-Instruct.

Works with

Overview

Size
18.1 GB
Weights
18.1 GB (safetensors)
Parameters
32.2B
Formats
safetensors
Task
text generation
License
Apache-2.0 (permissive)
Files
12, each with a sha256
Publisher
lmstudio-community
Added
2026-11-15
Section
alt.freeweights.olmo
Lineage

Original release from the publisher.

Base model: allenai/Olmo-3.1-32B-Instruct

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:12 UTCpassed

Model card

From the publisher at commit a76cbe1. Shown as plain text with links; images open at the publisher.

💫 Community Model> Olmo-3.1-32B-Instruct by allenai#

👾 LM Studio Community models highlights program. Highlighting new & noteworthy models by the community. Join the conversation on Discord.

Model creator: allenai

Original model: Olmo-3.1-32B-Instruct

MLX quantization: provided by LM Studio team using mlx_lm

Technical Details#

4-bit quantized version of Olmo-3.1-32B-Instruct using MLX, optimized for Apple Silicon.

Special thanks#

🙏 Special thanks to the Apple Machine Learning Research team for creating MLX.

Disclaimers#

LM Studio is not the creator, originator, or owner of any Model featured in the Community Model Program. Each Community Model is created and provided by third parties. LM Studio does not endorse, support, represent or guarantee the completeness, truthfulness, accuracy, or reliability of any Community Model. You understand that Community Models can produce content that might be offensive, harmful, inaccurate or otherwise inappropriate, or deceptive. Each Community Model is the sole responsibility of the person or entity who originated such Model. LM Studio may not monitor or control the Community Models and cannot, and does not, take responsibility for any such Model. LM Studio disclaims all warranties or guarantees about the accuracy, reliability or benefits of the Community Models. LM Studio further disclaims any warranty that the Community Model will meet your requirements, be secure, uninterrupted or available at any time or location, or error-free, viruses-free, or that any errors will be corrected, or otherwise. You will be solely responsible for any damage resulting from your use of or access to the Community Models, your downloading of any Community Model, or use of any other Community Model provided by or through LM Studio.

Files

12 files · 18.1 GBWeights 18.1 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 12 files with their sha256
FileSizesha256
.gitattributes1.52 KB11ad7efa24975ee4b0c3c3a38ed18737f0658a5f75a0a96787b576a78a023361
README.md2.27 KB88b6c47aab54968ceab4e56a4d1ea6146609ae897e9c4d9d78e7dbb1bde10d72
chat_template.jinja2.75 KB49a944c9814e130bd3cc80a2420c55ff22e24a4e4ba97009aa60000909b5eac3
config.json2.94 KB7129731c165012539c6e2455961914dc5dc4d9437762ccbc887188b0139c7e97
generation_config.json207 B9ca20766a58daf4a6e1bf5f6552d27dbe57733dba2c3af507dd9f4b12aacc0b0
model-00001-of-00004.safetensors5.34 GB27fecee2d1d5af776aed75125292620f97a3aa0ef8ea5dc02bb01aeed257c9de
model-00002-of-00004.safetensors5.37 GB4b0b40f216f52b0405404c082b90088af60dd0078376c1c59359d5b26c243758
model-00003-of-00004.safetensors5.33 GBe1129ad5bbcf5c72c836857a8fd40d3a510e981daeccbe6578fc985c9ea324b4
model-00004-of-00004.safetensors2.09 GBc9305ce51cf607838f9d87b7cae468db107de1367210dddc9095396fa8b68c19
model.safetensors.index.json139 KB80882116189386ac51ec074f6e00e3068d75fc33d9b8d6d2feb9131eb525ba9f
tokenizer.json7.14 MBf358faf5dd00fc34a7cd855438f2c961593989a8b517a0e385a35a1bdcf7f6d1
tokenizer_config.json3.19 KB31907e04ecab262e955bbb0bac0338b3c1fbf0aaf1ed08f342a90bc394f8b9ea
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
a76cbe1094 pinned now2026-11-15 05:12 UTC12 files · 18.1 GB

Use it

$ fw get lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit
# manifest sha256 4a8e5c9e6e4c… · 18.1 GB · 12 files
$ fw verify ./Olmo-3.1-32B-Instruct-MLX-4bit lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit.json --dir ./Olmo-3.1-32B-Instruct-MLX-4bit $ python3 fw.py verify ./Olmo-3.1-32B-Instruct-MLX-4bit ./lmstudio-community__Olmo-3.1-32B-Instruct-MLX-4bit.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit --revision a76cbe10949f56b8b0b2866b3c79167494c2bc60 --local-dir ./Olmo-3.1-32B-Instruct-MLX-4bit
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForCausalLM, AutoTokenizer tok = AutoTokenizer.from_pretrained("lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit", revision="a76cbe10949f56b8b0b2866b3c79167494c2bc60") model = AutoModelForCausalLM.from_pretrained("lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit", revision="a76cbe10949f56b8b0b2866b3c79167494c2bc60", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit --revision a76cbe10949f56b8b0b2866b3c79167494c2bc60

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
88b6c47aab54968ceab4e56a4d1ea6146609ae897e9c4d9d78e7dbb1bde10d72
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: lmstudio-community <huggingface.co/lmstudio-community>Newsgroups: alt.freeweights.olmoSubject: Olmo-3.1-32B-Instruct-MLX-4bitDate: 2026-11-15Commit: a76cbe1Signed: 2DC28CC7B26A283B ✓
Upstream
lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit
Pinned commit
a76cbe10949f56b8b0b2866b3c79167494c2bc60
Manifest
Olmo-3.1-32B-Instruct-MLX-4bit.json · .minisig
Manifest sha256
4a8e5c9e6e4ca9bb93f0b0686b59e9ded9529ea591590c2d653aa719d2fd8392
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:12 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit.json $ curl -O https://freeweights.allternit.com/manifests/lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit.json.minisig $ minisign -Vm Olmo-3.1-32B-Instruct-MLX-4bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

allenai/Olmo-3.1-32B-Instruct · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download lmstudio-community/Olmo-3.1-32B-Instruct-MLX-4bit
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Olmo-3.1-32B-Instruct-MLX-4bit.json. Provenance. Takedown history: none.
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3-7B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Instruct-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_Olmo-3.1-32B-Think-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-2-7B-1025-GGUF
From: bartowski <huggingface.co/bartowski>Subject: allenai_olmOCR-7B-0225-preview-GGUF