CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.qwen / Qwen3.5-9B-MLX-4bit
From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.qwenSubject:

Qwen3.5-9B-MLX-4bit

Date: 2026-11-14Commit: 938d891Signed: 2DC28CC7B26A283B ✓

Image text to text model with 9.4B parameters. Safetensors weights, 5.98 GB in all. Published by mlx-community under Apache-2.0.

9.4B params5.98GBQwen3.5-9B-MLX-4bitsafetensorspermissive
FactsParams9.4BSize5.98 GBFormatssafetensorsTaskimage text to textLicenseApache-2.0From sourcepermissive
$ fw get mlx-community/Qwen3.5-9B-MLX-4bit
# manifest sha256 fdc146d87745… · 5.98 GB · 13 files
$ fw verify ./Qwen3.5-9B-MLX-4bit mlx-community/Qwen3.5-9B-MLX-4bit
From sourceHosted (signed)mlx-community/Qwen3.5-9B-MLX-4bitLast check: 2026-11-14 21:30 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Qwen3.5-9B.

Works with

Run23Fine-tune29Convert15Evaluate13Scan13Apps62
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
5.98 GB
Weights
5.95 GB (safetensors)
Parameters
9.4B
Formats
safetensors
Task
image text to text
License
Apache-2.0 (permissive)
Files
13, each with a sha256
Publisher
mlx-community
Added
2026-11-14
Section
alt.freeweights.qwen
Lineage

Original release from the publisher.

Base model: Qwen/Qwen3.5-9B

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 21:30 UTCpassed

Model card

From the publisher at commit 938d891. Shown as plain text with links; images open at the publisher.

Qwen3.5-9B-MLX-4bit#

This is a quantized MLX version of Qwen/Qwen3.5-9B for Apple Silicon.

Model Details#

  • Original Model: Qwen/Qwen3.5-9B
  • Quantization: 4-bit (~5.059 bits per weight)
  • Group Size: 64
  • Format: MLX SafeTensors
  • Framework: mlx-vlm

Conversion Details#

This model was converted using mlx-vlm with 4-bit quantization.

Conversion command:

python3 -m mlx_vlm convert \
  --hf-path "Qwen/Qwen3.5-9B" \
  --mlx-path "./mlx_models/Qwen3.5-9B-MLX-4bit" \
  -q --q-bits 4 --q-group-size 64

Important Note#

A better, more optimized conversion may be available from @Prince (@Blaizzy) in the MLX VLM community. Check the mlx-community organization for updated versions as official Qwen3.5 support is merged into the main mlx-vlm branch.

Usage#

from mlx_vlm import load, generate

model, processor = load("mlx-community/Qwen3.5-9B-MLX-4bit")

output = generate(
    model,
    processor,
    prompt="Describe this image in detail",
    image="path/to/image.jpg",
    max_tokens=200
)
print(output)

Or from the command line:

mlx_vlm generate \
  --model mlx-community/Qwen3.5-9B-MLX-4bit \
  --prompt "Describe this image" \
  --image path/to/image.jpg \
  --max-tokens 200

Performance#

  • Disk Size: ~5.6 GB
  • Runs efficiently on Apple Silicon Macs (M1/M2/M3/M4)
  • Lower memory footprint compared to 8-bit quantization

License#

This model inherits the Apache 2.0 license from the original Qwen3.5-9B model.

Files

13 files · 5.98 GBWeights 5.95 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 13 files with their sha256
FileSizesha256
.gitattributes1.57 KB34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930
README.md1.95 KB7cbe4c3e07a5465d52d60c94c71f8d578113550eb767d331553f9ca19538ce56
chat_template.jinja7.76 KBa4aee8afcf2e0711942cf848899be66016f8d14a889ff9ede07bca099c28f715
config.json3.33 KBa96942cb6a8a1d3f1d17514d81a1925d04362a6a3233b389d13012211baaa9f8
model-00001-of-00002.safetensors5.35 GBa68b87558c6ef43f74c2bd63ce7e9092ceddc3101f3def0030774bae5f42aadd
model-00002-of-00002.safetensors600 MBb0a770bf8469c7f3f18756a0e0283f1c1174344a83e059a4e483f6af4907352d
model.safetensors.index.json124 KBdd023913fb87cfdae27fb11dcf695117c925833796ccac3c64117d6652d8ff1e
preprocessor_config.json390 B27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516
processor_config.json1.30 KB14932921ca485d458a04dafd8069fbb0a4505622a48208d19ed247115801385b
tokenizer.json20.0 MB87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4
tokenizer_config.json1.14 KBe98f1901ac6f0adff67b1d540bfa0c36ac1a0cf59eb72ed78146ef89aafa1182
video_preprocessor_config.json385 B7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13
vocab.json6.72 MBce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
938d891994 pinned now manifest updated, same commit2026-11-14 21:30 UTC13 files · 5.98 GB
938d8919942026-11-14 21:30 UTC13 files · 5.98 GB

Use it

$ fw get mlx-community/Qwen3.5-9B-MLX-4bit
# manifest sha256 fdc146d87745… · 5.98 GB · 13 files
$ fw verify ./Qwen3.5-9B-MLX-4bit mlx-community/Qwen3.5-9B-MLX-4bit
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/Qwen3.5-9B-MLX-4bit.json --dir ./Qwen3.5-9B-MLX-4bit $ python3 fw.py verify ./Qwen3.5-9B-MLX-4bit ./mlx-community__Qwen3.5-9B-MLX-4bit.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/Qwen3.5-9B-MLX-4bit --revision 938d8919941c6e7efd3c7150eff7fe9d12afa631 --local-dir ./Qwen3.5-9B-MLX-4bit
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForImageTextToText, AutoProcessor processor = AutoProcessor.from_pretrained("mlx-community/Qwen3.5-9B-MLX-4bit", revision="938d8919941c6e7efd3c7150eff7fe9d12afa631") model = AutoModelForImageTextToText.from_pretrained("mlx-community/Qwen3.5-9B-MLX-4bit", revision="938d8919941c6e7efd3c7150eff7fe9d12afa631", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve mlx-community/Qwen3.5-9B-MLX-4bit --revision 938d8919941c6e7efd3c7150eff7fe9d12afa631
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-14
Text in
README.md
Text sha256
7cbe4c3e07a5465d52d60c94c71f8d578113550eb767d331553f9ca19538ce56
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.qwenSubject: Qwen3.5-9B-MLX-4bitDate: 2026-11-14Commit: 938d891Signed: 2DC28CC7B26A283B ✓
Upstream
mlx-community/Qwen3.5-9B-MLX-4bit
Pinned commit
938d8919941c6e7efd3c7150eff7fe9d12afa631
Manifest
Qwen3.5-9B-MLX-4bit.json · .minisig
Manifest sha256
fdc146d87745e2a982268e24cbb29d29e1a0afea015e461ba7322e3109400a40
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 21:30 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/mlx-community/Qwen3.5-9B-MLX-4bit.json $ curl -O https://freeweights.allternit.com/manifests/mlx-community/Qwen3.5-9B-MLX-4bit.json.minisig $ minisign -Vm Qwen3.5-9B-MLX-4bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

Qwen/Qwen3.5-9B · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download mlx-community/Qwen3.5-9B-MLX-4bit
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Qwen3.5-9B-MLX-4bit.json. Provenance. Takedown history: none.
Source
huggingface.co/mlx-community/Qwen3.5-9B-MLX-4bit

Related models

All of alt.freeweights.qwen →
From: BAAI <huggingface.co/BAAI>Subject: Aquila-VL-2B-llava-qwen
From: Perciqa <huggingface.co/Perciqa>Subject: Aurora-Code-1
From: BAAI <huggingface.co/BAAI>Subject: bge-reasoner-embed-qwen3-8b-0923
From: amazon <huggingface.co/amazon>Subject: BMOJOF-primed-HQwen3-8B-Instruct
From: nbeerbower <huggingface.co/nbeerbower>Subject: Bubba-Qwen3.6-27B-LoRA
From: bartowski <huggingface.co/bartowski>Subject: bytkim_Qwen3.8-27B-pi-GGUF