alt.freeweights.qwen / Qwen3-14B-ONNX

From:

onnx-community <huggingface.co/onnx-community>Newsgroups: alt.freeweights.qwenSubject:

Qwen3-14B-ONNX

Date: 2026-11-15Commit: 8a58d28Signed: 2DC28CC7B26A283B ✓

Model. Onnx weights, 30.4 GB in all. Published by onnx-community under Apache-2.0.

qwen

30.4GBQwen3-14B-ONNXonnxpermissive

FactsParamsnot statedSize30.4 GBFormatsonnxTasknot taggedLicenseApache-2.0From sourcepermissive

$ fw get onnx-community/Qwen3-14B-ONNX
# manifest sha256 8abd3e8d8d93… · 30.4 GB · 28 files
$ fw verify ./Qwen3-14B-ONNX onnx-community/Qwen3-14B-ONNX

From sourceHosted (signed)onnx-community/Qwen3-14B-ONNXLast check: 2026-11-15 05:29 UTC

Run at home Get help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Qwen3-14B.

Works with

Run2 Convert3 Scan1

Runs with

Ranked by fit to this model (onnx), then by GitHub stars.

Ultralytics OpenVINO

Convert with

ONNX

Optimum

Olive

Scan with

ModelScan

Overview Model card Files Use it License Provenance Model tree

Overview

Size: 30.4 GB
Weights: 541 KB (smallest of 3 ONNX variants)
Parameters: not stated
Formats: onnx
Task: not tagged
License: Apache-2.0 (permissive)
Files: 28, each with a sha256
Publisher: onnx-community
Added: 2026-11-15
Section: alt.freeweights.qwen

Lineage

Original release from the publisher.

Base model: Qwen/Qwen3-14B

Where these bytes come from

Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources

Badge	Host	Last check	Result
From source	huggingface.co	2026-11-15 05:29 UTC	passed

Model card

From the publisher at commit 8a58d28. Shown as plain text with links; images open at the publisher.

Qwen3-14B ONNX Models#

This repository hosts the optimized versions of Qwen3-14B to accelerate inference with ONNX Runtime. Model optimizations refer to techniques and methods used to improve the runtime performance, efficiency, and resource utilization of machine learning models.

Optimized models are published here in ONNX format to run with ONNX Runtime with the precision best suited to this target.

Here are some of the optimized configurations we have added:

ONNX model for CPU and mobile using int4 quantization via KLD gradient and block size 128.
ONNX model for CUDA using int4 quantization via KLD gradient and block size 128.
ONNX model for WebGPU using int4 quantization via KLD gradient and block size 32.

Model Create#

You can see how to create the ONNX models by following the Olive recipes here for your target hardware.

Model Run#

You can install ONNX Runtime GenAI to run the model. You can then run the inference example here.

For CPU:

# Download the model directly using the Hugging Face CLI
hf download onnx-community/Qwen3-14B-ONNX --include onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/* --local-dir .

# Install the CPU package of ONNX Runtime GenAI
pip install onnxruntime-genai

# Please adjust the model directory (-m) accordingly
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/common.py -o common.py
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-chat.py -o model-chat.py
python model-chat.py -m onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/ -e follow_config

For CUDA:

# Download the model directly using the Hugging Face CLI
hf download onnx-community/Qwen3-14B-ONNX --include onnxruntime/cuda/cuda-int4-kld-block-128/* --local-dir .

# Install the CUDA package of ONNX Runtime GenAI
pip install onnxruntime-genai-cuda

# Please adjust the model directory (-m) accordingly
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/common.py -o common.py
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-chat.py -o model-chat.py
python model-chat.py -m onnxruntime/cuda/cuda-int4-kld-block-128 -e follow_config

For WebGPU:

# Download the model directly using the Hugging Face CLI
hf download onnx-community/Qwen3-14B-ONNX --include onnxruntime/webgpu/webgpu-int4-kld-block-32/* --local-dir .

# Install the WebGPU packages of ONNX Runtime and ONNX Runtime GenAI
pip install onnxruntime-webgpu
pip install onnxruntime-genai --no-deps

# Please adjust the model directory (-m) accordingly
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/common.py -o common.py
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-chat.py -o model-chat.py
python model-chat.py -m onnxruntime/webgpu/webgpu-int4-kld-block-32 -e follow_config

Model Description#

Developed by: Microsoft
Model type: ONNX
License: Apache 2.0
Model Description: This is a conversion of the Qwen3-14B model for local inference on CPUs and GPUs.
Disclaimer: Model is only an optimization of the base model. Any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Files

28 files · 30.4 GBWeights 541 KB (smallest of 3 ONNX variants). Sizes and sha256 from the signed manifest.

Show all 28 files with their sha256

File	Size	sha256
.gitattributes	1.62 KB	6916ac4a9fd92a5964d49b45d4c87999e8dc7287e6a3073ecc6cba692d7a6615
LICENSE	11.3 KB	832dd9e00a68dd83b3c3fb9f5588dad7dcf337a0db50f7d9483f310cd292e92e
README.md	4.00 KB	0b6efa294d33a256940938174170a75ca67b8194666a3fb14910b4a8452f4dd6
config.json	728 B	e73c3664ca09b10a673fef0c22e8a6b456201d49bd4713c9691f775720e8857a
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/chat_template.jinja	4.17 KB	a55ee1b1660128b7098723e0abcd92caa0788061051c62d51cbe87d9cf1974d8
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/config.json	7.64 KB	428391f6d400fa700f684f99e7883544ae6029ee5915e7404aba4ef8595ea871
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/genai_config.json	1.52 KB	17e5240097a0637610d7c61367ba37e7e218be1188fd842ed94ab458a8662ca3
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/model.onnx	541 KB	0f501fe538f900f94d9e32fd29dd581897ef4c183444b897b6894ce8ec11e3d0
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/model.onnx.data	9.98 GB	734cb9989232224128712b2a20746eb96f14ae638242f4125db5e410988b46f8
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/model_config.json	23.0 KB	50c755897bcfe795216ee16a2fbf5fe40a31c752bd538d568998d16216ef4d02
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/tokenizer.json	11.4 MB	979d160e081df25a1bf7f4e2e8f4c441b5dfdc9a8e84aec9f32e80445e1b59b8
onnxruntime/cpu_and_mobile/cpu-int4-kld-block-128/tokenizer_config.json	663 B	bfd13b57b2e0c2cb582f311c0895f077d16a868c0dc61e4dbbba544a835341d6
onnxruntime/cuda/cuda-int4-kld-block-128/chat_template.jinja	4.17 KB	a55ee1b1660128b7098723e0abcd92caa0788061051c62d51cbe87d9cf1974d8
onnxruntime/cuda/cuda-int4-kld-block-128/config.json	7.64 KB	428391f6d400fa700f684f99e7883544ae6029ee5915e7404aba4ef8595ea871
onnxruntime/cuda/cuda-int4-kld-block-128/genai_config.json	1.76 KB	80b6e81c2fb54fd91640bfdeafd15c5ac0410d4a82c30c7ee42eb81b269eab08
onnxruntime/cuda/cuda-int4-kld-block-128/model.onnx	541 KB	4d8edd30dd034028abf56761fe0453480f4a94dc7c6faefea83874e9604a0428
onnxruntime/cuda/cuda-int4-kld-block-128/model.onnx.data	9.74 GB	2fd4db6a76a6160bc00a6fad485fd11ff8b9d53c86bbe3811459a4fa3b8552f8
onnxruntime/cuda/cuda-int4-kld-block-128/model_config.json	23.0 KB	bb52972898e5a6115f41925f1513c438e5a074c98c907ba484801a28bdbde06d
onnxruntime/cuda/cuda-int4-kld-block-128/tokenizer.json	11.4 MB	979d160e081df25a1bf7f4e2e8f4c441b5dfdc9a8e84aec9f32e80445e1b59b8
onnxruntime/cuda/cuda-int4-kld-block-128/tokenizer_config.json	663 B	bfd13b57b2e0c2cb582f311c0895f077d16a868c0dc61e4dbbba544a835341d6
onnxruntime/webgpu/webgpu-int4-kld-block-32/chat_template.jinja	4.17 KB	a55ee1b1660128b7098723e0abcd92caa0788061051c62d51cbe87d9cf1974d8
onnxruntime/webgpu/webgpu-int4-kld-block-32/config.json	7.64 KB	240aba8e0b0876a30e7859d96d3f344010f685cb54ae9507dae3f735d97de9da
onnxruntime/webgpu/webgpu-int4-kld-block-32/genai_config.json	1.75 KB	d6420a20680ba2b72d9270238d004a991e1fb45dc8b84ba7a7aaf532cec848d9
onnxruntime/webgpu/webgpu-int4-kld-block-32/model.onnx	542 KB	6f3f780f00f5e5f6202f2ad25c11c670c3c9959c276f46d4c182b2ca0ddbb99e
onnxruntime/webgpu/webgpu-int4-kld-block-32/model.onnx.data	10.7 GB	9885798b8f1c5bb1bc56d55742abfd5b7456ad602f669441e6ca58368c248bfe
onnxruntime/webgpu/webgpu-int4-kld-block-32/model_config.json	23.0 KB	e35d71f652c7848f1e93c0291d6f26d8980f17a02fc0705597c9a34e5bda4655
onnxruntime/webgpu/webgpu-int4-kld-block-32/tokenizer.json	11.4 MB	979d160e081df25a1bf7f4e2e8f4c441b5dfdc9a8e84aec9f32e80445e1b59b8
onnxruntime/webgpu/webgpu-int4-kld-block-32/tokenizer_config.json	663 B	bfd13b57b2e0c2cb582f311c0895f077d16a868c0dc61e4dbbba544a835341d6

VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.

Upstream commit	Date	Contents
8a58d280ce pinned now	2026-11-15 05:29 UTC	28 files · 30.4 GB

Use it

$ fw get onnx-community/Qwen3-14B-ONNX
# manifest sha256 8abd3e8d8d93… · 30.4 GB · 28 files
$ fw verify ./Qwen3-14B-ONNX onnx-community/Qwen3-14B-ONNX

fw.pyChecks the signature and every sha256, tries each source in order, resumes.

$ python3 fw.py get https://freeweights.allternit.com/manifests/onnx-community/Qwen3-14B-ONNX.json --dir ./Qwen3-14B-ONNX
$ python3 fw.py verify ./Qwen3-14B-ONNX ./onnx-community__Qwen3-14B-ONNX.json

hfThe Hugging Face CLI with one setting. Same repo id.

$ HF_ENDPOINT=https://freeweights.allternit.com hf download onnx-community/Qwen3-14B-ONNX --revision 8a58d280ce227fe9bcbcff80704f957dd6cb70f0 --local-dir ./Qwen3-14B-ONNX

Run at home

License

Name: Apache License 2.0
Id: Apache-2.0
Class: Permissive
Redistribution: yes
Listing: Hosted (signed)
Decided: License as declared by the publisher. No person read it. 2026-11-15
Text in: LICENSE
Text sha256: 832dd9e00a68dd83b3c3fb9f5588dad7dcf337a0db50f7d9483f310cd292e92e
Terms gate: No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From:

onnx-community <huggingface.co/onnx-community>Newsgroups: alt.freeweights.qwenSubject: Qwen3-14B-ONNXDate: 2026-11-15Commit: 8a58d28Signed: 2DC28CC7B26A283B ✓

Upstream: onnx-community/Qwen3-14B-ONNX
Pinned commit: 8a58d280ce227fe9bcbcff80704f957dd6cb70f0
Manifest: Qwen3-14B-ONNX.json · .minisig
Manifest sha256: 8abd3e8d8d93b7f9d79f152c9b705b65cf21f020d8810cf95fc4edbf240154fe
Signature: minisign, Ed25519, key 2DC28CC7B26A283B
Created: 2026-11-15 05:29 UTC
Generator: freeweights-manifest/0.1.0
Takedowns: None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/onnx-community/Qwen3-14B-ONNX.json
$ curl -O https://freeweights.allternit.com/manifests/onnx-community/Qwen3-14B-ONNX.json.minisig
$ minisign -Vm Qwen3-14B-ONNX.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file>   # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

Qwen/Qwen3-14B · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it

Download

$ HF_ENDPOINT=https://freeweights.allternit.com hf download onnx-community/Qwen3-14B-ONNX

Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest

minisign, key 2DC28CC7B26A283B. Qwen3-14B-ONNX.json. Provenance. Takedown history: none.

Source

huggingface.co/onnx-community/Qwen3-14B-ONNX

Related models

All of alt.freeweights.qwen →

From:

BAAI <huggingface.co/BAAI>Subject: Aquila-VL-2B-llava-qwen

From: Perciqa <huggingface.co/Perciqa>Subject: Aurora-Code-1

From:

BAAI <huggingface.co/BAAI>Subject: bge-reasoner-embed-qwen3-8b-0923

From: amazon <huggingface.co/amazon>Subject: BMOJOF-primed-HQwen3-8B-Instruct

From: nbeerbower <huggingface.co/nbeerbower>Subject: Bubba-Qwen3.6-27B-LoRA

From: bartowski <huggingface.co/bartowski>Subject: bytkim_Qwen3.8-27B-pi-GGUF