CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.mistral / Mistral-7B-v0.1-onnx
From: microsoft <huggingface.co/microsoft>Newsgroups: alt.freeweights.mistralSubject:

Mistral-7B-v0.1-onnx

Date: 2026-11-15Commit: 3d5ce13Signed: 2DC28CC7B26A283B ✓

Model. Onnx weights, 14.5 GB in all. Published by microsoft under Apache-2.0.

mistral14.5GBMistral-7B-v0.1-onnxonnxpermissive
FactsParamsnot statedSize14.5 GBFormatsonnxTasknot taggedLicenseApache-2.0From sourcepermissive
$ fw get microsoft/Mistral-7B-v0.1-onnx
# manifest sha256 723e5e889e62… · 14.5 GB · 4 files
$ fw verify ./Mistral-7B-v0.1-onnx microsoft/Mistral-7B-v0.1-onnx
From sourceHosted (signed)microsoft/Mistral-7B-v0.1-onnxLast check: 2026-11-15 05:30 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of Mistral-7B-v0.1.

Works with

Run2Convert3Scan1

Runs with

Ranked by fit to this model (onnx), then by GitHub stars.

UltralyticsOpenVINO

Convert with

ONNXOptimumOlive

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
14.5 GB
Weights
221 KB (ONNX)
Parameters
not stated
Formats
onnx
Task
not tagged
License
Apache-2.0 (permissive)
Files
4, each with a sha256
Publisher
microsoft
Added
2026-11-15
Section
alt.freeweights.mistral
Lineage

Original release from the publisher.

Base model: mistralai/Mistral-7B-v0.1

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 05:30 UTCpassed

Model card

From the publisher at commit 3d5ce13. Shown as plain text with links; images open at the publisher.
This is an optimized version of the Mistral 7B model, available on this repository: https://huggingface.co/mistralai/Mistral-7B-v0.1 and under the license on such repository. Microsoft permits you to use, modify, redistribute, and create derivatives of Microsoft's contributions to the optimized version subject to the restrictions and disclaimers of warranty and liability in license agreement.#

Mistral-7b for ONNX Runtime#

Introduction#

This repository hosts the optimized versions of Mistral-7B-v0.1 to accelerate inference with ONNX Runtime CUDA execution provider.

See the usage instructions for how to inference this model with the ONNX files hosted in this repository.

Model Description#

  • Developed by: MistralAI
  • Model type: Pretrained generative text model
  • License: Apache 2.0 License
  • Model Description: This is a conversion of the Mistral-7B-v0.1 for ONNX Runtime inference with CUDA execution provider.

Performance Comparison#

Latency for token generation#

Below is average latency of generating a token using a prompt of varying size using NVIDIA A100-SXM4-80GB GPU, taken from the ORT benchmarking script for Mistral

Prompt LengthBatch SizePyTorch 2.1 torch.compileONNX Runtime CUDA
32132.58ms12.08ms
256154.54ms23.20ms
10241100.6ms77.49ms
20481236.8ms144.99ms
32463.71ms15.32ms
256486.74ms75.94ms
10244380.2ms273.9ms
20484N/A554.5ms

Usage Example#

Following the benchmarking instructions. Example steps:

  1. Clone onnxruntime repository.
git clone https://github.com/microsoft/onnxruntime
cd onnxruntime
  1. Install required dependencies
python3 -m pip install -r onnxruntime/python/tools/transformers/models/llama/requirements-cuda.txt
  1. Inference using manual model API, or use Hugging Face's ORTModelForCausalLM
from optimum.onnxruntime import ORTModelForCausalLM
from onnxruntime import InferenceSession
from transformers import AutoConfig, AutoTokenizer

sess = InferenceSession("Mistral-7B-v0.1.onnx", providers = ["CUDAExecutionProvider"])
config = AutoConfig.from_pretrained("mistralai/Mistral-7B-v0.1")

model = ORTModelForCausalLM(sess, config, use_cache = True, use_io_binding = True)

tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")

inputs = tokenizer("Instruct: What is a fermi paradox?\nOutput:", return_tensors="pt")

outputs = model.generate(**inputs)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Files

4 files · 14.5 GBWeights 221 KB (ONNX). Sizes and sha256 from the signed manifest.
Hide all 4 files with their sha256
FileSizesha256
.gitattributes1.65 KB5ee1b60e81bec3051dca601b77fbf794d59fb0f7709d33b68711df495fc4ca14
Mistral-7B-v0.1.onnx221 KBcf7000e873030a6ef75b556c5e7f04131c79de987449393ecad1e5ce175d4b9f
Mistral-7B-v0.1.onnx.data14.5 GB703dcd7f177b8e2151fb29343855f1f10b1f5b7d8721bad173efc6e2ea6daf76
README.md3.41 KB35f74a498e9f9f3ff56b0ef40e6d2f84468854e27bb152ddb0b0085d7f20429f
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
3d5ce13f65 pinned now2026-11-15 05:30 UTC4 files · 14.5 GB

Use it

$ fw get microsoft/Mistral-7B-v0.1-onnx
# manifest sha256 723e5e889e62… · 14.5 GB · 4 files
$ fw verify ./Mistral-7B-v0.1-onnx microsoft/Mistral-7B-v0.1-onnx
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/microsoft/Mistral-7B-v0.1-onnx.json --dir ./Mistral-7B-v0.1-onnx $ python3 fw.py verify ./Mistral-7B-v0.1-onnx ./microsoft__Mistral-7B-v0.1-onnx.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download microsoft/Mistral-7B-v0.1-onnx --revision 3d5ce13f65bd660957092e9e9d703f7f2d512f7e --local-dir ./Mistral-7B-v0.1-onnx
Run at home

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
35f74a498e9f9f3ff56b0ef40e6d2f84468854e27bb152ddb0b0085d7f20429f
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: microsoft <huggingface.co/microsoft>Newsgroups: alt.freeweights.mistralSubject: Mistral-7B-v0.1-onnxDate: 2026-11-15Commit: 3d5ce13Signed: 2DC28CC7B26A283B ✓
Upstream
microsoft/Mistral-7B-v0.1-onnx
Pinned commit
3d5ce13f65bd660957092e9e9d703f7f2d512f7e
Manifest
Mistral-7B-v0.1-onnx.json · .minisig
Manifest sha256
723e5e889e621eb8a9eb2837047729569e60900499e256413ab9d9aaf087d0c6
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 05:30 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/microsoft/Mistral-7B-v0.1-onnx.json $ curl -O https://freeweights.allternit.com/manifests/microsoft/Mistral-7B-v0.1-onnx.json.minisig $ minisign -Vm Mistral-7B-v0.1-onnx.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

mistralai/Mistral-7B-v0.1 · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download microsoft/Mistral-7B-v0.1-onnx
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Mistral-7B-v0.1-onnx.json. Provenance. Takedown history: none.
Source
huggingface.co/microsoft/Mistral-7B-v0.1-onnx

Related models

All of alt.freeweights.mistral →
From: bartowski <huggingface.co/bartowski>Subject: alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF
From: microsoft <huggingface.co/microsoft>Subject: chatbench-mistral-7b
From: NousResearch <huggingface.co/NousResearch>Subject: DeepHermes-3-Mistral-24B-Preview
From: mistralai <huggingface.co/mistralai>Subject: Devstral-Small-2-24B-Instruct-2512
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-4bit
From: mlx-community <huggingface.co/mlx-community>Subject: Devstral-Small-2-24B-Instruct-2512-6bit