CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.llama / ultravox-v0_5-llama-3_1-8b-GGUF
From: ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.llamaSubject:

ultravox-v0_5-llama-3_1-8b-GGUF

Date: 2026-11-15Commit: 7a0280dSigned: 2DC28CC7B26A283B ✓

Model. Gguf weights, 6.30 GB in all. Published by ggml-org under MIT.

llama6.30GBultravox-v0_5-llama-3_1-8b-GGUFggufpermissive
FactsParamsnot statedSize6.30 GBFormatsggufTasknot taggedLicenseMITFrom sourcepermissive
$ fw get ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
# manifest sha256 e9cda18afe03… · 6.30 GB · 4 files
$ fw verify ./ultravox-v0_5-llama-3_1-8b-GGUF ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
From sourceHosted (signed)ggml-org/ultravox-v0_5-llama-3_1-8b-GGUFLast check: 2026-11-15 03:21 UTC
Run at homeGet help

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Run11Convert1Scan1

Convert with

ggml

Scan with

ModelScan
OverviewModel cardFilesUse itLicenseProvenanceModel tree

Overview

Size
6.30 GB
Weights
4.92 GB (GGUF)
Parameters
not stated
Formats
gguf
Task
not tagged
License
MIT (permissive)
Files
4, each with a sha256
Publisher
ggml-org
Added
2026-11-15
Section
alt.freeweights.llama
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 03:21 UTCpassed

Model card

No model card stored here.No README was stored for this model. Read the publisher's page: https://huggingface.co/ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF

Files

4 files · 6.30 GBWeights 4.92 GB (GGUF). Sizes and sha256 from the signed manifest.
Hide all 4 files with their sha256
FileSizesha256
.gitattributes1.91 KB86d63fde741f0defa019fd20d10459573c22df5a6d015bce49e6d00c825f5c3f
Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf4.92 GB7b064f5842bf9532c91456deda288a1b672397a54fa729aa665952863033557c
README.md24 Bd8d7a46d41a1a37fe4f0a5f637bf55c649310185329127d8a2204632e480be17
mmproj-ultravox-v0_5-llama-3_1-8b-f16.gguf1.38 GBe6395ed42124303eaa9fca934452aabce14c59d2a56fab2dda65b798442289ff
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
7a0280d66c pinned now2026-11-15 03:21 UTC4 files · 6.30 GB

Use it

$ fw get ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
# manifest sha256 e9cda18afe03… · 6.30 GB · 4 files
$ fw verify ./ultravox-v0_5-llama-3_1-8b-GGUF ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF.json --dir ./ultravox-v0_5-llama-3_1-8b-GGUF $ python3 fw.py verify ./ultravox-v0_5-llama-3_1-8b-GGUF ./ggml-org__ultravox-v0_5-llama-3_1-8b-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF --revision 7a0280d66c0700c366c2c26586e0f0967f97bad0 --local-dir ./ultravox-v0_5-llama-3_1-8b-GGUF
llama.cppDownload one GGUF variant (Meta-Llama-3.1-8B-Instruct-Q4_K_M, 4.92 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF --include "Meta-Llama-3.1-8B-Instruct-Q4_K_M*" --local-dir ./ultravox-v0_5-llama-3_1-8b-GGUF $ llama-server -m ./ultravox-v0_5-llama-3_1-8b-GGUF/Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./ultravox-v0_5-llama-3_1-8b-GGUF/Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf\n' > Modelfile $ ollama create ultravox-v0-5-llama-3-1-8b-gguf -f Modelfile
Run at home

License

Name
MIT License
Id
MIT
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
README.md
Text sha256
d8d7a46d41a1a37fe4f0a5f637bf55c649310185329127d8a2204632e480be17
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: ggml-org <huggingface.co/ggml-org>Newsgroups: alt.freeweights.llamaSubject: ultravox-v0_5-llama-3_1-8b-GGUFDate: 2026-11-15Commit: 7a0280dSigned: 2DC28CC7B26A283B ✓
Upstream
ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
Pinned commit
7a0280d66c0700c366c2c26586e0f0967f97bad0
Manifest
ultravox-v0_5-llama-3_1-8b-GGUF.json · .minisig
Manifest sha256
e9cda18afe03ed502175f8d81bb809938113e059decf0e37fe629a48dc59c74f
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 03:21 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF.json.minisig $ minisign -Vm ultravox-v0_5-llama-3_1-8b-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

No related models in this catalog.Nothing here lists this model as its parent, and it names no parent.
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. ultravox-v0_5-llama-3_1-8b-GGUF.json. Provenance. Takedown history: none.
Source
huggingface.co/ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF

Related models

All of alt.freeweights.llama →
From: BAAI <huggingface.co/BAAI>Subject: Bunny-Llama-3-8B-V
From: BAAI <huggingface.co/BAAI>Subject: Bunny-Llama-3-8B-V-gguf
From: BAAI <huggingface.co/BAAI>Subject: Bunny-v1_1-Llama-3-8B-V
From: unsloth <huggingface.co/unsloth>Subject: codellama-7b
From: unsloth <huggingface.co/unsloth>Subject: codellama-7b-bnb-4bit
From: BAAI <huggingface.co/BAAI>Subject: Infinity-Instruct-3M-0613-Llama3-70B