From: mozilla-ai <github.com/mozilla-ai>Newsgroups: alt.freeweights.toolsSubject:

llamafile

Release: 0.10.6 (2026-09-15)Commit: 017cdebLicense: Apache-2.0

Packs a model and its runtime into one file that runs on most operating systems.

inference engine0.10.6releasellamafileC++Apache-2.0

FactsLicenseApache-2.0LanguageC++Kindinference engineRelease2026-09-15PlatformsLinux, macOS, Windows, FreeBSDLinks to the projectpermissive

$ curl -L -o llamafile https://github.com/mozilla-ai/llamafile/releases/latest/download/llamafile

Overview Install Use with Freeweights License Provenance

Overview

Packs a model and its runtime into one file that runs on most operating systems.

Kind: inference engine
License: Apache-2.0
Language: C++
Platforms: Linux, macOS, Windows, FreeBSD
Latest release: 0.10.6 (2026-09-15)
Repository: mozilla-ai/llamafile

Topicscross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text

Freeweights links to the project and does not host tool binaries.

Install

$ curl -L -o llamafile https://github.com/mozilla-ai/llamafile/releases/latest/download/llamafile

$ curl -L -o llamafile https://github.com/mozilla-ai/llamafile/releases/latest/download/llamafile

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (1944)

abacusai_Smaug-Humanizer-GGUF Accio-Lab_occamy-1.0-GGUF AesCode-32B-GGUF AesCode-8B-GGUF AgentCPM-Explore-GGUF AgentCPM-Report-GGUF agentica-org_DeepCoder-14B-Preview-GGUF agentica-org_DeepScaleR-1.5B-Preview-GGUF agentica-org_DeepSWE-Preview-GGUF ai21labs_AI21-Jamba-Reasoning-3B-GGUF ai21labs_AI21-Jamba2-Mini-GGUF ai9stars_G9v3-3B-GGUF alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF AlchemistCoder-L-7B-GGUF Alibaba-NLP_Tongyi-DeepResearch-30B-A3B-GGUF allenai_Olmo-3-7B-Instruct-GGUF allenai_Olmo-3-7B-Think-GGUF allenai_Olmo-3.1-32B-Instruct-GGUF allenai_Olmo-3.1-32B-Think-GGUF allenai_olmOCR-2-7B-1025-GGUF allenai_olmOCR-7B-0225-preview-GGUF AM-Thinking-v1-GGUF AMD-OLMo-1B-SFT-DPO-GGUF AMD-OLMo-1B-SFT-GGUF Apertus-70B-Instruct-2509-GGUF Apertus-8B-Instruct-2509-GGUF Apexintelligence-AI_Apex-35B-V1.0-GGUF apodex_Apodex-1.1-mini-GGUF Apriel-1.5-15b-Thinker-GGUF Apriel-Nemotron-15b-Thinker-GGUF arcee-ai_AFM-4.5B-GGUF arcee-ai_Arcee-Maestro-7B-Preview-GGUF arcee-ai_GLM-4-32B-Base-32K-GGUF ATH-MaaS_OvisOCR2-GGUF AutoGLM-Phone-9B-GGUF BAAI_AREX-2-GGUF BAAI_AREX-Base-GGUF BAAI_AREX-Turbo-GGUF baichuan-inc_Baichuan-M2-32B-GGUF baidu_ERNIE-4.5-21B-A3B-PT-GGUF baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF Beam-1.0-501B-A23B-GGUF Beam-1.0-501B-A23B-GGUF bert-base-uncased bge-small-en-v1.5-GGUF Biggie-SmoLlm-0.4B BitCPM-CANN-0.5B-gguf BitCPM-CANN-1B-gguf BitCPM-CANN-3B-gguf BitCPM-CANN-8B-gguf BitCPM4-0.5B-GGUF BitCPM4-1B-GGUF bitnet-b1.58-2B-4T-gguf bitnet-embedding-0.6b bitnet-embedding-270m Bonsai-27B-GGUF Bunny-Llama-3-8B-V-gguf Bunny-v1_0-4B-gguf ByteDance-Seed_Seed-OSS-36B-Instruct-GGUF bytkim_Qwen3.8-27B-pi-GGUF

and 1884 more.

License

License: Apache-2.0
Class: Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: mozilla-ai <github.com/mozilla-ai>Newsgroups: alt.freeweights.toolsSubject: llamafileRelease: 0.10.6 (2026-09-15)Commit: 017cdebLicense: Apache-2.0

Repository: mozilla-ai/llamafile
Pinned release: 0.10.6, 2026-09-15
Release commit: 017cdeb4b7217c0fb44cc7b61f44bd8ab2749dd2
Default branch: main 334e66444a96d5429fd2d667301bd067029b1eb5
Fetched: 2026-11-14
Takedowns: None.

Freeweights links to the project and does not host tool binaries.

Get it

Install Project repository

Works with

1944 catalog models. See the list