From: mudler <github.com/mudler>Newsgroups: alt.freeweights.toolsSubject:

LocalAI

Release: v4.12.1 (2026-10-23)Commit: ec92740License: MIT

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

inference enginev4.12.1releaseLocalAIGoMIT

FactsLicenseMITLanguageGoKindinference engineRelease2026-10-23PlatformsLinux, macOS, WindowsLinks to the projectpermissive

$ docker run -ti --name local-ai -p 8080:8080 localai/localai:latest

Overview Install Use with Freeweights License Provenance

Overview

Drop-in OpenAI-compatible API that runs text, image, audio and embedding models on your own hardware.

Kind: inference engine
License: MIT
Language: Go
Platforms: Linux, macOS, Windows
Latest release: v4.12.1 (2026-10-23)
Repository: mudler/LocalAI

Topicsagentsaiapiaudio-generationdecentralizeddistributedimage-generationlibp2pllamallmmambamcp

Freeweights links to the project and does not host tool binaries.

Install

$ docker run -ti --name local-ai -p 8080:8080 localai/localai:latest

$ docker run -ti --name local-ai -p 8080:8080 localai/localai:latest

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (8007)

135M-lc-100k-rope-12B a2-rl-e2egit_large-50-32B a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B a3-rl-DCAgent_mix_h2_language_proportional-65-8B a3-rl-DCAgent_mix_h4_binary_easy-50-8B a3-rl-laion_exp_rpt_ghactions-v3-20-8B a3-rl-laion_nemotron-gym-agent-calendar-80-8B abacusai_Smaug-Humanizer-GGUF ablation-pymethods2test-seqmean-arm0-tis-15-8B Accio-Lab_occamy-1.0-GGUF ACE-Step ACE-Step-v1-3.5B AesCode-32B AesCode-32B-GGUF AesCode-8B AesCode-8B-GGUF AFM-4.5B AFM-4.5B-Base AgentCPM-Explore-GGUF AgentCPM-Report AgentCPM-Report-GGUF agentica-org_DeepCoder-14B-Preview-GGUF agentica-org_DeepScaleR-1.5B-Preview-GGUF agentica-org_DeepSWE-Preview-GGUF Agents-A1-4B ai_vs_real_image_detection AI-Anime-Image-Detector-ViT AI21-Jamba-Reasoning-3B AI21-Jamba2-Mini ai21labs_AI21-Jamba-Reasoning-3B-GGUF ai21labs_AI21-Jamba2-Mini-GGUF ai9stars_G9v3-3B-GGUF alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF AlchemistCoder-L-7B AlchemistCoder-L-7B-GGUF Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r128 Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r64 Alexandria-Gemma-4-12B-it-Qwen27-Knowledge-Units-LoRA-r128 Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r128 Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r64 Alexandria-Gemma-4-E4B-it-Qwen27-Knowledge-Units-LoRA-r128 Alibaba-NLP_Tongyi-DeepResearch-30B-A3B-GGUF all-MiniLM-L6-v1 all-MiniLM-L6-v2 all-MiniLM-L6-v2-4bit all-mpnet-base-v1 ALLaM-7B-Instruct-preview allenai_Olmo-3-7B-Instruct-GGUF allenai_Olmo-3-7B-Think-GGUF allenai_Olmo-3.1-32B-Instruct-GGUF allenai_Olmo-3.1-32B-Think-GGUF allenai_olmOCR-2-7B-1025-GGUF allenai_olmOCR-7B-0225-preview-GGUF allenai-specter AM-Thinking-v1 AM-Thinking-v1-GGUF AMD-OLMo-1B

and 7947 more.

License

License: MIT
Class: Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: mudler <github.com/mudler>Newsgroups: alt.freeweights.toolsSubject: LocalAIRelease: v4.12.1 (2026-10-23)Commit: ec92740License: MIT

Repository: mudler/LocalAI
Pinned release: v4.12.1, 2026-10-23
Release commit: ec9274027eadd552d56f2c6c1fe86cd9216a991a
Default branch: master 062473903e068a3d0fc64f78ef09204aa61596e8
Fetched: 2026-11-14
Takedowns: None.

Freeweights links to the project and does not host tool binaries.

Get it

Install Project repository

Works with

8007 catalog models. See the list