alt.freeweights.tools / Text Generation WebUI

From: oobabooga <github.com/oobabooga>Newsgroups: alt.freeweights.toolsSubject:

Text Generation WebUI

Release: v4.9 (2026-05-20)Commit: f9df9beLicense: AGPL-3.0

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

app or UIv4.9releaseText Generation WebUIPythonAGPL-3.0

FactsLicenseAGPL-3.0LanguagePythonKindapp or UIRelease2026-05-20PlatformsLinux, macOS, WindowsLinks to the projectcopyleft

$ git clone https://github.com/oobabooga/textgen
$ cd textgen
$ python -m venv venv
$ source venv/bin/activate
$ pip install -r requirements/portable/requirements.txt --upgrade
$ python server.py --portable --api --auto-launch

Overview Install Use with Freeweights License Provenance

Overview

Gradio web UI for running language models with several backends, chat and notebook modes.

Kind: app or UI
License: AGPL-3.0
Language: Python
Platforms: Linux, macOS, Windows
Latest release: v4.9 (2026-05-20)
Repository: oobabooga/textgen

Freeweights links to the project and does not host tool binaries.

Install

$ git clone https://github.com/oobabooga/textgen
$ cd textgen
$ python -m venv venv
$ source venv/bin/activate
$ pip install -r requirements/portable/requirements.txt --upgrade
$ python server.py --portable --api --auto-launch

$ git clone https://github.com/oobabooga/textgen
$ cd textgen
$ python -m venv venv
$ source venv/bin/activate
$ pip install -r requirements/portable/requirements.txt --upgrade
$ python server.py --portable --api --auto-launch

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (4579)

135M-lc-100k-rope-12B a2-rl-e2egit_large-50-32B Accio-Lab_occamy-1.0-GGUF AesCode-32B AesCode-32B-GGUF AesCode-8B AesCode-8B-GGUF AFM-4.5B AFM-4.5B-Base AgentCPM-Report agentica-org_DeepCoder-14B-Preview-GGUF agentica-org_DeepScaleR-1.5B-Preview-GGUF agentica-org_DeepSWE-Preview-GGUF Agents-A1-4B AI21-Jamba-Reasoning-3B AI21-Jamba2-Mini ai21labs_AI21-Jamba-Reasoning-3B-GGUF ai21labs_AI21-Jamba2-Mini-GGUF ai9stars_G9v3-3B-GGUF alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF AlchemistCoder-L-7B AlchemistCoder-L-7B-GGUF Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r128 Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r64 Alexandria-Gemma-4-12B-it-Qwen27-Knowledge-Units-LoRA-r128 Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r128 Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r64 Alexandria-Gemma-4-E4B-it-Qwen27-Knowledge-Units-LoRA-r128 Alibaba-NLP_Tongyi-DeepResearch-30B-A3B-GGUF ALLaM-7B-Instruct-preview allenai_Olmo-3-7B-Instruct-GGUF allenai_Olmo-3-7B-Think-GGUF allenai_Olmo-3.1-32B-Instruct-GGUF allenai_Olmo-3.1-32B-Think-GGUF allenai_olmOCR-2-7B-1025-GGUF allenai_olmOCR-7B-0225-preview-GGUF AM-Thinking-v1 AM-Thinking-v1-GGUF AMD-OLMo-1B AMD-OLMo-1B-SFT AMD-OLMo-1B-SFT-DPO AMD-OLMo-1B-SFT-DPO-GGUF AMD-OLMo-1B-SFT-GGUF Apertus-70B-2509 Apertus-70B-Instruct-2509 Apertus-70B-Instruct-2509-GGUF Apertus-8B-2509 Apertus-8B-Instruct-2509 Apertus-8B-Instruct-2509-GGUF Apertus-8B-Instruct-2509-unsloth-bnb-4bit Apertus-v1.1-0.5B Apertus-v1.1-0.5B-Instruct Apertus-v1.1-1.5B Apertus-v1.1-1.5B-Instruct Apertus-v1.1-4B Apertus-v1.1-4B-Instruct Apex-35B-V1.0 Apexintelligence-AI_Apex-35B-V1.0-GGUF apodex_Apodex-1.1-mini-GGUF Apodex-1.1-mini

and 4519 more.

License

License: AGPL-3.0
Class: Copyleft (GPL)

AGPL-3.0, a copyleft license: if you run a modified version as a network service you must publish its source.

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: oobabooga <github.com/oobabooga>Newsgroups: alt.freeweights.toolsSubject: Text Generation WebUIRelease: v4.9 (2026-05-20)Commit: f9df9beLicense: AGPL-3.0

Repository: oobabooga/textgen
Pinned release: v4.9, 2026-05-20
Release commit: f9df9be98267a79b57617d287d6d0638823116d4
Default branch: main c93f8871239550de2ccfe1e95d469aa82616f07e
Fetched: 2026-11-14
Takedowns: None.

Freeweights links to the project and does not host tool binaries.

Get it

Install Project repository

Works with

4579 catalog models. See the list