From: containers <github.com/containers>Newsgroups: alt.freeweights.toolsSubject:

RamaLama

Release: v0.26.0 (2026-11-04)Commit: 066e9ccLicense: MIT

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

distributionv0.26.0releaseRamaLamaPythonMIT

FactsLicenseMITLanguagePythonKinddistributionRelease2026-11-04PlatformsLinux, macOS, WindowsLinks to the projectpermissive

$ pip install ramalama

Overview Install Use with Freeweights License Provenance

Overview

Runs models from registries inside containers, the way you run any other image.

Kind: distribution
License: MIT
Language: Python
Platforms: Linux, macOS, Windows
Latest release: v0.26.0 (2026-11-04)
Repository: containers/ramalama

Topicsaicontainerscudahacktoberfesthipinference-serverintelllamacppllmpodmanvllm

Freeweights links to the project and does not host tool binaries.

Install

$ pip install ramalama

$ pip install ramalama

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (1944)

abacusai_Smaug-Humanizer-GGUF Accio-Lab_occamy-1.0-GGUF AesCode-32B-GGUF AesCode-8B-GGUF AgentCPM-Explore-GGUF AgentCPM-Report-GGUF agentica-org_DeepCoder-14B-Preview-GGUF agentica-org_DeepScaleR-1.5B-Preview-GGUF agentica-org_DeepSWE-Preview-GGUF ai21labs_AI21-Jamba-Reasoning-3B-GGUF ai21labs_AI21-Jamba2-Mini-GGUF ai9stars_G9v3-3B-GGUF alamios_Mistral-Small-3.1-DRAFT-0.5B-GGUF AlchemistCoder-L-7B-GGUF Alibaba-NLP_Tongyi-DeepResearch-30B-A3B-GGUF allenai_Olmo-3-7B-Instruct-GGUF allenai_Olmo-3-7B-Think-GGUF allenai_Olmo-3.1-32B-Instruct-GGUF allenai_Olmo-3.1-32B-Think-GGUF allenai_olmOCR-2-7B-1025-GGUF allenai_olmOCR-7B-0225-preview-GGUF AM-Thinking-v1-GGUF AMD-OLMo-1B-SFT-DPO-GGUF AMD-OLMo-1B-SFT-GGUF Apertus-70B-Instruct-2509-GGUF Apertus-8B-Instruct-2509-GGUF Apexintelligence-AI_Apex-35B-V1.0-GGUF apodex_Apodex-1.1-mini-GGUF Apriel-1.5-15b-Thinker-GGUF Apriel-Nemotron-15b-Thinker-GGUF arcee-ai_AFM-4.5B-GGUF arcee-ai_Arcee-Maestro-7B-Preview-GGUF arcee-ai_GLM-4-32B-Base-32K-GGUF ATH-MaaS_OvisOCR2-GGUF AutoGLM-Phone-9B-GGUF BAAI_AREX-2-GGUF BAAI_AREX-Base-GGUF BAAI_AREX-Turbo-GGUF baichuan-inc_Baichuan-M2-32B-GGUF baidu_ERNIE-4.5-21B-A3B-PT-GGUF baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF Beam-1.0-501B-A23B-GGUF Beam-1.0-501B-A23B-GGUF bert-base-uncased bge-small-en-v1.5-GGUF Biggie-SmoLlm-0.4B BitCPM-CANN-0.5B-gguf BitCPM-CANN-1B-gguf BitCPM-CANN-3B-gguf BitCPM-CANN-8B-gguf BitCPM4-0.5B-GGUF BitCPM4-1B-GGUF bitnet-b1.58-2B-4T-gguf bitnet-embedding-0.6b bitnet-embedding-270m Bonsai-27B-GGUF Bunny-Llama-3-8B-V-gguf Bunny-v1_0-4B-gguf ByteDance-Seed_Seed-OSS-36B-Instruct-GGUF bytkim_Qwen3.8-27B-pi-GGUF

and 1884 more.

License

License: MIT
Class: Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: containers <github.com/containers>Newsgroups: alt.freeweights.toolsSubject: RamaLamaRelease: v0.26.0 (2026-11-04)Commit: 066e9ccLicense: MIT

Repository: containers/ramalama
Pinned release: v0.26.0, 2026-11-04
Release commit: 066e9cc7bbd6229abbe9e3b02b6b7f05151719df
Default branch: main 58c808965f181c3b7c3fa9c3f6061d25811c053a
Fetched: 2026-11-14
Takedowns: None.

Freeweights links to the project and does not host tool binaries.

Get it

Install Project repository

Works with

1944 catalog models. See the list