From: InternLM <github.com/InternLM>Newsgroups: alt.freeweights.toolsSubject:

LMDeploy

Release: v0.18.0 (2026-09-28)Commit: 110965cLicense: Apache-2.0

Toolkit for compressing, deploying and serving language and vision-language models.

inference enginev0.18.0releaseLMDeployPythonApache-2.0

FactsLicenseApache-2.0LanguagePythonKindinference engineRelease2026-09-28PlatformsLinux (GPU), WindowsLinks to the projectpermissive

$ pip install lmdeploy
# use with Freeweights
$ lmdeploy serve api_server <id>

Overview Install Use with Freeweights License Provenance

Overview

Toolkit for compressing, deploying and serving language and vision-language models.

Kind: inference engine
License: Apache-2.0
Language: Python
Platforms: Linux (GPU), Windows
Latest release: v0.18.0 (2026-09-28)
Repository: InternLM/lmdeploy

Topicscodellamacuda-kernelsdeepspeedfastertransformerinternlmllamallama2llama3llmllm-inferenceturbomind

Freeweights links to the project and does not host tool binaries.

Install

$ pip install lmdeploy
# use with Freeweights
$ lmdeploy serve api_server <id>

$ pip install lmdeploy

Checked against the project's README on 2026-11-14. The project's own instructions win when they differ: install docs

Freeweights links to the project and does not host tool binaries.

Use with Freeweights

Run a catalog model

$ lmdeploy serve api_server <id>

Download the weights from Freeweights first (HF_ENDPOINT or fw.py), then point the tool at the folder.

Catalog models it can run (3137)

135M-lc-100k-rope-12B a2-rl-e2egit_large-50-32B AesCode-32B AesCode-8B AFM-4.5B AFM-4.5B-Base AgentCPM-Report Agents-A1-4B AI21-Jamba-Reasoning-3B AI21-Jamba2-Mini AlchemistCoder-L-7B Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r128 Alexandria-Gemma-4-12B-it-Ornith9-Summaries-LoRA-r64 Alexandria-Gemma-4-12B-it-Qwen27-Knowledge-Units-LoRA-r128 Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r128 Alexandria-Gemma-4-12B-it-Qwen27-Summaries-LoRA-r64 Alexandria-Gemma-4-E4B-it-Qwen27-Knowledge-Units-LoRA-r128 ALLaM-7B-Instruct-preview AM-Thinking-v1 AMD-OLMo-1B AMD-OLMo-1B-SFT AMD-OLMo-1B-SFT-DPO Apertus-70B-2509 Apertus-70B-Instruct-2509 Apertus-8B-2509 Apertus-8B-Instruct-2509 Apertus-8B-Instruct-2509-unsloth-bnb-4bit Apertus-v1.1-0.5B Apertus-v1.1-0.5B-Instruct Apertus-v1.1-1.5B Apertus-v1.1-1.5B-Instruct Apertus-v1.1-4B Apertus-v1.1-4B-Instruct Apex-35B-V1.0 Apodex-1.1-mini Apriel-1.5-15b-Thinker Apriel-1.6-15b-Thinker Apriel-Nemotron-15b-Thinker Aquila-135M-Intermediate Aquila-VL-2B-Intermediate AquilaDense-16B AquilaMoE AquilaMoE-SFT Arcee-Maestro-7B-Preview Arete-27B AREX-2 AREX-2-6bit AREX-Base AREX-Turbo AstaBrief_8B AstaBrief_8B_SFT Aurora-Code-1 Baguettotron Baichuan-M2-32B BAR-2x7B-Base BAR-2x7B-Code BAR-2x7B-Code-SFT BAR-2x7B-Math BAR-2x7B-Math-SFT BAR-2x7B-Safety

and 3077 more.

License

License: Apache-2.0
Class: Permissive

Read the license

Freeweights links to the project and does not host tool binaries.

Provenance

From: InternLM <github.com/InternLM>Newsgroups: alt.freeweights.toolsSubject: LMDeployRelease: v0.18.0 (2026-09-28)Commit: 110965cLicense: Apache-2.0

Repository: InternLM/lmdeploy
Pinned release: v0.18.0, 2026-09-28
Release commit: 110965c7706bbbeb31e21df5d7ef2531fe01c935
Default branch: main 442097e83799c2e85df9d6bbce35c7c79ea05dfe
Fetched: 2026-11-14
Takedowns: None.

Freeweights links to the project and does not host tool binaries.

Get it

Install Project repository

Works with

3137 catalog models. See the list