From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.textSubject: llm-jp-4-8b-thinking-4bit Date: 2026-11-15Commit: c0f9483Signed: 2DC28CC7B26A283B ✓ Text generation model with 8.6B parameters. Safetensors weights, 4.85 GB in all. Published by mlx-community under Apache-2.0.
8.6B params 4.85 GB llm-jp-4-8b-thinking-4bit safetensors permissive Facts Params 8.6B Size 4.85 GB Formats safetensors Task text generation License Apache-2.0 permissive
fw
$ fw get mlx-community/llm-jp-4-8b-thinking-4bit
# manifest sha256 a3a42cf15b8d… · 4.85 GB · 11 files
$ fw verify ./llm-jp-4-8b-thinking-4bit mlx-community/llm-jp-4-8b-thinking-4bitHosted (signed) mlx-community/llm-jp-4-8b-thinking-4bit Last check: 2026-11-15 05:13 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of llm-jp-4-8b-thinking .
Works with
Runs with Ranked by fit to this model (safetensors), then by GitHub stars.
Show all 24 Fine-tune with Show all 29
Overview
Size 4.85 GB
Weights 4.83 GB (safetensors)
Parameters 8.6B
Formats safetensors
Task text generation
License Apache-2.0 (permissive)
Files 11, each with a sha256
Publisher mlx-community
Added 2026-11-15
Section alt.freeweights.text Lineage
Original release from the publisher.
Base model: llm-jp/llm-jp-4-8b-thinking
Where these bytes come from
Publisher at the pinned commit →You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
Badge Host Last check Result huggingface.co 2026-11-15 05:13 UTC passed
Model card From the publisher at commit
c0f9483 . Shown as plain text with links; images open at the publisher.
This model mlx-community/llm-jp-4-8b-thinking-4bit was converted to MLX format from llm-jp/llm-jp-4-8b-thinking using mlx-lm version 0.31.1 .
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/llm-jp-4-8b-thinking-4bit")
prompt = "こんにちは"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)pip install git+https://github.com/waybarrios/vllm-mlx.git
vllm-mlx serve mlx-community/llm-jp-4-8b-thinking-4bit --reasoning-parser gpt_oss --port 8000
vllm-mlx-chat --server-url http://localhost:8000or,
from openai import OpenAI
# Without API key (local development)
client = OpenAI(base_url="http://localhost:8000/v1", api_key="not-needed")
response = client.chat.completions.create(
model="default",
messages=[{"role": "user", "content": "こんにちは"}],
)
print(response.choices[0].message.content) Files 11 files · 4.85 GB Weights 4.83 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 11 files with their sha256 File Size sha256 .gitattributes 1.57 KB 34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930 README.md 1.69 KB f766dee82456fa260bf9d053e8f279f88455779b85ef8668c4053f858594cecb chat_template.jinja 17.0 KB 5d5e57261aef30a188c6fe8ac74e02de777f7e16a846485780d758f21f3e4093 config.json 938 B 959621f25fbe162f8b08e6db56062c9f5589274d125ce68f03d7a45f8de67db3 generation_config.json 111 B 9e28577f9e06c60184458fb81fef865cd061d85ab13ceb78b1161313734d7e30 llmjp4_harmony.py 4.18 KB 1a4e09c66b17d3a8d19bed6b43978b951ba01b5a62feef1a2893d1e4e40f7d2a llmjp4_tokenizer.py 3.88 KB 6bcbcf4e7088b4d2487cff4a47bda90e85d0440797a741667f016efbb13a34ed model.safetensors 4.83 GB 8ab22be3fa03721f4dcb23d460ef70dfc1278619bbfed582caaa5c2911aa07cc model.safetensors.index.json 52.4 KB 7a2da3f0aca0c638db05e5821bd00d51ba81b4373888d34f595ea31db7f54499 tokenizer.json 12.9 MB 15d5f21ae725fc96a5766271720bef30e132bfba89c11820a1e8612e5f643426 tokenizer_config.json 660 B b09257b66f588a49b204072c962a28fdefba1f0033d053432083ba42e9c83f97
Versions Each time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commit Date Contents c0f9483ea1 pinned now 2026-11-15 05:13 UTC 11 files · 4.85 GB
Use it fw
$ fw get mlx-community/llm-jp-4-8b-thinking-4bit
# manifest sha256 a3a42cf15b8d… · 4.85 GB · 11 files
$ fw verify ./llm-jp-4-8b-thinking-4bit mlx-community/llm-jp-4-8b-thinking-4bitfw.py Checks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/llm-jp-4-8b-thinking-4bit.json --dir ./llm-jp-4-8b-thinking-4bit
$ python3 fw.py verify ./llm-jp-4-8b-thinking-4bit ./mlx-community__llm-jp-4-8b-thinking-4bit.jsonhf The Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/llm-jp-4-8b-thinking-4bit --revision c0f9483ea14a6fb566f686882449d0ad4cf6d3e0 --local-dir ./llm-jp-4-8b-thinking-4bittransformers Load the weights in Python.
import os
os.environ["HF_ENDPOINT" ] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("mlx-community/llm-jp-4-8b-thinking-4bit", revision="c0f9483ea14a6fb566f686882449d0ad4cf6d3e0")
model = AutoModelForCausalLM.from_pretrained("mlx-community/llm-jp-4-8b-thinking-4bit", revision="c0f9483ea14a6fb566f686882449d0ad4cf6d3e0", device_map="auto")vLLM Serve an OpenAI-compatible API.
$ HF_ENDPOINT =https://freeweights.allternit.com vllm serve mlx-community/llm-jp-4-8b-thinking-4bit --revision c0f9483ea14a6fb566f686882449d0ad4cf6d3e0License Name Apache License 2.0 Id Apache-2.0 Class Permissive Redistribution yes Listing Hosted (signed) Decided License as declared by the publisher. No person read it. 2026-11-15 Text in README.md Text sha256 f766dee82456fa260bf9d053e8f279f88455779b85ef8668c4053f858594cecb Terms gate No extra terms beyond the license. Read the license text
Licenses are checked against the license table . A custom license passes only after a person reads it.
Provenance From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.textSubject: llm-jp-4-8b-thinking-4bit Date: 2026-11-15Commit: c0f9483Signed: 2DC28CC7B26A283B ✓ How to verify
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/llm-jp-4-8b-thinking-4bit.json
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/llm-jp-4-8b-thinking-4bit.json.minisig
$ minisign -Vm llm-jp-4-8b-thinking-4bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tab A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree No model in the catalog names this one as its parent.
Get it
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/llm-jp-4-8b-thinking-4bitOpen in Freeweights Studio Pull, verify and run it in the Allternit app on Desktop, web or phone.
32.8B params 65.5 GB a2-rl-e2egit_large-50-32B safetensors permissive Facts Params 32.8B Size 65.5 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a2-rl-e2egit_large-50-32B 8.2B params 16.5 GB a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B safetensors permissive Facts Params 8.2B Size 16.5 GB Formats safetensors Task not tagged License MIT permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B 8.2B params 16.4 GB a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B safetensors permissive Facts Params 8.2B Size 16.4 GB Formats safetensors Task reinforcement learning License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B 8.2B params 16.6 GB a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B safetensors permissive Facts Params 8.2B Size 16.6 GB Formats safetensors Task not tagged License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B 8.2B params 16.6 GB a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B safetensors permissive Facts Params 8.2B Size 16.6 GB Formats safetensors Task not tagged License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B 8.2B params 16.7 GB a3-rl-DCAgent_mix_h2_language_proportional-65-8B safetensors permissive Facts Params 8.2B Size 16.7 GB Formats safetensors Task not tagged License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_mix_h2_language_proportional-65-8B
mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.textSubject: 
