From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.textSubject: Jan-v3-4B-base-instruct-4bit Date: 2026-11-15Commit: 3f01bd8Signed: 2DC28CC7B26A283B ✓ Text generation model with 4B parameters. Safetensors weights, 2.27 GB in all. Published by mlx-community under Apache-2.0.
4B params 2.27 GB Jan-v3-4B-base-instruct-4bit safetensors permissive Facts Params 4B Size 2.27 GB Formats safetensors Task text generation License Apache-2.0 permissive
fw
$ fw get mlx-community/Jan-v3-4B-base-instruct-4bit
# manifest sha256 65ebffe2c4ca… · 2.27 GB · 9 files
$ fw verify ./Jan-v3-4B-base-instruct-4bit mlx-community/Jan-v3-4B-base-instruct-4bitHosted (signed) mlx-community/Jan-v3-4B-base-instruct-4bit Last check: 2026-11-15 05:12 UTC
Get help: custom fine-tune or private deploy. We review your setup before we quote.
Quantized of Jan-v3-4B-base-instruct .
Works with
Runs with Ranked by fit to this model (safetensors), then by GitHub stars.
Show all 24 Fine-tune with Show all 29
Overview
Size 2.27 GB
Weights 2.26 GB (safetensors)
Parameters 4B
Formats safetensors
Task text generation
License Apache-2.0 (permissive)
Files 9, each with a sha256
Publisher mlx-community
Added 2026-11-15
Section alt.freeweights.text Lineage
Original release from the publisher.
Base model: janhq/Jan-v3-4B-base-instruct
Where these bytes come from
Publisher at the pinned commit →You
Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.
Sources
Badge Host Last check Result huggingface.co 2026-11-15 05:12 UTC passed
Model card From the publisher at commit
3f01bd8 . Shown as plain text with links; images open at the publisher.
This model mlx-community/Jan-v3-4B-base-instruct-4bit was converted to MLX format from janhq/Jan-v3-4B-base-instruct using mlx-lm version 0.30.5 .
Use with mlx#
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/Jan-v3-4B-base-instruct-4bit")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True) Files 9 files · 2.27 GB Weights 2.26 GB (safetensors). Sizes and sha256 from the signed manifest.
Hide all 9 files with their sha256 File Size sha256 .gitattributes 1.57 KB 34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930 README.md 938 B 26b2558707275b14a9e048e67fb4624bc7f465991fff28eb86b4fa297d026704 chat_template.jinja 2.63 KB 64f85b198065d0fba2a81f37e10ed68161ce2c19a754c7100e67e0ca2ee9c326 config.json 1.98 KB be2605ecfd403a0c1dac46f9a25bf55629ec5e79d72c545a19cf43be20dc7f16 generation_config.json 213 B 4d9818c3d27895c0058828a5f68bc7a4de80c3ae1bcdac90936ce24178063f59 model.safetensors 2.26 GB 2f0c5584d52cde5ba7b9049cfc44fff40ef33d8a87a9b45dcdaebcbc304b2f34 model.safetensors.index.json 64.0 KB 388d811b8b7c2608dd04cce1bcb04a8bf715d19b42790894e6d3427ff429a777 tokenizer.json 11.4 MB be75606093db2094d7cd20f3c2f385c212750648bd6ea4fb2bf507a6a4c55506 tokenizer_config.json 740 B a93181447d1e8002d6c7697e3904607df4a30101bf678079471e2e28dc9fe00f
Versions Each time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commit Date Contents 3f01bd8939 pinned now 2026-11-15 05:12 UTC 9 files · 2.27 GB
Use it fw
$ fw get mlx-community/Jan-v3-4B-base-instruct-4bit
# manifest sha256 65ebffe2c4ca… · 2.27 GB · 9 files
$ fw verify ./Jan-v3-4B-base-instruct-4bit mlx-community/Jan-v3-4B-base-instruct-4bitfw.py Checks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/mlx-community/Jan-v3-4B-base-instruct-4bit.json --dir ./Jan-v3-4B-base-instruct-4bit
$ python3 fw.py verify ./Jan-v3-4B-base-instruct-4bit ./mlx-community__Jan-v3-4B-base-instruct-4bit.jsonhf The Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/Jan-v3-4B-base-instruct-4bit --revision 3f01bd893923ebaf455efe08942e57adc0c97296 --local-dir ./Jan-v3-4B-base-instruct-4bittransformers Load the weights in Python.
import os
os.environ["HF_ENDPOINT" ] = "https://freeweights.allternit.com"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("mlx-community/Jan-v3-4B-base-instruct-4bit", revision="3f01bd893923ebaf455efe08942e57adc0c97296")
model = AutoModelForCausalLM.from_pretrained("mlx-community/Jan-v3-4B-base-instruct-4bit", revision="3f01bd893923ebaf455efe08942e57adc0c97296", device_map="auto")vLLM Serve an OpenAI-compatible API.
$ HF_ENDPOINT =https://freeweights.allternit.com vllm serve mlx-community/Jan-v3-4B-base-instruct-4bit --revision 3f01bd893923ebaf455efe08942e57adc0c97296License Name Apache License 2.0 Id Apache-2.0 Class Permissive Redistribution yes Listing Hosted (signed) Decided License as declared by the publisher. No person read it. 2026-11-15 Text in README.md Text sha256 26b2558707275b14a9e048e67fb4624bc7f465991fff28eb86b4fa297d026704 Terms gate No extra terms beyond the license. Read the license text
Licenses are checked against the license table . A custom license passes only after a person reads it.
Provenance From: <huggingface.co/mlx-community> Newsgroups: alt.freeweights.textSubject: Jan-v3-4B-base-instruct-4bit Date: 2026-11-15Commit: 3f01bd8Signed: 2DC28CC7B26A283B ✓ How to verify
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/Jan-v3-4B-base-instruct-4bit.json
$ curl -O https://freeweights.allternit.com/manifests/mlx-community/Jan-v3-4B-base-instruct-4bit.json.minisig
$ minisign -Vm Jan-v3-4B-base-instruct-4bit.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq
$ shasum -a 256 <file> # compare with the Files tab A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download
Model tree No model in the catalog names this one as its parent.
Get it
$ HF_ENDPOINT =https://freeweights.allternit.com hf download mlx-community/Jan-v3-4B-base-instruct-4bitOpen in Freeweights Studio Pull, verify and run it in the Allternit app on Desktop, web or phone.
32.8B params 65.5 GB a2-rl-e2egit_large-50-32B safetensors permissive Facts Params 32.8B Size 65.5 GB Formats safetensors Task text generation License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a2-rl-e2egit_large-50-32B 8.2B params 16.5 GB a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B safetensors permissive Facts Params 8.2B Size 16.5 GB Formats safetensors Task not tagged License MIT permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B 8.2B params 16.4 GB a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B safetensors permissive Facts Params 8.2B Size 16.4 GB Formats safetensors Task reinforcement learning License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B 8.2B params 16.6 GB a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B safetensors permissive Facts Params 8.2B Size 16.6 GB Formats safetensors Task not tagged License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B 8.2B params 16.6 GB a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B safetensors permissive Facts Params 8.2B Size 16.6 GB Formats safetensors Task not tagged License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B 8.2B params 16.7 GB a3-rl-DCAgent_mix_h2_language_proportional-65-8B safetensors permissive Facts Params 8.2B Size 16.7 GB Formats safetensors Task not tagged License Apache-2.0 permissive flip From: laion <huggingface.co/laion> Subject: a3-rl-DCAgent_mix_h2_language_proportional-65-8B
mlx-community <huggingface.co/mlx-community>Newsgroups: alt.freeweights.textSubject: 
