alt.freeweights.image / FLUX.2-klein-base-4B-GGUF
From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.imageSubject:

FLUX.2-klein-base-4B-GGUF

Date: 2026-11-15Commit: 2ea5cccSigned: 2DC28CC7B26A283B ✓

Image to image model. Gguf weights, 51.3 GB in all. Published by unsloth under Apache-2.0.

image51.3GBFLUX.2-klein-base-4B-GGUFggufpermissive
FactsParamsnot statedSize51.3 GBFormatsggufTaskimage to imageLicenseApache-2.0From sourcepermissive
$ fw get unsloth/FLUX.2-klein-base-4B-GGUF
# manifest sha256 4e53c02a2ae0… · 51.3 GB · 21 files
$ fw verify ./FLUX.2-klein-base-4B-GGUF unsloth/FLUX.2-klein-base-4B-GGUF
From sourceHosted (signed)unsloth/FLUX.2-klein-base-4B-GGUFLast check: 2026-11-15 04:44 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Quantized of FLUX.2-klein-base-4B.

Works with

Convert with

Scan with

Overview

Size
51.3 GB
Weights
1.45 GB (smallest of 15 GGUF variants)
Parameters
not stated
Formats
gguf
Task
image to image
License
Apache-2.0 (permissive)
Files
21, each with a sha256
Publisher
unsloth
Added
2026-11-15
Section
alt.freeweights.image
Lineage

Original release from the publisher.

Base model: black-forest-labs/FLUX.2-klein-base-4B

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 04:44 UTCpassed

Model card

From the publisher at commit 2ea5ccc. Shown as plain text with links; images open at the publisher.

This is a GGUF quantized version of FLUX.2-klein-base-4B.

unsloth/FLUX.2-klein-base-4B-GGUF uses Unsloth Dynamic 2.0 methodology for SOTA performance.

  • Important layers are upcasted to higher precision.
  • Uses tooling from ComfyUI-GGUF by city96.

https://github.com/unslothai/unsloth/ https://discord.gg/unsloth https://docs.unsloth.ai/basics/unsloth-dynamic-2.0-ggufs


Image: Teaser Image: Teaser Image: Teaser

The FLUX.2 [klein] model family are our fastest image models to date. FLUX.2 [klein] unifies generation and editing in a single compact architecture, delivering state-of-the-art quality with end-to-end inference in as low as under a second. Built for applications that require real-time image generation without sacrificing quality, and runs on consumer hardware, with as little as 13GB VRAM.

FLUX.2 [klein] 4B Base is a 4 billion parameter rectified flow transformer capable of generating images from text descriptions and supports multi-reference editing capabilities.

It's a full-capacity foundation model. Undistilled, preserving complete training signal for maximum flexibility. Ideal for fine-tuning, LoRA training, research, and custom pipelines where control matters more than speed. Higher output diversity than the distilled models.

For more information, please read our blog post.

Key Features#

  1. Exceptional speed and quality-to-size ratio.
  2. Ideal for local deployment and fine-tuning on limited hardware.
  3. Trained without step or guidance distillation, making FLUX.2 [klein] 4B Base more efficient and flexible.
  4. Open weights for customization and fine-tuning to drive science, research, and empower artists to iterate with speed.
  5. Outputs can be used for commercial purposes, as described in the Apache 2.0 license.

Usage#

We provide a reference implementation of FLUX.2 [klein] 4B Base, as well as sampling code, in a dedicated GitHub repository. Developers and creatives looking to build on top of FLUX.2 [klein] 4B Base are encouraged to use this as a starting point.

FLUX.2 [klein] 4B Base is also available in both ComfyUI and Diffusers.

Using with Diffusers 🧨#

To use FLUX.2 [klein] 4B Base with the 🧨 Diffusers python library, first install or upgrade diffusers:

pip install -U diffusers

Then you can use Flux2KleinPipeline to run the model:

import torch
from diffusers import Flux2KleinPipeline

device = "cuda"
dtype = torch.bfloat16

pipe = Flux2KleinPipeline.from_pretrained("black-forest-labs/FLUX.2-klein-base-4B", torch_dtype=dtype)
pipe.enable_model_cpu_offload()  # save some VRAM by offloading the model to CPU

prompt = "A cat holding a sign that says hello world"
image = pipe(
    prompt,
    height=1024,
    width=1024,
    guidance_scale=4.0,
    num_inference_steps=50,
    generator=torch.Generator(device=device).manual_seed(0)
).images[0]
image.save("flux-klein.png")

Limitations

  • This model is not intended or able to provide factual information.
  • While the model can output text, text rendered may be inaccurate or subject to distortion.
  • As a statistical model, this checkpoint may represent or amplify biases observed in the training data.
  • The model may fail to generate output that matches the prompts.
  • Prompt following is heavily influenced by the prompting style.

Out-of-Scope Use

The model and its derivatives may not be used:

  • In any way that violates applicable law.
  • For the purpose of exploiting, harming or attempting to exploit or harm minors in any way; including but not limited to the solicitation, creation, acquisition, or dissemination of child exploitative content.
  • To generate or disseminate deceptive, fraudulent, misleading or otherwise harmful content.
  • To generate or disseminate personal identifiable information that can be used to harm an individual.
  • To harass, abuse, threaten, stalk, or bully individuals or groups of individuals.
  • To create non-consensual intimate imagery or illegal pornographic content.
  • For fully automated decision making or high risk applications that adversely impact an individual's legal rights or otherwise create or modify a binding, enforceable obligation.

Nothing contained in this Model Card should be interpreted as or deemed a restriction or modification to the license the model is released under.

Hardware#

The FLUX.2 [klein] 4B Base model fits in ~13GB VRAM and is accessible on NVIDIA RTX 3090/4070 and above.


Responsible AI Development#

Black Forest Labs is committed to the responsible development and deployment of our models. Prior to releasing the FLUX.2 family of models, we evaluated and mitigated a number of risks in our model checkpoints and hosted services, including the generation of unlawful content, including child sexual abuse material (CSAM) and nonconsensual intimate imagery (NCII). We implemented a series of pre-release mitigations to help prevent misuse by third parties, with additional post-release mitigations to help address residual risks:

  1. Pre-training mitigation. We filtered pre-training data for multiple categories of "not safe for work" (NSFW) and known child sexual abuse material (CSAM) to help prevent a user generating unlawful content in response to text prompts or uploaded images. We have partnered with the https://www.iwf.org.uk/, an independent nonprofit organization dedicated to preventing online abuse, to filter known CSAM from the training data.
  2. Post-training mitigation. Subsequently, we undertook multiple rounds of targeted fine-tuning to provide additional mitigation against potential abuse, including both text-to-image (T2I) and image-to-image (I2I) attacks. By inhibiting certain behaviors and suppressing certain concepts in the trained model, these techniques can help to prevent a user generating synthetic CSAM or NCII from a text prompt, or transforming an uploaded image into synthetic CSAM or NCII.
  3. Ongoing evaluation. Throughout this process, we conducted multiple internal and external third-party evaluations of model checkpoints to identify further opportunities for mitigation. External third-party evaluations focused on eliciting CSAM and NCII through adversarial testing with (i) text-only prompts, (ii) a single uploaded reference image with text prompts, and (iii) multiple uploaded reference images with text prompts. Based on this feedback, we conducted further safety fine-tuning to produce our open-weight FLUX.2 [klein] models.
  4. Release decision. After safety fine-tuning and prior to release, we conducted a final third-party evaluation of the proposed release checkpoints, focused on T2I and I2I generation of synthetic CSAM and NCII, including a comparison with other open-weight T2I and I2I models. The final FLUX.2 [klein] checkpoints demonstrated high resilience against violative inputs in complex generation and editing tasks, and demonstrated higher resilience than leading open-weight models across these risk categories. Based on these findings, we approved the release of the open-weight FLUX.2 [klein] 4B models under an Apache 2.0 license and the release of the FLUX.2 [klein] 9B models under a non-commercial license to support third-party research and development.
  5. Inference filters. The repository for the FLUX.2 [klein] models includes filters for NSFW and protected content in inputs and outputs. Filters or manual review must be used with the FLUX.2 [klein] 9B models under the terms of the FLUX Non-Commercial License, and we encourage deployers to implement these mitigations when using the FLUX.2 [klein] 4B models. Where we implement these features on our own hosted services, we may apply multiple filters to intercept text prompts, uploaded images, and output images. We utilize both in-house and third-party filters to mitigate against harmful outputs, such as CSAM and NCII outputs, including filters provided by https://thehive.ai/ and https://www.microsoft.com/.
  6. Content provenance. Content provenance features can help users and platforms better identify, label, and interpret AI-generated content online. The inference code for FLUX.2 [klein] implements an example of pixel-layer watermarking. Additionally, this repository includes links to the https://c2pa.org/ standard for metadata. The API for FLUX.2 [klein] applies cryptographically-signed C2PA metadata to downloaded output content to indicate that images were produced with our model.
  7. Policies. Acceptable use of our models and access to our API are governed by policies set out in applicable documentation, including FLUX Non-Commercial License (for our non-commercial open-weight users); Developer Terms of Service, Self-Hosted Commercial License Terms, and Usage Policy (for our commercial open-weight model users); and Developer Terms of Service, FLUX API Service Terms, and Usage Policy (for our API users). These prohibit the generation of unlawful content or the use of generated content for unlawful, defamatory, or abusive purposes. Developers and users must consent to these conditions to access the FLUX.2 [klein] 9B models on Hugging Face.
  8. Safety. Black Forest Labs takes model safety seriously. We provide a dedicated email address (safety@blackforestlabs.ai) to solicit feedback from the community. We maintain a reporting relationship with organizations such as the https://www.iwf.org.uk/ and the https://www.missingkids.org/, and welcome ongoing engagement with authorities, developers, and researchers to share intelligence about emerging risks and develop effective mitigations.

License#

This model is licensed under the https://www.apache.org/licenses/LICENSE-2.0.

Trademarks & IP

This project may contain trademarks or logos for projects, products, or services. Use of Black Forest Labs and FLUX trademarks or logos in modified versions of this project must not cause confusion or imply sponsorship or endorsement. Any use of third-party trademarks, intellectual property or logos are subject to those third-party's policies.

Files

21 files · 51.3 GBWeights 1.45 GB (smallest of 15 GGUF variants). Sizes and sha256 from the signed manifest.
Show all 21 files with their sha256
FileSizesha256
.gitattributes2.68 KB8a4846ff3c5e3433a7046824c61ec255b2439eaf9171972e598b4994a11009ad
LICENSE.md9.58 KBca02bc51900ab07789d1b70283329e7137f5af98f5161c23a1c81fc38a4af1fe
README.md11.2 KB547419bbcc238806e410de1a740d4117122b198f70f91d95b9c80dd595bb5cae
editing.jpg2.51 MB2912ca5a7cb9ccbdc8627f8123894d28d8d5e5b0425e8907b3c8111659885ce0
flux-2-klein-base-4b-BF16.gguf7.75 GB1534bcd075bf6f241242110af5bdbdf5e13ea83d6fe9105f8f24235743de8ceb
flux-2-klein-base-4b-F16.gguf7.75 GB4f4d02a566fca0afa097f7c3f9ea9871d78f06c65df611b8a52c9e719a63abee
flux-2-klein-base-4b-Q2_K.gguf1.45 GB3f91a8995e3210614be678b79c9af86776003452e2cd78992180aff71cbbd3e2
flux-2-klein-base-4b-Q3_K_M.gguf2.12 GB88b7f7191ece79596be78a69fddcba45bd93d01ffaae2751b231ee5e8ee23be8
flux-2-klein-base-4b-Q3_K_S.gguf2.10 GBd3b4eb65483d000c525ce5d13ac94f01eb65cc49c55d6d925c2dadcb4bcfe0f9
flux-2-klein-base-4b-Q4_0.gguf2.46 GB8da333a34b7f7f45333f63a39abf4e6093d8de9d7b312275a3377d9ffab332c8
flux-2-klein-base-4b-Q4_1.gguf2.69 GBd66a07fda556c779b77ff4886df45d4bf161f2d48982130c394ca4f9e4a9cd34
flux-2-klein-base-4b-Q4_K_M.gguf2.42 GB5e3893a005ec1b0515ba6c23f6a93bec37ddf7fd2dfcf101fef4e19bc53c3a1c
flux-2-klein-base-4b-Q4_K_S.gguf2.58 GB2e81d56fd18dd3a46e6a458c20af1cb49662ea1976d4142694db7e5985b06863
flux-2-klein-base-4b-Q5_0.gguf2.92 GB1af333e130665a79e45a0f1a0f61ae1a56e00972e86269a0d1bcf97b9b5fddfc
flux-2-klein-base-4b-Q5_1.gguf3.15 GB6a1e0fdc4b89d99ef0f7c0e5a65ef85e65e4dcabd8af27a126808bfb781d9811
flux-2-klein-base-4b-Q5_K_M.gguf3.07 GB1252620f38658466150f60654a3430ff31ed516f29fc837ee3db66713ee3474c
flux-2-klein-base-4b-Q5_K_S.gguf3.05 GB9c7f454c3242ee1839e2fb08585f6751e9e45f8c2020c782b5023d52396398ee
flux-2-klein-base-4b-Q6_K.gguf3.39 GB668846b03628917063f086125aab68f2dd1af822ac6452b75330fa549c9e976f
flux-2-klein-base-4b-Q8_0.gguf4.42 GBb70242e2643f7619f667d41e21691dc462162db72992aab4f230e6f94de3fbce
others.jpg3.39 MB78caed191515181abe87c10b6303a0fb58ae5518b8e7c7ed5847f406b377a0e4
realism.jpg2.86 MB6cccc69a683c3f650eb149a006be54cdcd42eb92b367d2b8e65939d486d1946a
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
2ea5cccd7d pinned now2026-11-15 04:44 UTC21 files · 51.3 GB

Use it

$ fw get unsloth/FLUX.2-klein-base-4B-GGUF
# manifest sha256 4e53c02a2ae0… · 51.3 GB · 21 files
$ fw verify ./FLUX.2-klein-base-4B-GGUF unsloth/FLUX.2-klein-base-4B-GGUF
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/unsloth/FLUX.2-klein-base-4B-GGUF.json --dir ./FLUX.2-klein-base-4B-GGUF $ python3 fw.py verify ./FLUX.2-klein-base-4B-GGUF ./unsloth__FLUX.2-klein-base-4B-GGUF.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/FLUX.2-klein-base-4B-GGUF --revision 2ea5cccd7d42769c39a848d55a6ebe5987b97354 --local-dir ./FLUX.2-klein-base-4B-GGUF
llama.cppDownload one GGUF variant (flux-2-klein-base-4b-Q2_K, 1.45 GB), then serve it.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/FLUX.2-klein-base-4B-GGUF --include "flux-2-klein-base-4b-Q2_K*" --local-dir ./FLUX.2-klein-base-4B-GGUF $ llama-server -m ./FLUX.2-klein-base-4B-GGUF/flux-2-klein-base-4b-Q2_K.gguf
OllamaMake an Ollama model from the downloaded file.
$ printf 'FROM ./FLUX.2-klein-base-4B-GGUF/flux-2-klein-base-4b-Q2_K.gguf\n' > Modelfile $ ollama create flux.2-klein-base-4b-gguf -f Modelfile
Packaged for ComfyUI. Most image, video and music models run in ComfyUI . Check the publisher's page for the workflow. Freeweights does not host it.

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
LICENSE.md
Text sha256
ca02bc51900ab07789d1b70283329e7137f5af98f5161c23a1c81fc38a4af1fe
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: unsloth <huggingface.co/unsloth>Newsgroups: alt.freeweights.imageSubject: FLUX.2-klein-base-4B-GGUFDate: 2026-11-15Commit: 2ea5cccSigned: 2DC28CC7B26A283B ✓
Upstream
unsloth/FLUX.2-klein-base-4B-GGUF
Pinned commit
2ea5cccd7d42769c39a848d55a6ebe5987b97354
Manifest
FLUX.2-klein-base-4B-GGUF.json · .minisig
Manifest sha256
4e53c02a2ae0bbd4b5e7d2ab8210e3a36c2ae0465f9721b8e45d646c0f7e0f1e
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 04:44 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/unsloth/FLUX.2-klein-base-4B-GGUF.json $ curl -O https://freeweights.allternit.com/manifests/unsloth/FLUX.2-klein-base-4B-GGUF.json.minisig $ minisign -Vm FLUX.2-klein-base-4B-GGUF.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

Parent

black-forest-labs/FLUX.2-klein-base-4B · this model is a quantization of it

No model in the catalog names this one as its parent.

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download unsloth/FLUX.2-klein-base-4B-GGUF
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. FLUX.2-klein-base-4B-GGUF.json. Provenance. Takedown history: none.
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: Boogu-Image
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: Chroma1-HD
From: lodestones <huggingface.co/lodestones>Subject: Chroma1-HD
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: Chroma1-Radiance
From: Comfy-Org <huggingface.co/Comfy-Org>Subject: ERNIE-Image
From: baidu <huggingface.co/baidu>Subject: ERNIE-Image