alt.freeweights.text / Darwin-36B-Opus
From: FINAL-Bench <huggingface.co/FINAL-Bench>Newsgroups: alt.freeweights.textSubject:

Darwin-36B-Opus

Date: 2026-11-15Commit: ebc6cbeSigned: 2DC28CC7B26A283B ✓

Text generation model with 34.7B parameters. Safetensors weights, 69.4 GB in all. Published by FINAL-Bench under Apache-2.0.

34.7B params69.4GBDarwin-36B-Opussafetensorspermissive
FactsParams34.7BSize69.4 GBFormatssafetensorsTasktext generationLicenseApache-2.0From sourcepermissive
$ fw get FINAL-Bench/Darwin-36B-Opus
# manifest sha256 29a3ebcb8fdc… · 69.4 GB · 34 files
$ fw verify ./Darwin-36B-Opus FINAL-Bench/Darwin-36B-Opus
From sourceHosted (signed)FINAL-Bench/Darwin-36B-OpusLast check: 2026-11-15 03:33 UTC

Get help: custom fine-tune or private deploy. We review your setup before we quote.

Works with

Overview

Size
69.4 GB
Weights
69.3 GB (safetensors)
Parameters
34.7B
Formats
safetensors
Task
text generation
License
Apache-2.0 (permissive)
Files
34, each with a sha256
Publisher
FINAL-Bench
Added
2026-11-15
Section
alt.freeweights.text
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commitโ†’You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-15 03:33 UTCpassed

Model card

From the publisher at commit ebc6cbe. Shown as plain text with links; images open at the publisher.
๐Ÿ“ฑ Run it on your phone or a GPU-less PC โ†’ POCKET ยท ๐Ÿš€ Try it live (CPU chat)#

POCKET is quantized straight from this model. VIDRAFT's on-device family: a 35B model that runs on iPhone and on CPU with no GPU โ€” stock llama.cpp, no fork.

Live demo Collection 35B KR MLX EN

Darwin-36B-Opus: Darwin V7 Evolutionary Merge on Qwen3.6-35B-A3B โ€” 88.4% on GPQA Diamond#

GPQA Sibling

Genesis 9B 27B 31B

36B

Family FINAL Bench

Qwen3.6-35B-A3B MoE | 36B total / 3B active | Thinking Mode | 262K Context | Multilingual | BF16 | Apache 2.0 Darwin V7 evolutionary merge: base parent ร— reasoning-distilled parent โ†’ 88.4% on GPQA Diamond


Abstract#

Darwin-36B-Opus is a 36-billion-parameter mixture-of-experts (MoE) language model produced by the Darwin V7 evolutionary breeding engine from two publicly available parents:

Darwin V7 recombines these two parents into a single descendant that preserves the reasoning parent's distilled chain-of-thought behavior while retaining the structural fidelity of the base parent's expert topology. The breeding process is fully automated and produces a deployable bfloat16 checkpoint in under an hour on a single GPU.

On the GPQA Diamond benchmark โ€” 198 graduate-level questions in physics, chemistry, and biology โ€” Darwin-36B-Opus achieves 88.4%, establishing it as the highest-performing model in the Darwin family and extending the series' record of producing state-of-the-art open models through evolution rather than retraining.


GPQA Diamond Leaderboard (April 23, 2026)#

RankModelParametersGPQA Diamond
1TNSA/NGen-4-Proโ€”91.1%
2TNSA/NGen-4โ€”90.1%
3Qwen/Qwen3.5-397B-A17B397B88.4%
3FINAL-Bench/Darwin-36B-Opus36B (A3B)88.4%
5moonshotai/Kimi-K2.5โ€”87.6%
6FINAL-Bench/Darwin-27B-Opus27B86.9%
7Qwen/Qwen3.5-122B-A10B122B86.6%
8zai-org/GLM-5.1744B86.2%
9zai-org/GLM-5744B86.0%
10zai-org/GLM-4.7โ€”85.7%

A 36B-parameter MoE model (3B active), tying the 397B dense-equivalent Qwen3.5-397B-A17B and surpassing flagship dense and sparse systems an order of magnitude larger.


What Is Darwin?#

Darwin is the evolutionary model breeding engine developed by FINAL-Bench / VIDRAFT_LAB. Rather than allocating further compute to gradient optimization, Darwin treats trained checkpoints as a genetic pool and discovers high-performing descendants through principled recombination of their weight tensors.

Each Darwin generation (v1 through v7+) refines the breeding procedure. Darwin V7 is the current generation and the one used to produce this model. Specific algorithmic details of V7 are proprietary to FINAL-Bench; at a high level, the engine performs:

  1. Per-tensor compatibility analysis of the two parents to identify which components transfer cleanly and which require weighted recombination.
  2. Automated recombination guided by that analysis, producing a single coherent descendant.
  3. Verification via a multi-phase scientific benchmark before release.

All Darwin models are released under Apache 2.0 and inherit fully from the parents' open-source licenses.


Parent Models#

๐Ÿ”ต Base parent โ€” Qwen/Qwen3.6-35B-A3B#
  • Model type: Qwen3.6 MoE, 35B total / ~3B active parameters
  • Layers: 40, Hidden size: 2048
  • Attention: hybrid 75% Gated DeltaNet + 25% Gated Attention (alternating)
  • Experts: 256 routed (top-8) + 1 shared per layer
  • Native scores: MMLU-Pro 85.2%, GPQA 86.0%, AIME26 92.7%
  • Role: Structural backbone and MoE topology donor.
๐Ÿ”ด Reasoning parent โ€” hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled#
  • Method: LoRA SFT on the base over 14,233 reasoning chain-of-thought samples
  • Training regime: qwen3-thinking template, response-only masking
  • Native score: MMLU-Pro (70 limit-5) 75.71%, +32.85 percentage points over the un-distilled base baseline
  • Role: Reasoning signal donor โ€” the source whose <think> trajectories Darwin preserves.

Evolution Process (High Level)#

Darwin V7 produces the descendant through a deterministic recombination that does not require gradient optimization on the final assembly. The engine analyzes each tensor in both parents, classifies it by architectural role, and assigns a recombination weight appropriate to that role โ€” biasing toward the reasoning parent for components that carry reasoning behavior, while preserving the base parent's structural contributions where they dominate.

Total breeding time on a single B200 GPU: under 10 minutes.


GPQA Diamond Evaluation#

Methodology#

We employed a two-pass adaptive evaluation protocol (identical across all Darwin Opus models to preserve cross-model comparability):

Pass 1 โ€” Greedy Baseline

  • All 198 GPQA Diamond questions, deterministic decoding (do_sample=False)
  • Maximum 5,120 new tokens per question (allows full <think> trajectories)
  • Standard multiple-choice prompt format

Pass 2 โ€” Stochastic Retry with Tiebreaker

  • Questions incorrectly answered in Pass 1 are re-evaluated with majority-of-8 stochastic generations (temperature=0.7, max_tokens=5120)
  • Where the vote margin is inconclusive (3:3, 3:4, or 4:4), an additional 16-vote combined tiebreaker round (temperature=0.5) resolves the answer

Evaluation was performed in parallel across 8 ร— NVIDIA B200 GPUs, each running an independent full copy of the model on a disjoint subset of the benchmark (round-robin question assignment).

Aggregate Results#
PhaseCumulative CorrectAccuracyฮ”
Pass 1 โ€” Greedy Baseline145/19873.2%baseline
Pass 2 โ€” Stochastic Retry175/19888.4%+15.2 percentage points

The Pass-2 gain of +30 questions (+15.2 pp) demonstrates that the reasoning parent's inherited <think> reasoning yields substantially more correct answers under stochastic decoding than under greedy, confirming that the evolutionary merge preserved reasoning depth.

Results by Shard#
GPUQuestionsPass 1 GreedyFinal
GPU02517/25 (68.0%)22/25 (88.0%)
GPU12517/25 (68.0%)20/25 (80.0%)
GPU22519/25 (76.0%)23/25 (92.0%)
GPU32521/25 (84.0%)25/25 (100.0%) โญ
GPU42520/25 (80.0%)23/25 (92.0%)
GPU52517/25 (68.0%)22/25 (88.0%)
GPU62417/24 (70.8%)20/24 (83.3%)
GPU72417/24 (70.8%)20/24 (83.3%)
Total198145/198 (73.2%)175/198 (88.4%)

Notably, GPU3 achieved a perfect 25/25 score on its 25-question partition โ€” every Pass-1 error on that shard was successfully recovered through the stochastic retry cascade.


Usage#

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

tok = AutoTokenizer.from_pretrained("FINAL-Bench/Darwin-36B-Opus", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    "FINAL-Bench/Darwin-36B-Opus",
    torch_dtype=torch.bfloat16,
    device_map="auto",
    trust_remote_code=True,
)

messages = [
    {"role": "user", "content": "Derive the equation for relativistic kinetic energy."}
]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tok(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=5120, temperature=0.6, do_sample=True)
print(tok.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
Answer Extraction for Evaluations#

This is a thinking model โ€” responses always begin with a <think> reasoning trace. For benchmarks, extract the final answer after </think>:

response = tok.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True)
idx = response.rfind("</think>")
answer_part = response[idx + len("</think>"):].strip() if idx >= 0 else response
  • Temperature: 0.6โ€“0.7 for reasoning / majority voting; 0.0 for greedy deterministic
  • max_new_tokens: โ‰ฅ5120 to accommodate full <think> trajectories
  • Chat template: <|im_start|>assistant\n<think>\n auto-inserted by apply_chat_template(add_generation_prompt=True)

Model Specifications#

ArchitectureQwen3MoE (Qwen3.6 codebase)
Total parameters36.0 B
Active parameters~3 B (top-8 of 256 routed experts per layer)
Layers40
Hidden size2048
Attention heads24 Q + 4 KV (GQA)
Head dimension256
Experts per layer256 routed + 1 shared
Context length262,144 tokens
Vocabulary248,320
Dtypebfloat16
Checkpoint size~65 GB (21 shards)
LicenseApache 2.0

VRAM Requirements#

PrecisionVRAMRecommended GPU
bf16 (full)~72 GB1ร— H100 80GB / 1ร— B200
8-bit~40 GB1ร— A100 40GB+ / 1ร— L40S
4-bit~22 GB1ร— RTX 4090 / 1ร— A10

Darwin Model Family#

ModelBaseParamsGPQA Diamond
Darwin-4B-GenesisQwen3.5-4B4 Bโ€”
Darwin-9B-OpusQwen3.5-9B9 Bโ€”
Darwin-27B-OpusQwen3.5-27B27 B86.9%
Darwin-31B-OpusGemma2-27B ร— variants31 B85.9%
Darwin-36B-OpusQwen3.6-35B-A3B36 B (A3B)88.4% โญ

Key Findings#

  1. Evolutionary merging continues to scale. Across three successive parameter tiers (27B โ†’ 31B โ†’ 36B), each new Darwin Opus model surpasses the prior one's GPQA Diamond score while maintaining the same zero-training methodology.
  2. Hybrid-attention MoE preserves reasoning under recombination. The base parent's 75% Gated-DeltaNet + 25% Gated-Attention architecture, inherited intact, demonstrates robustness to tensor-level recombination โ€” a notable result given that MoE expert routing is sensitive to weight perturbation.
  3. Stochastic retry closes the greedy gap. The +15.2 percentage-point lift from Pass 1 (73.2%) to Pass 2 (88.4%) suggests that the reasoning parent's distilled reasoning is consistently present but occasionally greedy-subdominant โ€” a pattern characteristic of well-distilled chain-of-thought models.

References#

  • Idavidrein et al., GPQA: A Graduate-Level Google-Proof Q&A Benchmark, 2024. dataset
  • Qwen Team, Qwen3.6 Technical Report, 2026.

Built By#

FINAL-Bench / VIDRAFT_LAB โ€” Darwin V7 evolutionary breeding engine.

  • Base parent weights by the Qwen Team.
  • Reasoning parent by @hesamation (reasoning-distilled).

Learn more#

Citation#

@misc{darwin-36b-opus,
  title   = {Darwin-36B-Opus: Darwin V7 Evolutionary Merge on Qwen3.6-35B-A3B},
  author  = {FINAL-Bench and VIDRAFT_LAB},
  year    = {2026},
  url     = {https://huggingface.co/FINAL-Bench/Darwin-36B-Opus},
  note    = {Qwen3.6-35B-A3B base x reasoning-distilled variant, Darwin V7 engine, 88.4% GPQA Diamond}
}

This model is introduced in Darwin Family.

Files

34 files ยท 69.4 GBWeights 69.3 GB (safetensors). Sizes and sha256 from the signed manifest.
Show all 34 files with their sha256
FileSizesha256
.eval_results/gpqa_diamond.yaml404 Bc5b63f4063d843710e6888baabee1eda1fabe5fec5bcbd2d051640d5faefac3a
.gitattributes1.68 KBf6c3cd4e11bf1ae9de4a951f12684dc7782d5b42a198cc65458efff6f9b20e2e
DARWIN.png4.05 MB6ab5bff80db424c26a2a23820096290aa52f23a9342461122159416f96328b59
LICENSE11.4 KBcfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30
README.md15.4 KBd554bff864f0a9f9054be55426426e51b729e2ffc6b0ffefe73ff89a8feafca6
chat_template.jinja7.76 KBe84f32a23fdda27689f868aa4a1a5621f41133e51a48d7f3efcbea2839574259
config.json2.31 KB4333c11a7ec0612ba1ffc4e1fc5355c38479a5ae2169d84cf980206fa157e368
generation_config.json167 B11332ce2e523628289f6ac122c9be02f80798c9e1488cbfa8e47d4f2a314a27b
merges.txt3.35 MBa9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d
model-00001-of-00021.safetensors3.79 GB04a05da07efab4c31e89a561663d70552996f94bdb66b17235942e6f345ad4ab
model-00002-of-00021.safetensors3.84 GBe33791827d9fbbf2b73f27198e4f4953d5664660db5a6475f2702419dc7eb6e1
model-00003-of-00021.safetensors3.43 GB4f2d5cc9e6982f8315943e4f8831578e01cd6261c5ce501c1ac391184b2eea7b
model-00004-of-00021.safetensors3.30 GB0b173cde85eb02618efc2d8ac2ca6f4659e4e53551f91a4715a9edef9ae0804e
model-00005-of-00021.safetensors3.43 GB9ed5c108fe368221889f8f72d322ca37b78e8bb2d216163380821ea4e014bdca
model-00006-of-00021.safetensors3.30 GB83ab746e0e0c6a40cc3063234fb71264f0452c3834f35922e7243747fbaa664b
model-00007-of-00021.safetensors3.43 GBa3d1c3299aec5659369ede6408c2d343e142040718295963e7f6d3497ada8f67
model-00008-of-00021.safetensors3.30 GBe4a80674fe677807b1237587ae4ed916b8e9304b4316a781a3379ea0eccaa9fe
model-00009-of-00021.safetensors3.43 GBd9ab4f0d16ebc118f381d2f565d9187226a8a40c2bc2cc9c7f9dec0f6902f18a
model-00010-of-00021.safetensors3.30 GB4cb2ff607f8f877ff59395b85be6e8e768639c37cad5fa1c52b879cc0ffd0b00
model-00011-of-00021.safetensors3.43 GBd92b6ad39f0535cd8d67d10560e73780b7b268ad72a684e2500e623694239e69
model-00012-of-00021.safetensors3.30 GB24b3f1bdc137e794d99e7640bd07b2f7cdbba051cf7400a628324396a8a59261
model-00013-of-00021.safetensors3.43 GB21fe501ab39ccfa8639189df97b44490f29ab5409ace80f5173eb721181e6778
model-00014-of-00021.safetensors3.30 GB3664b335b133b0981b84d446d27710f39ee080c51ede97bc0bbc75661ed90b90
model-00015-of-00021.safetensors3.43 GB522189f295a0cd517388686d340741ee01182f642e2a43c102c2d8de15247b90
model-00016-of-00021.safetensors3.30 GBff392bcc5880b83a0cfe53bdd551dd7e5a299e05a5c9bdd5cc47516749b9f067
model-00017-of-00021.safetensors3.43 GB01f193c4b5d702fb680af40d904face45bc98118273b46d553a65b9dcbd3cc0d
model-00018-of-00021.safetensors3.30 GB0fb09fe769fe1c55508c44cdf2fe6a609a92c191e346c7bafb714e27cc4cbaf6
model-00019-of-00021.safetensors3.43 GB4bd814e32972a86307762009456abf55e61dca7f5aa84c6b555e95dee7348cf2
model-00020-of-00021.safetensors3.30 GBecd417490bf2f654c2fd46936f518f3b0c8a80a7a039ea08e740a77fe3be64f4
model-00021-of-00021.safetensors1.14 GB9cb1579edb4feb980e2bfa6775b8b130145f4d0dc668f6a8487afe2a75c99243
model.safetensors.index.json69.7 KB30ac56221b919a2e3e712c920fca184031fc298feef6e548100b6191440576d2
tokenizer.json20.0 MB87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4
tokenizer_config.json1.17 KB2783443b70c176cdabe25ede812ac28b29f25bc149b6800eaf6472bd424cd07c
vocab.json6.72 MBce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003
VersionsEach time the pinned upstream commit or file list changed in this repo. Newest first.
Upstream commitDateContents
ebc6cbeb96 pinned now2026-11-15 03:33 UTC34 files ยท 69.4 GB

Use it

$ fw get FINAL-Bench/Darwin-36B-Opus
# manifest sha256 29a3ebcb8fdc… · 69.4 GB · 34 files
$ fw verify ./Darwin-36B-Opus FINAL-Bench/Darwin-36B-Opus
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/FINAL-Bench/Darwin-36B-Opus.json --dir ./Darwin-36B-Opus $ python3 fw.py verify ./Darwin-36B-Opus ./FINAL-Bench__Darwin-36B-Opus.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download FINAL-Bench/Darwin-36B-Opus --revision ebc6cbeb96b67e47617825134add4a6747f732fc --local-dir ./Darwin-36B-Opus
transformersLoad the weights in Python.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from transformers import AutoModelForCausalLM, AutoTokenizer tok = AutoTokenizer.from_pretrained("FINAL-Bench/Darwin-36B-Opus", revision="ebc6cbeb96b67e47617825134add4a6747f732fc") model = AutoModelForCausalLM.from_pretrained("FINAL-Bench/Darwin-36B-Opus", revision="ebc6cbeb96b67e47617825134add4a6747f732fc", device_map="auto")
vLLMServe an OpenAI-compatible API.
$ HF_ENDPOINT=https://freeweights.allternit.com vllm serve FINAL-Bench/Darwin-36B-Opus --revision ebc6cbeb96b67e47617825134add4a6747f732fc

License

Name
Apache License 2.0
Id
Apache-2.0
Class
Permissive
Redistribution
yes
Listing
Hosted (signed)
Decided
License as declared by the publisher. No person read it. 2026-11-15
Text in
LICENSE
Text sha256
cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license table. A custom license passes only after a person reads it.

Provenance

From: FINAL-Bench <huggingface.co/FINAL-Bench>Newsgroups: alt.freeweights.textSubject: Darwin-36B-OpusDate: 2026-11-15Commit: ebc6cbeSigned: 2DC28CC7B26A283B ✓
Upstream
FINAL-Bench/Darwin-36B-Opus
Pinned commit
ebc6cbeb96b67e47617825134add4a6747f732fc
Manifest
Darwin-36B-Opus.json ยท .minisig
Manifest sha256
29a3ebcb8fdcdbccbea98ce4b0eb2193ba92d870bf3718e48d8c515cd0b08b90
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-15 03:33 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/FINAL-Bench/Darwin-36B-Opus.json $ curl -O https://freeweights.allternit.com/manifests/FINAL-Bench/Darwin-36B-Opus.json.minisig $ minisign -Vm Darwin-36B-Opus.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Model tree

1 model in the catalog name this one as their parent.

Quantizations
1
Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download FINAL-Bench/Darwin-36B-Opus
Open in Freeweights Studio

Pull, verify and run it in the Allternit app on Desktop, web or phone.

Signed manifest
minisign, key 2DC28CC7B26A283B. Darwin-36B-Opus.json. Provenance. Takedown history: none.

Variants

1 quantized or adapter build of Darwin-36B-Opus. Each has its own license check and page.

From: laion <huggingface.co/laion>Subject: a2-rl-e2egit_large-50-32B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-large-15-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_pymethods2test-large-80-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_exp_rpt_unitsyn-python-large-10-8B
From: laion <huggingface.co/laion>Subject: a3-rl-DCAgent_mix_h2_language_proportional-65-8B