Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
We present Darwin Family, a framework for training-free evolutionary merging of large language models via gradient-free weight-space recombination. We ask whether frontier-level reasoning performance can be improved without additional training, by reorganizing latent capabilities already encoded in existing checkpoints. Darwin introduces three key ideas: (i) a 14-dimensional adaptive merge genome enabling fine-grained component- and block-level recombination; (ii) MRI-Trust Fusion, which adaptively balances diagnostic layer-importance signals with evolutionary search through a learnable trust parameter; and (iii) an Architecture Mapper that enables cross-architecture breeding between heterogeneous model families. Empirically, the flagship Darwin-27B-Opus achieves 86.9% on GPQA Diamond, ranking #6 among 1,252 evaluated models, and outperforming its fully trained foundation model without any gradient-based training. Across scales from 4B to 35B parameters, Darwin models consistently improve over their parents, support recursive multi-generation evolution, and enable a training-free evolutionary merge that combines Transformer- and Mamba-based components. Together, the Darwin Family demonstrates that diagnostic-guided evolutionary merging is a practical and reproducible alternative to costly post-training pipelines for reasoning-centric language models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 27 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
20 of 27 references.
References · 20
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2018Regularized Evolution for Image Classifier Architecture Searchcited by 909
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
8 more
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
- 2021Causal Abstractions of Neural Networkscited by 422
- 2024Evolutionary Optimization of Model Merging Recipescited by 208
- 2017Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learningcited by 150
- 2023Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Maskscited by 133
- 2024Training-Free Pretrained Model Mergingcited by 32
- 2024Training-Free Model Merging for Multi-target Domain Adaptationcited by 15
- 2024Exploring Multilingual Probing in Large Language Models: A Cross-Language Analysiscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AERO: Autonomous Evolutionary Reasoning Optimization via Endogenous Dual-Loop Feedback
- 2025CoT-Evo: Evolutionary Distillation of Chain-of-Thought for Scientific Reasoning
- 2025Evolution without an Oracle: Driving Effective Evolution with LLM Judges
- 2025DEBATE, TRAIN, EVOLVE: Self Evolution of Language Model Reasoning
- 2025Fine, I'll Merge It Myself: A Multi-Fidelity Framework for Automated Model Merging
- 2026Escaping Confidence Trap: Evolutionary Decoding for Mathematical Reasoning in Diffusion LLMs
- 2026Hyper-ES: Effective Evolution Strategies for LLM Reasoning via Descent Direction Merging
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution