ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Reasoning Models (LRMs) with long chain-of-thought reasoning have recently achieved remarkable success. Yet, equipping domain-specialized models with such reasoning capabilities, referred to as "Reasoning + X", remains a significant challenge. While model merging offers a promising training-free solution, existing methods often suffer from a destructive performance collapse: existing methods tend to both weaken reasoning depth and compromise domain-specific utility. Interestingly, we identify a counter-intuitive phenomenon underlying this failure: reasoning ability predominantly resides in parameter regions with low gradient sensitivity, contrary to the common assumption that domain capabilities correspond to high-magnitude parameters. Motivated by this insight, we propose ReasonAny, a novel merging framework that resolves the reasoning-domain performance collapse through Contrastive Gradient Identification. Experiments across safety, biomedicine, and finance domains show that ReasonAny effectively synthesizes "Reasoning + X" capabilities, significantly outperforming state-of-the-art baselines while retaining robust reasoning performance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 40 of its 93 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
40 of 93 references.
Closest ancestors · 4
Same direction, newest first
- 2025The Thinking Spectrum: An Empirical Study of Tunable Reasoning in LLMs through Model Merging26 Sep
- 2025RCP-Merging: Merging Long Chain-of-Thought Models with Domain-Specific Models by Considering Reasoning Capability as Prior5 Aug
- 2025Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?17 Feb
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
Other references · 36
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2023Let's Verify Step by Stepcited by 3,789
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
- 2024OpenAI o1 System Cardcited by 1,244
24 more
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
- 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 265
- 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilitiescited by 136
- 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinkingcited by 99
- 2023Deep Model Fusion: A Surveycited by 91
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
- 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 90
- 2024The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunitiescited by 64
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
- 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 46
- 2024Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Modelscited by 44
- 2025Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Financecited by 35
- 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMscited by 34
- 2025FinanceQA: A Benchmark for Evaluating Financial Analysis Capabilities of Large Language Modelscited by 19
- 2025Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Modelscited by 18
- 2025Disentangling Reasoning and Knowledge in Medical Large Language Modelscited by 18
- 2025Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Modelscited by 16
- 2025Improving Medical Reasoning with Curriculum-Aware Reinforcement Learningcited by 16
- 2025From Task-Specific Models to Unified Systems: A Review of Model Merging Approachescited by 11
- 2025Adapting Language-Specific LLMs to a Reasoning Model in One Day via Model Merging -- An Open Recipecited by 9
- 2025Unraveling LLM Jailbreaks Through Safety Knowledge Neuronscited by 7
- 2025Reasoning Vectors: Transferring Chain-of-Thought Capabilities via Task Arithmeticcited by 4
- 2025Weight-of-Thought Reasoning: Exploring Neural Network Weights for Enhanced LLM Reasoningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Unconstrained Model Merging for Enhanced LLM Reasoning
- 2025ReasonBridge: Efficient Reasoning Transfer from Closed to Open-Source Language Models
- 2025Small Models Struggle to Learn from Strong Reasoners
- 2026Multi-objective Evolutionary Merging Enables Efficient Reasoning Models
- 2025Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities
- 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
- 2025The Ouroboros of Benchmarking: Reasoning Evaluation in an Era of Saturation
- 2025Superficial Self-Improved Reasoners Benefit from Model Merging