mlsanityData to 14 Oct 2026

ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging

arXiv 2601.05560 ↗First posted 9 Jan 2026cs.CL cs.AIcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Reasoning Models (LRMs) with long chain-of-thought reasoning have recently achieved remarkable success. Yet, equipping domain-specialized models with such reasoning capabilities, referred to as "Reasoning + X", remains a significant challenge. While model merging offers a promising training-free solution, existing methods often suffer from a destructive performance collapse: existing methods tend to both weaken reasoning depth and compromise domain-specific utility. Interestingly, we identify a counter-intuitive phenomenon underlying this failure: reasoning ability predominantly resides in parameter regions with low gradient sensitivity, contrary to the common assumption that domain capabilities correspond to high-magnitude parameters. Motivated by this insight, we propose ReasonAny, a novel merging framework that resolves the reasoning-domain performance collapse through Contrastive Gradient Identification. Experiments across safety, biomedicine, and finance domains show that ReasonAny effectively synthesizes "Reasoning + X" capabilities, significantly outperforming state-of-the-art baselines while retaining robust reasoning performance.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 40 of its 93 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

40 of 93 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025The Thinking Spectrum: An Empirical Study of Tunable Reasoning in LLMs through Model Merging26 Sep
  2. 2025RCP-Merging: Merging Long Chain-of-Thought Models with Domain-Specific Models by Considering Reasoning Capability as Prior5 Aug
  3. 2025Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?17 Feb
  4. 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb

Other references · 36

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  7. 2023Let's Verify Step by Stepcited by 3,789
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  9. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  10. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  11. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  12. 2024OpenAI o1 System Cardcited by 1,244
24 more
  1. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
  2. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 265
  3. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
  4. 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilitiescited by 136
  5. 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinkingcited by 99
  6. 2023Deep Model Fusion: A Surveycited by 91
  7. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
  8. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 90
  9. 2024The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunitiescited by 64
  10. 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
  11. 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 46
  12. 2024Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Modelscited by 44
  13. 2025Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Financecited by 35
  14. 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMscited by 34
  15. 2025FinanceQA: A Benchmark for Evaluating Financial Analysis Capabilities of Large Language Modelscited by 19
  16. 2025Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Modelscited by 18
  17. 2025Disentangling Reasoning and Knowledge in Medical Large Language Modelscited by 18
  18. 2025Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Modelscited by 16
  19. 2025Improving Medical Reasoning with Curriculum-Aware Reinforcement Learningcited by 16
  20. 2025From Task-Specific Models to Unified Systems: A Review of Model Merging Approachescited by 11
  21. 2025Adapting Language-Specific LLMs to a Reasoning Model in One Day via Model Merging -- An Open Recipecited by 9
  22. 2025Unraveling LLM Jailbreaks Through Safety Knowledge Neuronscited by 7
  23. 2025Reasoning Vectors: Transferring Chain-of-Thought Capabilities via Task Arithmeticcited by 4
  24. 2025Weight-of-Thought Reasoning: Exploring Neural Network Weights for Enhanced LLM Reasoningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Unconstrained Model Merging for Enhanced LLM Reasoning
  2. 2025ReasonBridge: Efficient Reasoning Transfer from Closed to Open-Source Language Models
  3. 2025Small Models Struggle to Learn from Strong Reasoners
  4. 2026Multi-objective Evolutionary Merging Enables Efficient Reasoning Models
  5. 2025Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities
  6. 2026Stabilizing Efficient Reasoning with Step-Level Advantage Selection
  7. 2025The Ouroboros of Benchmarking: Reasoning Evaluation in an Era of Saturation
  8. 2025Superficial Self-Improved Reasoners Benefit from Model Merging