M2A: Synergizing Mathematical and Agentic Reasoning in Large Language Models
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
While reasoning has become a central capability of large language models (LLMs), the reasoning patterns required for different scenarios are often misaligned. Mathematical reasoning typically relies on intrinsic logic to solve closed-world problems in a single response, whereas agentic reasoning requires not only internal reasoning but also multi-turn interaction with external environments, interleaving thought and action. This misalignment prevents mathematical and agentic reasoning from effectively benefiting from each other, often yielding unstable reasoning behavior and only limited performance gains under multi-task learning. In this paper, we propose M2A, a novel paradigm that synergizes mathematical and agentic reasoning via model merging. To avoid overfitting to superficial reasoning patterns under joint training, M2A operates directly in parameter space: it identifies the feature subspace critical for agent behavior, and merges the mathematical reasoning task vector only along its null space, thereby injecting reasoning capability along directions that do not perturb agent behavior. Unlike SFT or RL, M2A requires no additional gradient-update and exposes the merging coefficient as a simple knob for controlling reasoning length. Experiments in a challenging real-world coding agent setting show that our method effectively extends agentic reasoning depth and delivers substantial performance improvements. Applied to a fine-tuned Qwen3-8B, M2A improves its SWE-Bench Verified resolved rate from 44.0% to 51.2% without retraining the model. Code is available at https://github.com/laplucky/M2A.git.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 28 of its 50 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
28 of 50 references.
Closest ancestors · 3
Same direction, newest first
- 2026Reasoning and Tool-use Compete in Agentic RL:From Quantifying Interference to Disentangled Tuning1 Feb
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan
- 2024OpenAI o1 System Card21 Dec
Other references · 25
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 297
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
- 2023AdaMerging: Adaptive Model Merging for Multi-Task Learningcited by 252
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domainscited by 156
- 2025General-Reasoner: Advancing LLM Reasoning Across All Domainscited by 135
- 2025Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoningcited by 106
13 more
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agentscited by 41
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 31
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 31
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 25
- 2025Decouple and Orthogonalize: A Data-Free Framework for LoRA Mergingcited by 18
- 2026Multi-Task GRPO: Reliable LLM Reasoning Across Taskscited by 14
- 2026To Mix or To Merge: Toward Multi-Domain Reinforcement Learning for Large Language Modelscited by 11
- 2026SERA: Soft-Verified Efficient Repository Agentscited by 10
- 2026RAIN-Merging: A Gradient-Free Method to Enhance Instruction Following in Large Reasoning Models with Preserved Thinking Formatcited by 9
- 2025Reasoning Curriculum: Bootstrapping Broad LLM Reasoning from Mathcited by 8
- 2025How and Why LLMs Generalize: A Fine-Grained Analysis of LLM Reasoning from Cognitive Behaviors to Low-Level Patternscited by 8
- 2026SWE-AGILE: A Software Agent Framework for Efficiently Managing Dynamic Reasoning Contextcited by 6
- 2026Orthogonal Model Mergingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025AgentMath: Empowering Mathematical Reasoning for Large Language Models via Tool-Augmented Agent
- 2026Agentic Proposing: Enhancing Large Language Model Reasoning via Compositional Skill Synthesis
- 2025AgentCoMa: A Compositional Benchmark Mixing Commonsense and Mathematical Reasoning in Real-World Scenarios
- 2025AlphaApollo: A System for Deep Agentic Reasoning
- 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learning
- 2023Modeling Complex Mathematical Reasoning via Large Language Model based MathAgent
- 2024Mars-PO: Multi-Agent Reasoning System Preference Optimization
- 2026From Atomic to Agentic: Towards Interpretable Evaluation of LLMs' Agentic Mathematical Capabilities