A2R: An Asymmetric Two-Stage Reasoning Framework for Parallel Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Recent Large Reasoning Models have achieved significant improvements in complex task-solving capabilities by allocating more computation at the inference stage with a "thinking longer" paradigm. Even as the foundational reasoning capabilities of models advance rapidly, the persistent gap between a model's performance in a single attempt and its latent potential, often revealed only across multiple solution paths, starkly highlights the disparity between its realized and inherent capabilities. To address this, we present A2R, an Asymmetric Two-Stage Reasoning framework designed to explicitly bridge the gap between a model's potential and its actual performance. In this framework, an "explorer" model first generates potential solutions in parallel through repeated sampling. Subsequently,a "synthesizer" model integrates these references for a more refined, second stage of reasoning. This two-stage process allows computation to be scaled orthogonally to existing sequential methods. Our work makes two key innovations: First, we present A2R as a plug-and-play parallel reasoning framework that explicitly enhances a model's capabilities on complex questions. For example, using our framework, the Qwen3-8B-distill model achieves a 75% performance improvement compared to its self-consistency baseline. Second, through a systematic analysis of the explorer and synthesizer roles, we identify an effective asymmetric scaling paradigm. This insight leads to A2R-Efficient, a "small-to-big" variant that combines a Qwen3-4B explorer with a Qwen3-8B synthesizer. This configuration surpasses the average performance of a monolithic Qwen3-32B model at a nearly 30% lower cost. Collectively, these results show that A2R is not only a performance-boosting framework but also an efficient and practical solution for real-world applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 23 of its 27 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
23 of 27 references.
Closest ancestors · 7
Same direction, newest first
- 2025Learning to Reason Across Parallel Samples for LLM Reasoning10 Jun
- 2025Learning from Peers in Reasoning Models12 May
- 2025Learning Adaptive Parallel Reasoning with Language Models21 Apr
- 2024Training Language Models to Self-Correct via Reinforcement Learning19 Sep
- 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMs19 May
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
Other references · 16
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
4 more
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2025Skywork Open Reasoner 1 Technical Reportcited by 165
- 2025Multiverse: Your Language Models Secretly Decide How to Parallelize and Merge Generationcited by 30
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025A Survey on Parallel Reasoningcited by 11
- 2025A Survey on Parallel Reasoning14 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Parallel Thinking, Sequential Answering: Bridging NAR and AR for Efficient Reasoning
- 2025ThreadWeaver: Adaptive Threading for Efficient Parallel Reasoning in Language Models
- 2025ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Compute
- 2026Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning
- 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning
- 2025Efficient Reasoning Models: A Survey
- 2025Adaptive Termination for Multi-round Parallel Reasoning: An Universal Semantic Entropy-Guided Framework
- 2025SPRINT: Enabling Interleaved Planning and Parallelized Execution in Reasoning Models