EffiReason-Bench: A Unified Benchmark for Evaluating and Advancing Efficient Reasoning in Large Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models (LLMs) with Chain-of-Thought (CoT) prompting achieve strong reasoning but often produce unnecessarily long explanations, increasing cost and sometimes reducing accuracy. Fair comparison of efficiency-oriented approaches is hindered by fragmented evaluation practices. We introduce EffiReason-Bench, a unified benchmark for rigorous cross-paradigm evaluation of efficient reasoning methods across three categories: Reasoning Blueprints, Dynamic Execution, and Post-hoc Refinement. To enable step-by-step evaluation, we construct verified CoT annotations for CommonsenseQA and LogiQA via a pipeline that enforces standardized reasoning structures, comprehensive option-wise analysis, and human verification. We evaluate 7 methods across 6 open-source LLMs (1B-70B) on 4 datasets spanning mathematics, commonsense, and logic, and propose the E3-Score, a principled metric inspired by economic trade-off modeling that provides smooth, stable evaluation without discontinuities or heavy reliance on heuristics. Experiments show that no single method universally dominates; optimal strategies depend on backbone scale, task complexity, and architecture.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 33 of its 39 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
33 of 39 references.
Closest ancestors · 19
Same direction, newest first
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models4 Aug
- 2025Efficient Reasoning Models: A Survey15 Apr
- 2025Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models7 Apr
- 2025When Reasoning Meets Compression: Understanding the Effects of LLMs Compression on Large Reasoning Models2 Apr
- 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models31 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding3 Mar
- 2025LightThinker: Thinking Step-by-Step Compression21 Feb
- 2025Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights18 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
7 more
- 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
- 2025Efficient Reasoning with Hidden Thinking31 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec
- 2023Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation28 Jul
Other references · 14
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
- 2024The Impact of Reasoning Step Length on Large Language Modelscited by 152
- 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 110
- 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 109
- 2020LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoningcited by 68
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Inference for Large Reasoning Models: A Survey
- 2025THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models
- 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models
- 2023Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance
- 2025Early Stopping Chain-of-thoughts in Large Language Models
- 2025Reasoning Relay: Evaluating Stability and Interchangeability of Large Language Models in Mathematical Reasoning
- 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond
- 2026A State-Transition Framework for Efficient LLM Reasoning