mlsanityData to 7 Oct 2026

NEAT: Neuron-Based Early Exit for Large Reasoning Models

arXiv 2602.02010 ↗First posted 2 Feb 2026cs.CLcited by 3

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Large Reasoning Models (LRMs) often suffer from overthinking, a phenomenon in which redundant reasoning steps are generated after a correct solution has already been reached. Existing early reasoning exit methods primarily rely on output-level heuristics or trained probing models to skip redundant reasoning steps, thereby mitigating overthinking. However, these approaches typically require additional rollout computation or externally labeled datasets. In this paper, we propose NEAT, a Neuron-based Early reAsoning exiT framework that monitors neuron-level activation dynamics to enable training-free early exits, without introducing additional test-time computation. NEAT identifies exit-associated neurons and tracks their activation patterns during reasoning to dynamically trigger early exit or suppress reflection, thereby reducing unnecessary reasoning while preserving solution quality. Experiments on four reasoning benchmarks across six models with different scales and architectures show that, for each model, NEAT achieves an average token reduction of 22% to 28% when averaged over the four benchmarks, while maintaining accuracy.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 21 of its 35 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

21 of 35 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppression7 Aug
  2. 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
  3. 2025Overclocking LLM Reasoning: Monitoring and Controlling Thinking Path Lengths in LLMs8 Jun
  4. 2025Let LRMs Break Free from Overthinking via Self-Braking Tuning20 May
  5. 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
  6. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
  7. 2025Dynamic Early Exit in Reasoning Models22 Apr
  8. 2025Reasoning Models Can Be Effective Without Thinking14 Apr
  9. 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verification7 Apr
  10. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  11. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug

Other references · 10

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  3. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  4. 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 38
  5. 2024Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysiscited by 31
  6. 2025Back Attention: Understanding and Enhancing Multi-Hop Reasoning in Large Language Modelscited by 23
  7. 2024An Investigation of Neuron Activation as a Unified Lens to Explain Chain-of-Thought Eliciting Arithmetic Reasoning of LLMscited by 20
  8. 2025Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulationcited by 17
  9. 2025Activation Control for Efficiently Eliciting Long Chain-of-thought Ability of Language Modelscited by 12
  10. 2025Locate-then-Merge: Neuron-Level Parameter Fusion for Mitigating Catastrophic Forgetting in Multimodal LLMscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring
  2. 2026Step-GRPO: Internalizing Dynamic Early Exit for Efficient Reasoning
  3. 2026Identifying and Transferring Reasoning-Critical Neurons: Improving LLM Inference Reliability via Activation Steering
  4. 2025FlashThink: An Early Exit Method For Efficient Reasoning
  5. 2025LYNX: Learning Dynamic Exits for Confidence-Controlled Reasoning
  6. 2026TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning
  7. 2026NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neurons
  8. 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probing