# Reasoning benchmarks and evaluation Area: [LLM reasoning](https://mlsanity.com/lr/index.md). HTML: https://mlsanity.com/lr/reasoning-benchmarks-and-evaluation/ ## Key facts - Reasoning benchmarks and evaluation: 2,388 papers on arXiv since 2021 (data through 7 Oct 2026). - 230 of its 2,388 mapped papers (10%) cite “Qwen3 Technical Report” (2025, arXiv 2505.09388). - 177 of its 2,388 mapped papers (7%) cite “LLaMA: Open and Efficient Foundation Language Models” (2023, arXiv 2302.13971). - 41 new papers 17 Sep–7 Oct. ## Most cited here - [Qwen3 Technical Report](https://mlsanity.com/paper/2505.09388/) (2025), cited by 230 papers here - [LLaMA: Open and Efficient Foundation Language Models](https://mlsanity.com/paper/2302.13971/) (2023), cited by 177 papers here - [FOLIO: Natural Language Reasoning with First-Order Logic](https://mlsanity.com/paper/2209.00840/) (2022), cited by 139 papers here - [ReAct: Synergizing Reasoning and Acting in Language Models](https://mlsanity.com/paper/2210.03629/) (2022), cited by 139 papers here - [Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning](https://mlsanity.com/paper/2305.12295/) (2023), cited by 126 papers here - [Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought](https://mlsanity.com/paper/2210.01240/) (2022), cited by 123 papers here - [DeepSeek-V3 Technical Report](https://mlsanity.com/paper/2412.19437/) (2024), cited by 114 papers here - [Towards Reasoning in Large Language Models: A Survey](https://mlsanity.com/paper/2212.10403/) (2022), cited by 105 papers here - [PAL: Program-aided Language Models](https://mlsanity.com/paper/2211.10435/) (2022), cited by 95 papers here - [Show Your Work: Scratchpads for Intermediate Computation with Language Models](https://mlsanity.com/paper/2112.00114/) (2021), cited by 92 papers here ## New (17 Sep–7 Oct) - [The Long Road to the Same Answer: Cognitive Bias Under Escalating Reasoning Budgets in Large Language Models](https://mlsanity.com/paper/2610.10049/) (2026-10-07) - [Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMs](https://mlsanity.com/paper/2610.09733/) (2026-10-07) - [Rethinking Faithfulness in LLMs: A Pairwise Context-Sensitive Perspective](https://mlsanity.com/paper/2610.07894/) (2026-10-06) - [Verb-ICL: Rethinking In-Context Learning for Structured Prediction](https://mlsanity.com/paper/2610.04725/) (2026-10-03) - [Language-Conditioned Token and Reasoning Efficiency in Large Language Models: A Paired Cross-Lingual Study Protocol](https://mlsanity.com/paper/2610.04295/) (2026-10-03) - [Writerslogic at PAN 2026: Process over Content for Robust Detection under Domain Shift](https://mlsanity.com/paper/2610.03565/) (2026-10-02) - [SyntaxBench: A Statistical Diagnostic Framework for Character-Level Reasoning in Large Language Models](https://mlsanity.com/paper/2610.03329/) (2026-10-02) - [Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented Generation](https://mlsanity.com/paper/2610.03136/) (2026-10-02) - [Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks](https://mlsanity.com/paper/2610.02549/) (2026-10-01) - [Detecting Inconsistencies in Model Specifications with LLM-as-Verifier Reasoning](https://mlsanity.com/paper/2610.01847/) (2026-10-01) - [The Concrete-Arbitrary Gap: Kinship Reasoning in LLMs Is Not Indifferent to Presentation](https://mlsanity.com/paper/2609.39913/) (2026-09-30) - [Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models](https://mlsanity.com/paper/2609.39853/) (2026-09-30) - [Also Small Models Can Reasonably Self-Evaluate Their Confidence](https://mlsanity.com/paper/2609.39478/) (2026-09-30) - [Offline Guidance, Online Reasoning: Reusing LLM Feedback for Small Language Models](https://mlsanity.com/paper/2609.39346/) (2026-09-30) - [When Order Matters: First-Speaker Bias and Mitigation through Personality in Sequential Multi-Agent Debate](https://mlsanity.com/paper/2609.38964/) (2026-09-30) - [ACTR: Aligning Thoughts and Responses for Multilingual Safety in Reasoning LLMs](https://mlsanity.com/paper/2609.37054/) (2026-09-30) - [LongHarness Bench: Stress-Testing Language Model Harnesses for Long-Context Reasoning](https://mlsanity.com/paper/2609.38137/) (2026-09-29) - [Probability is Not Enough: Exploring and Counting Divergent Tokens for Reasoning Uncertainty Quantification in LLMs](https://mlsanity.com/paper/2609.38070/) (2026-09-29) - [Pair Difficulty Matters: Rethinking Pairwise LLM-as-a-Judge Evaluation and Consistency](https://mlsanity.com/paper/2609.37577/) (2026-09-29) - [What Does Post-Training Change in Multilingual Reasoning?](https://mlsanity.com/paper/2609.37104/) (2026-09-29) - [Dating the Model: Hidden Dates in System Prompts Affect LLM Evaluation](https://mlsanity.com/paper/2609.36931/) (2026-09-29) - [Layer-Informed Fine-Tuning via Three-Stage Functional Segmentation of LLMs](https://mlsanity.com/paper/2609.38027/) (2026-09-28) - [Mnemon: Raw Records, Fast Judgments, Slow Thoughts](https://mlsanity.com/paper/2609.36059/) (2026-09-28) - [MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs](https://mlsanity.com/paper/2609.35312/) (2026-09-28) - [MechReasoner: A Simulator and Benchmark for Mechanistic Reasoning in Qualitative Physics](https://mlsanity.com/paper/2609.34636/) (2026-09-28) - [When Words Fall Short: Iterative Synergy Between Verbalized Reasoning and Hidden Features for LLM Confidence Estimation](https://mlsanity.com/paper/2609.34454/) (2026-09-28) - [Quizzing the Translation: A Prover-Grounded Evaluation Metric for NLrightarrowFOL](https://mlsanity.com/paper/2609.33612/) (2026-09-27) - [Certainty Is Not Just Correctness: Rethinking Token-Level Certainty in LLM Reasoning](https://mlsanity.com/paper/2610.00296/) (2026-09-26) - [Counting on Thinking: Tracing Evidence Integration in Language Models](https://mlsanity.com/paper/2609.32932/) (2026-09-26) - [Locally Sound, Globally Insufficient: The Local-Global Gap in Multi-Hop Reasoning](https://mlsanity.com/paper/2609.32496/) (2026-09-26)