mlsanityData to 7 Oct 2026

Strategy Executability in Mathematical Reasoning: Leveraging Human-Model Differences for Effective Guidance

arXiv 2602.22583 ↗First posted 26 Feb 2026cs.AI cs.CLcited by 0

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Example-based guidance is widely used to improve mathematical reasoning at inference time, yet its effectiveness is highly unstable across problems and models-even when the guidance is correct and problem-relevant. We show that this instability arises from a previously underexplored gap between strategy usage-whether a reasoning strategy appears in successful solutions-and strategy executability-whether the strategy remains effective when instantiated as guidance for a target model. Through a controlled analysis of paired human-written and model-generated solutions, we identify a systematic dissociation between usage and executability: human- and model-derived strategies differ in structured, domain-dependent ways, leading to complementary strengths and consistent source-dependent reversals under guidance. Building on this diagnosis, we propose Selective Strategy Retrieval (SSR), a test-time framework that explicitly models executability by selectively retrieving and combining strategies using empirical, multi-route, source-aware signals. Across multiple mathematical reasoning benchmarks, SSR yields reliable and consistent improvements over direct solving, in-context learning, and single-source guidance, improving accuracy by up to +13 points on AIME25 and +5 points on Apex for compact reasoning models. Code and benchmark are publicly available at: https://github.com/lwd17/strategy-execute-pipeline.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 48 references that are in the map. First posted on arXiv 26 Feb 2026.

Builds on

37 of 48 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Plan before Solving: Problem-Aware Strategy Routing for Mathematical Reasoning with LLMs29 Sep
  2. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitions29 May
  3. 2025Brains vs. Bytes: Evaluating LLM Proficiency in Olympiad Mathematics1 Apr
  4. 2025Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solving17 Feb
  5. 2025Premise-Augmented Reasoning Chains Improve Error Identification in Math reasoning with LLMs4 Feb
  6. 2025Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective19 Jan
  7. 2025BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning6 Jan
  8. 2024HARP: A challenging human-annotated math reasoning benchmark11 Dec
  9. 2024Step Guided Reasoning: Improving Mathematical Reasoning using Guidance Generation and Step Reasoning18 Oct
  10. 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models10 Oct
  11. 2022Solving Quantitative Reasoning Problems with Language Models29 Jun

Other references · 26

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  10. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  11. 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
  12. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
14 more
  1. 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 213
  2. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  3. 2022Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Orderingcited by 158
  4. 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
  5. 2022Faithful Reasoning Using Large Language Modelscited by 130
  6. 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
  7. 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 111
  8. 2024Are self-explanations from Large Language Models faithful?cited by 101
  9. 2025Self-Training Elicits Concise Reasoning in Large Language Modelscited by 97
  10. 2024Procedural Knowledge in Pretraining Drives Reasoning in Large Language Modelscited by 41
  11. 2025What Makes a Good Reasoning Chain? Uncovering Structural Patterns in Long Chain-of-Thought Reasoningcited by 21
  12. 2025Accurate and Diverse LLM Mathematical Reasoning via Automated PRM-Guided GFlowNetscited by 10
  13. 2025Zero-Shot Verification-guided Chain of Thoughtscited by 9
  14. 2025Coarse-to-Fine Process Reward Modeling for Mathematical Reasoningcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Accuracy: Evaluating Strategy Diversity in LLM Mathematical Reasoning
  2. 2026When Does Longer Reasoning Help? Predicting Mathematical Reasoning Through Discovery and Execution
  3. 2026From Outcomes to Strategies: Learning Strategy Utility for Mathematical Reasoning
  4. 2026Are We Measuring Strategy or Phrasing? The Gap Between Surface- and Approach-Level Diversity in LLM Math Reasoning
  5. 2026INSPIRE: An Internalize-Then-Improve Approach for Example-Driven Mathematical Reasoning
  6. 2025Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning Models
  7. 2025Reasoning Relay: Evaluating Stability and Interchangeability of Large Language Models in Mathematical Reasoning
  8. 2026Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play