mlsanityData to 14 Oct 2026

Method-Based Reasoning for Large Language Models: Extraction, Reuse, and Continuous Improvement

arXiv 2508.04289 ↗First posted 6 Aug 2025cs.AI cs.CL cs.LGcited by 6

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) have shown impressive capabilities across a wide range of language tasks. However, their reasoning process is primarily guided by statistical patterns in training data, which limits their ability to handle novel problems and perform consistent logical reasoning. In this paper, we propose a method-based model that enhances LLMs with explicit, reusable procedures extracted from training content, generated responses, and user interactions. Each method is represented as a pair consisting of a problem and its corresponding solution, stored externally and ranked based on feedback. When a new query is received, the system retrieves and applies the most relevant methods to guide the LLM's response. Our model enables continual learning, method reuse, and logical consistency beyond next-token prediction. Experimental results demonstrate that the system improves factual verification and generalization in complex prompts, and that newly learned methods can outperform earlier ones through user-driven refinement.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 14 of its 21 references that are in the map. First posted on arXiv 6 Aug 2025.

Builds on

14 of 21 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Empowering LLMs with Logical Reasoning: A Comprehensive Survey21 Feb
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct

Other references · 12

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2022Large Language Models Can Self-Improvecited by 664
  6. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
  7. 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 274
  8. 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 66
  9. 2023Efficient LLM Inference on CPUscited by 24
  10. 2024Large Language Model (LLM) AI text generation detection based on transformer deep learning algorithmcited by 23
  11. 2024MedSyn: LLM-based Synthetic Medical Text Generation Frameworkcited by 19
  12. 2024Structured Dialogue System for Mental Health: An LLM Chatbot Leveraging the PM+ Guidelinescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 1.

6 papers.

  1. 2026Code as Agent Harnesscited by 47
  2. 2025A Layered Intuition -- Method Model with Scope Extension for LLM Reasoningcited by 3
  3. 2025Human-Inspired Learning for Large Language Models via Obvious Record and Maximum-Entropy Method Discoverycited by 3
  4. 2025Cross-Question Method Reuse in Large Language Models: From Word-Level Prediction to Rational Logical-Layer Reasoningcited by 2
  5. 2025Active Thinking Model: A Goal-Directed Self-Improving Framework for Real-World Adaptive Intelligencecited by 1
  6. 2025Method Decoration (DeMe): A Framework for LLM-Driven Adaptive Method Generation in Dynamic IoT Environmentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Advancing Reasoning in Large Language Models: Promising Methods and Approaches
  2. 2024A NotSo Simple Way to Beat Simple Bench
  3. 2026Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Models
  4. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debate
  5. 2026Enhancing reasoning accuracy in large language models during inference time
  6. 2024Refining Answer Distributions for Improved Large Language Model Reasoning
  7. 2023Adaptive-Solver Framework for Dynamic Strategy Selection in Large Language Model Reasoning
  8. 2023Large Language Model Programs