mlsanityData to 7 Oct 2026

Understanding Before Reasoning: Enhancing Chain-of-Thought with Iterative Summarization Pre-Prompting

arXiv 2501.04341 ↗First posted 8 Jan 2025cs.CLcited by 4

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

Chain-of-Thought (CoT) Prompting is a dominant paradigm in Large Language Models (LLMs) to enhance complex reasoning. It guides LLMs to present multi-step reasoning, rather than generating the final answer directly. However, CoT encounters difficulties when key information required for reasoning is implicit or missing. This occurs because CoT emphasizes the sequence of reasoning steps while overlooking the early extraction of essential information. We propose a pre-prompting method called Iterative Summarization Pre-Prompting (ISP^2) to refine LLM reasoning when key information is not explicitly provided. First, entities and their corresponding descriptions are extracted to form potential key information pairs. Next, we use a reliability rating to assess these pairs, then merge the two lowest-ranked pairs into a new entity description. This process is repeated until a unique key information pair is obtained. Finally, that pair, along with the original question, is fed into LLMs to produce the answer. Extensive experiments demonstrate a 7.1% improvement compared to existing methods. Unlike traditional prompting, ISP^2 adopts an inductive approach with pre-prompting, offering flexible integration into diverse reasoning frameworks. The code is available at https://github.com/zdhgreat/ISP-2.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 45 references that are in the map. First posted on arXiv 8 Jan 2025.

Builds on

40 of 45 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024ERA-CoT: Improving Chain-of-Thought through Entity Relationship Analysis11 Mar
  2. 2023Progressive-Hint Prompting Improves Reasoning in Large Language Models19 Apr
  3. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks22 Nov
  4. 2022Automatic Chain of Thought Prompting in Large Language Models7 Oct
  5. 2022Complexity-Based Prompting for Multi-Step Reasoning3 Oct
  6. 2022Large Language Models are Zero-Shot Reasoners24 May
  7. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
  8. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
  9. 2022Iteratively Prompt Pre-trained Language Models for Chain of Thought16 Mar
  10. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan

Other references · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  9. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  11. 2023A Survey of Large Language Modelscited by 2,537
  12. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
18 more
  1. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  2. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  3. 2023Teaching Large Language Models to Self-Debugcited by 963
  4. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
  5. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  6. 2022Large Language Models Can Self-Improvecited by 656
  7. 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
  8. 2021MetaICL: Learning to Learn In Contextcited by 450
  9. 2023Language Models can Solve Computer Taskscited by 371
  10. 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 265
  11. 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 203
  12. 2020Unsupervised Question Decomposition for Question Answeringcited by 118
  13. 2023Cumulative Reasoning with Large Language Modelscited by 94
  14. 2024Can large language models explore in-context?cited by 75
  15. 2022Improving In-Context Few-Shot Learning via Self-Supervised Trainingcited by 56
  16. 2022SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Modelscited by 38
  17. 2023Re-Reading Improves Reasoning in Large Language Modelscited by 37
  18. 2024Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classroomscited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Chain of Thought Prompting in Large Language Models via Reasoning Patterns
  2. 2022Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters
  3. 2024Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods
  4. 2023Towards Better Chain-of-Thought Prompting Strategies: A Survey
  5. 2023Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  6. 2025Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens
  7. 2023R3 Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context
  8. 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models