To Retrieve or To Think? Cross-Boundary Context Evolution for Multi-hop Complex Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Current context augmentation methods, such as retrieval-augmented generation, play a crucial role in bridging a model's internal knowledge boundary and external evidence for multi-hop reasoning. However, they often follow a rigid policy and treat external retrieval as the default action at each step. Such brute-force context expansion incurs unnecessary computational cost and may degrade reasoning performance by saturating the context with redundant or weakly relevant evidence. In this paper, we propose cross-boundary Context Evolution (EvoCtx), a framework that models complex reasoning as an adaptive process of boundary-aware context evolution. EvoCtx dynamically decides whether the next reasoning transition should cross the current evidence boundary through retrieval or refine the reasoning state within the existing context. It estimates the semantic gap between the reasoning state and the accumulated evidence, and strategically alternates between boundary expansion and intra-boundary trajectory refinement. This eliminates redundant retrieval steps and preserves a compact, evidence-supported reasoning trajectory. Extensive experiments on challenging open-domain and multi-hop QA benchmarks demonstrate that EvoCtx significantly outperforms previous methods, offering an effective approach to complex reasoning tasks. The source code can be accessed at https://github.com/Anya-RB-Chen/EvoCtx.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 15 of its 34 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
15 of 34 references.
Closest ancestors · 2
Same direction, newest first
- 2025Inference Scaled GraphRAG: Improving Multi Hop Question Answering on Knowledge Graphs24 Jun
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec
Other references · 13
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 343
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
1 more
- 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2026MemTrain: Self-Supervised Context Memory Trainingcited by 0
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026MemTrain: Self-Supervised Context Memory Training2 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Scaling Trends for Multi-Hop Contextual Reasoning in Mid-Scale Language Models
- 2026Retrieval--Reasoning Processes for Multi-hop Question Answering: A Four-Axis Design Framework and Empirical Trends
- 2026ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning
- 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering
- 2026CIRAG: Construction-Integration Retrieval and Adaptive Generation for Multi-hop Question Answering
- 2024Lost in the Middle, and In-Between: Enhancing Language Models' Ability to Reason Over Long Contexts in Multi-Hop QA
- 2024Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understanding
- 2025Think-on-Graph 3.0: Efficient and Adaptive LLM Reasoning on Heterogeneous Graphs via Multi-Agent Dual-Evolving Context Retrieval