mlsanityData to 14 Oct 2026

RE-Searcher: Robust Agentic Search with Goal-oriented Planning and Self-reflection

arXiv 2509.26048 ↗First posted 30 Sep 2025cs.CLcited by 5

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Large language models (LLMs) excel at knowledge-intensive question answering and reasoning, yet their real-world deployment remains constrained by knowledge cutoff, hallucination, and limited interaction modalities. Augmenting LLMs with external search tools helps alleviate these issues, but it also exposes agents to a complex search environment in which small, plausible variations in query formulation can steer reasoning into unproductive trajectories and amplify errors. We present a systematic analysis that quantifies how environmental complexity induces fragile search behaviors and, in turn, degrades overall performance. To address this challenge, we propose a simple yet effective approach to instantiate a search agent, RE-Searcher. During search, RE-Searcher explicitly articulates a concrete search goal and subsequently reflects on whether the retrieved evidence satisfies that goal. This combination of goal-oriented planning and self-reflection enables RE-Searcher to resist spurious cues in complex search environments and perform robust search. Extensive experiments show that our method improves search accuracy and achieves state-of-the-art results. Perturbation studies further demonstrate substantial resilience to noisy or misleading external signals, mitigating the fragility of the search process. We believe these findings offer practical guidance for integrating LLM-powered agents into more complex interactive environments and enabling more autonomous decision-making.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 39 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

34 of 39 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025DynaSearcher: Dynamic Knowledge Graph Augmented Search Agent via Multi-Reward Reinforcement Learning23 Jul
  2. 2025O2-Searcher: A Searching-based Agent Model for Open-Domain Open-Ended Question Answering22 May
  3. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Models9 Jan

Other references · 31

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2024Qwen2.5 Technical Reportcited by 4,942
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  9. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  10. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  11. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  12. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
19 more
  1. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  2. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  3. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  4. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  5. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  6. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  7. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
  8. 2024Large Language Models: A Surveycited by 525
  9. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  10. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 269
  11. 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 213
  12. 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 208
  13. 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 202
  14. 2025StepSearch: Igniting LLMs Search Ability via Step-Wise Proximal Policy Optimizationcited by 88
  15. 2025CodeI/O: Condensing Reasoning Patterns via Code Input-Output Predictioncited by 55
  16. 2024Dated Data: Tracing Knowledge Cutoffs in Large Language Modelscited by 51
  17. 2025R1-Searcher++: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learningcited by 30
  18. 2025Beyond the Reported Cutoff: Where Large Language Models Fall Short on Financial Knowledgecited by 8
  19. 2025KG-TRACES: Enhancing Large Language Models with Knowledge Graph-constrained Trajectory Reasoning and Attribution Supervisioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Search, Do not Guess: Teaching Small Language Models to Be Effective Search Agents
  2. 2025Reinforcement Fine-Tuning for Reasoning towards Multi-Step Multi-Source Search in Large Language Models
  3. 2025Supervising the search process produces reliable and generalizable information-seeking agents
  4. 2026Beyond Monolithic Architectures: A Multi-Agent Search and Knowledge Optimization Framework for Agentic Search
  5. 2026From Delivery to Stateful Exploration: Rethinking the Index for Agentic Search
  6. 2025RAVine: Reality-Aligned Evaluation for Agentic Search
  7. 2026Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning
  8. 2026Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systems