REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agents
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Large language models are transitioning from generalpurpose knowledge engines to realworld problem solvers, yet optimizing them for deep search tasks remains challenging. The central bottleneck lies in the extreme sparsity of highquality search trajectories and reward signals, arising from the difficulty of scalable longhorizon task construction and the high cost of interactionheavy rollouts involving external tool calls. To address these challenges, we propose REDSearcher, a unified framework that codesigns complex task synthesis, midtraining, and posttraining for scalable searchagent optimization. Specifically, REDSearcher introduces the following improvements: (1) We frame task synthesis as a dualconstrained optimization, where task difficulty is precisely governed by graph topology and evidence dispersion, allowing scalable generation of complex, highquality tasks. (2) We introduce toolaugmented queries to encourage proactive tool use rather than passive recall.(3) During midtraining, we strengthen core atomic capabilities knowledge, planning, and function calling substantially reducing the cost of collecting highquality trajectories for downstream training. (4) We build a local simulated environment that enables rapid, lowcost algorithmic iteration for reinforcement learning experiments. Across both textonly and multimodal searchagent benchmarks, our approach achieves stateoftheart performance. To facilitate future research on longhorizon search agents, we will release 10K highquality complex text search trajectories, 5K multimodal trajectories and 1K text RL query set, and together with code and model checkpoints.
Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 43 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
30 of 43 references.
Closest ancestors · 2
Same direction, newest first
- 2025WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learning16 Sep
- 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul
Other references · 28
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2025OpenAI GPT-5 System Cardcited by 989
16 more
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2025Humanity's Last Examcited by 491
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 145
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 124
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 119
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 101
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
- 2025MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agentscited by 42
- 2025MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agentscited by 38
- 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Modelscited by 37
- 2026LongCat-Flash-Thinking-2601 Technical Reportcited by 34
- 2026Deep Search with Hierarchical Meta-Cognitive Monitoring Inspired by Cognitive Neurosciencecited by 5
Built on by
Citing papers per year: 2026: 49.
49 papers.
Sort:
By area:
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 75
- 2026OpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Datacited by 39
- 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verificationcited by 32
- 2026Marco DeepResearch: Unlocking Efficient Deep Research Agents via Verification-Centric Designcited by 16
- 2026Towards Long-horizon Agentic Multimodal Searchcited by 11
- 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Taskscited by 11
- 2026Evo-Bench: Can Language Models Improve Agent Harness?cited by 11
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agentscited by 10
- 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agentscited by 10
- 2026STRIDE: Strategic Trajectory Reasoning via Discriminative Estimation for Verifiable Reinforcement Learningcited by 10
- 2026OpenSeeker-v2: Pushing the Limits of Search Agents with Informative and High-Difficulty Trajectoriescited by 8
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 7
37 more
- 2026DR-Venus: Towards Frontier Edge-Scale Deep Research Agents with Only 10K Open Datacited by 5
- 2026LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?cited by 5
- 2026Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansioncited by 5
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agentscited by 5
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learningcited by 5
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 5
- 2026Learning Agentic Policy from Action Guidancecited by 4
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Researchcited by 3
- 2026DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agentscited by 3
- 2026SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Taskcited by 3
- 2026SearchMaster: Grounded and Regulated Self-Play for Search Agentscited by 3
- 2026ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignmentcited by 3
- 2026DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoningcited by 2
- 2026SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Searchcited by 2
- 2026DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agentscited by 2
- 2026QuarkMedSearch: A Long-Horizon Deep Search Agent for Exploring Medical Intelligencecited by 1
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Managementcited by 1
- 2026WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agentscited by 1
- 2026WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editingcited by 1
- 2026False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agentscited by 1
- 2026RAG-Stress: Probing the Limits of Evidence Reliance in Retrieval-Augmented Generationcited by 1
- 2026G-ReAct: Graph-Guided Deep Search via Structure-State Co-Evolutioncited by 0
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Researchcited by 0
- 2026MemoryWalker: Stop Training Agents on Contexts They Never Sawcited by 0
- 2026Iris: Climbing to the Search Frontiercited by 0
- 2026Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Tracescited by 0
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrievalcited by 0
- 2026IterSynth: Rethinking Deep Search Agents via Role-Decoupled Iterative Synthesiscited by 0
- 2026ActiveMem: Dynamic Latent Memory Trees for Long-Horizon Agentscited by 0
- 2026PrimeSeeker: Capability-Oriented Supervision for Deep Search Agentscited by 0
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glancecited by 0
- 2026VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Researchcited by 0
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agentscited by 0
- 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agentscited by 0
- 2026HyWe: Unifying Search and Operation for Real-World Hybrid Web Taskscited by 0
- 2026Glasseek: A Transparent Recipe for Training and Trustworthy Evaluation of DeepSearch Agentscited by 0
- 2026Neos: Learning to Interleave Search and Visual Reasoningcited by 0
- 2026Neos: Learning to Interleave Search and Visual Reasoning12 Oct 2026
- 2026Glasseek: A Transparent Recipe for Training and Trustworthy Evaluation of DeepSearch Agents12 Oct 2026
- 2026HyWe: Unifying Search and Operation for Real-World Hybrid Web Tasks12 Oct 2026
- 2026RAG-Stress: Probing the Limits of Evidence Reliance in Retrieval-Augmented Generation8 Oct 2026
- 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agents5 Oct 2026
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agents4 Oct 2026
- 2026VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research4 Oct 2026
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glance30 Sep 2026
- 2026False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents30 Sep 2026
- 2026ActiveMem: Dynamic Latent Memory Trees for Long-Horizon Agents27 Sep 2026
- 2026IterSynth: Rethinking Deep Search Agents via Role-Decoupled Iterative Synthesis24 Sep 2026
- 2026PrimeSeeker: Capability-Oriented Supervision for Deep Search Agents20 Sep 2026
37 more
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrieval19 Sep 2026
- 2026WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing4 Sep 2026
- 2026Iris: Climbing to the Search Frontier3 Sep 2026
- 2026MemoryWalker: Stop Training Agents on Contexts They Never Saw1 Sep 2026
- 2026WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents28 Aug 2026
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research26 Aug 2026
- 2026Evo-Bench: Can Language Models Improve Agent Harness?10 Aug 2026
- 2026Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Traces5 Aug 2026
- 2026ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignment5 Aug 2026
- 2026DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents3 Aug 2026
- 2026SearchMaster: Grounded and Regulated Self-Play for Search Agents3 Aug 2026
- 2026G-ReAct: Graph-Guided Deep Search via Structure-State Co-Evolution2 Aug 2026
- 2026SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task25 Jul 2026
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation7 Jul 2026
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning3 Jul 2026
- 2026SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Search30 Jun 2026
- 2026STRIDE: Strategic Trajectory Reasoning via Discriminative Estimation for Verifiable Reinforcement Learning14 Jun 2026
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents13 Jun 2026
- 2026Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion12 Jun 2026
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents10 Jun 2026
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research8 Jun 2026
- 2026DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoning5 Jun 2026
- 2026DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents27 May 2026
- 2026LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?27 May 2026
- 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks22 May 2026
- 2026Learning Agentic Policy from Action Guidance12 May 2026
- 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents8 May 2026
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agents6 May 2026
- 2026OpenSeeker-v2: Pushing the Limits of Search Agents with Informative and High-Difficulty Trajectories5 May 2026
- 2026DR-Venus: Towards Frontier Edge-Scale Deep Research Agents with Only 10K Open Data21 Apr 2026
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management15 Apr 2026
- 2026Towards Long-horizon Agentic Multimodal Search14 Apr 2026
- 2026QuarkMedSearch: A Long-Horizon Deep Search Agent for Exploring Medical Intelligence14 Apr 2026
- 2026Marco DeepResearch: Unlocking Efficient Deep Research Agents via Verification-Centric Design30 Mar 2026
- 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verification16 Mar 2026
- 2026OpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Data16 Mar 2026
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agents12 Mar 2026
- 2026OpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Datacited by 39
- 2026Marco DeepResearch: Unlocking Efficient Deep Research Agents via Verification-Centric Designcited by 16
- 2026Towards Long-horizon Agentic Multimodal Searchcited by 11
- 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Taskscited by 11
- 2026Evo-Bench: Can Language Models Improve Agent Harness?cited by 11
- 2026OpenSeeker-v2: Pushing the Limits of Search Agents with Informative and High-Difficulty Trajectoriescited by 8
- 2026DR-Venus: Towards Frontier Edge-Scale Deep Research Agents with Only 10K Open Datacited by 5
- 2026LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?cited by 5
- 2026Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansioncited by 5
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agentscited by 5
- 2026Learning Agentic Policy from Action Guidancecited by 4
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Researchcited by 3
12 most cited of 27 All 27 (JSON)
- 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agents5 Oct 2026
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agents4 Oct 2026
- 2026VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research4 Oct 2026
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glance30 Sep 2026
- 2026ActiveMem: Dynamic Latent Memory Trees for Long-Horizon Agents27 Sep 2026
- 2026PrimeSeeker: Capability-Oriented Supervision for Deep Search Agents20 Sep 2026
- 2026MM-ContextFold: Context Folding for Multimodal Agentic Retrieval19 Sep 2026
- 2026WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing4 Sep 2026
- 2026WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents28 Aug 2026
- 2026Evo-Bench: Can Language Models Improve Agent Harness?10 Aug 2026
- 2026SearchMaster: Grounded and Regulated Self-Play for Search Agents3 Aug 2026
- 2026SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task25 Jul 2026
12 newest of 27 All 27 (JSON)
- 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verificationcited by 32
- 2026STRIDE: Strategic Trajectory Reasoning via Discriminative Estimation for Verifiable Reinforcement Learningcited by 10
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learningcited by 5
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 5
- 2026IterSynth: Rethinking Deep Search Agents via Role-Decoupled Iterative Synthesiscited by 0
- 2026Neos: Learning to Interleave Search and Visual Reasoningcited by 0
- 2026Neos: Learning to Interleave Search and Visual Reasoning12 Oct 2026
- 2026IterSynth: Rethinking Deep Search Agents via Role-Decoupled Iterative Synthesis24 Sep 2026
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation7 Jul 2026
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning3 Jul 2026
- 2026STRIDE: Strategic Trajectory Reasoning via Discriminative Estimation for Verifiable Reinforcement Learning14 Jun 2026
- 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verification16 Mar 2026
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 75
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agentscited by 10
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 7
- 2026ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignmentcited by 3
- 2026False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agentscited by 1
- 2026G-ReAct: Graph-Guided Deep Search via Structure-State Co-Evolutioncited by 0
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Researchcited by 0
- 2026MemoryWalker: Stop Training Agents on Contexts They Never Sawcited by 0
- 2026Iris: Climbing to the Search Frontiercited by 0
- 2026Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Tracescited by 0
- 2026HyWe: Unifying Search and Operation for Real-World Hybrid Web Taskscited by 0
- 2026Glasseek: A Transparent Recipe for Training and Trustworthy Evaluation of DeepSearch Agentscited by 0
- 2026Glasseek: A Transparent Recipe for Training and Trustworthy Evaluation of DeepSearch Agents12 Oct 2026
- 2026HyWe: Unifying Search and Operation for Real-World Hybrid Web Tasks12 Oct 2026
- 2026False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents30 Sep 2026
- 2026Iris: Climbing to the Search Frontier3 Sep 2026
- 2026MemoryWalker: Stop Training Agents on Contexts They Never Saw1 Sep 2026
- 2026AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research26 Aug 2026
- 2026Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Traces5 Aug 2026
- 2026ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignment5 Aug 2026
- 2026G-ReAct: Graph-Guided Deep Search via Structure-State Co-Evolution2 Aug 2026
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents10 Jun 2026
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agents6 May 2026
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agents12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Supervising the search process produces reliable and generalizable information-seeking agents
- 2025RE-Searcher: Robust Agentic Search with Goal-oriented Planning and Self-reflection
- 2026Beyond Monolithic Architectures: A Multi-Agent Search and Knowledge Optimization Framework for Agentic Search
- 2025Demystifying and Enhancing the Efficiency of Large Language Model Based Search Agents
- 2026ToolSearcher: Optimizing Tool Selection at Scale via Reinforcement Learning
- 2026WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search
- 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization
- 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RL