mlsanityData to 14 Oct 2026

RIVO: Lightweight Adaptive Rerouting for Deep Research Agents

arXiv 2610.15910 ↗First posted 11 Oct 2026cs.CLcited by 0

On the map: LLM agents and tool use → Web, search, and research agents also fits: Reinforcement learning for LLM agents

Abstract (arXiv)

Deep Research agents rely on long-horizon reasoning and iterative tool use to solve complex information-seeking tasks. However, adaptive decision-making over these trajectories remains challenging, as agents may stop prematurely when further evidence is needed, continue unnecessarily after sufficient evidence has been gathered, or fail to redirect unproductive trajectories. Existing solutions either require costly model retraining and dense turn-level supervision, or rely on heuristic control rules that are not directly optimized for downstream research utility. This motivates a lightweight, utility-aware alternative for Deep Research control. We formulate adaptive rerouting in long-horizon Deep Research as a state-conditioned trajectory correction problem. Based on this view, we introduce RIVO, a lightweight plug-in framework for adaptive trajectory correction. The agent estimates its research state from lightweight signals and determines whether trajectory redirection is needed. Once triggered, the plug-in modifies the Host token logits to steer generation toward a more promising research direction. Theoretical analysis shows that, under a value-alignment condition and bounded local curvature, a sufficiently small logit intervention can locally improve expected downstream research utility. We further construct BrowseCore, a curated dataset with a paired local corpus, for efficient and controlled Deep Research experimentation. Building on this resource, the plug-in is trained from downstream outcomes, enabling it to learn corrections that improve subsequent research and final task performance. Extensive experiments across multiple Deep Research benchmarks and control settings demonstrate the effectiveness of our method, showing that lightweight logit intervention can improve long-horizon research without retraining the underlying Host model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 41 references that are in the map. First posted on arXiv 11 Oct 2026.

Builds on

37 of 41 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026When Deep Research Agents Stagnate: Enhancing Reasoning with Retrieval-Aware Agent Control15 Aug
  2. 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents13 Jun
  3. 2026LiteResearcher: A Scalable Agentic RL Training Framework for Deep Research Agent20 Apr
  4. 2026EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering6 Apr
  5. 2026Marco DeepResearch: Unlocking Efficient Deep Research Agents via Verification-Centric Design30 Mar
  6. 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis17 Mar
  7. 2026Agentic-R: Learning to Retrieve for Agentic Search17 Jan
  8. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent8 Aug
  9. 2025Open Deep Search: Democratizing Search with Open-source Reasoning Agents26 Mar

Other references · 28

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  5. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  6. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  7. 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 77
  8. 2025Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn Search Agentscited by 48
  9. 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 40
  10. 2025DeepRAG: Thinking to Retrieve Step by Step for Large Language Modelscited by 38
  11. 2024BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicinecited by 31
  12. 2025DRBench: A Realistic Benchmark for Enterprise Deep Researchcited by 22
16 more
  1. 2024CancerLLM: A Large Language Model in Cancer Domaincited by 12
  2. 2024Benchmarking Retrieval-Augmented Large Language Models in Biomedical NLP: Application, Robustness, and Self-Awarenesscited by 11
  3. 2023Understand the Dynamic World: An End-to-End Knowledge Informed Framework for Open Domain Entity State Trackingcited by 9
  4. 2025Logic-RAG: Augmenting Large Multimodal Models with Visual-Spatial Knowledge for Road Scene Understandingcited by 7
  5. 2025CaRT: Teaching LLM Agents to Know When They Know Enoughcited by 7
  6. 2026GLEN-Bench: A Graph-Language based Benchmark for Nutritional Healthcited by 7
  7. 2026Counterfactual Graph for Multi-Agent LLM Calibrationcited by 7
  8. 2025Think in Parallel, Answer as One: Logit Averaging for Open-Ended Reasoningcited by 6
  9. 2025Logits are All We Need to Adapt Closed Modelscited by 5
  10. 2026Steering Language Models Before They Speak: Logit-Level Interventionscited by 4
  11. 2024A Condensed Transition Graph Framework for Zero-shot Link Prediction with Large Language Modelscited by 3
  12. 2026Stop When Further Reasoning Won't Help: Attention-State Adaptive Generation in Reasoning Modelscited by 3
  13. 2026DeepER-Med: Advancing Deep Evidence-Based Research in Medicine Through Agentic AIcited by 2
  14. 2026RICE-PO: Turning Retrieval Interactions into Credit Signals for Reasoning Agentscited by 2
  15. 2026In-Context Optimization for Retrieval-Augmented Generation: A Gradient-Descent Perspectivecited by 2
  16. 2026Efficient and Effective Internal Memory Retrieval for LLM-Based Healthcare Predictioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RE-TRAC: REcursive TRAjectory Compression for Deep Search Agents
  2. 2026Explore Before Committing: Hypothesis-Guided Search for Deep Research Agents
  3. 2026DeepRewind: Predicting and Repairing Premature Commitments in Deep Research Agents
  4. 2026AREX: Towards a Recursively Self-Improving Agent for Deep Research
  5. 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scaling
  6. 2026Where Do Deep-Research Agents Go Wrong? Span-Level Error Localization in Agent Trajectories
  7. 2026Not Worth Another Token: Marginal Value Estimation for Efficient Deep Research Agents
  8. 2026DualSpec: Accelerating Deep Research Agents via Dual-Process Action Speculation