Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
LLM-powered search agents are increasingly being used for multi-step information seeking tasks, yet the IR community lacks empirical understanding of how agentic search sessions unfold and how retrieved evidence is reflected in later queries. This paper presents a large-scale log analysis of agentic search based on 14.44M search requests (3.97M sessions) collected from DeepResearchGym, i.e., an open-source search API accessed by external agentic clients. We sessionize the logs, assign session-level intents and step-wise query-reformulation labels using LLM-based annotation, and propose Context-driven Term Adoption Rate (CTAR) to quantify whether newly introduced query terms are lexically traceable to previously retrieved evidence. Our analyses reveal distinctive behavioral patterns. First, over 90% of multi-turn sessions contain at most ten steps, and 89% of inter-step intervals fall under one minute. Second, behavior varies by intent. Fact-seeking sessions exhibit high repetition that increases over time, while sessions requiring reasoning sustain broader exploration. Third, query reformulations are often traceable to retrieved evidence across steps. On average, 54% of newly introduced query terms appear in the accumulated evidence context, with additional traceability to earlier steps beyond the most recent retrieval. These findings provide candidate signals for repetition-aware stopping, intent-adaptive retrieval budgeting, and explicit cross-step context tracking. We released the anonymized logs, making them available at a public HuggingFace~chrefhttps://huggingface.co/datasets/cx-cmu/deepresearchgym-agentic-search-logsrepository.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 16 of its 60 references that are in the map. First posted on arXiv 24 Jan 2026.
Builds on
16 of 60 references.
Closest ancestors · 2
Same direction, newest first
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul
Other references · 14
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
- 2025Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversationscited by 96
- 2025How Do AI Agents Do Human Work? Comparing AI and Human Workflows Across Diverse Occupationscited by 19
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Revision or Re-Solving? Decomposing Second-Pass Gains in Multi-LLM Pipelinescited by 7
- 2026Effective Reinforcement Learning for Agentic Search by Recycling Zero-Variance Queries During Trainingcited by 3
- 2026Same Agent, Different Answers: A Repeat-Aware Audit of Corpus-Induced Answer Churn in Retrieval-Augmented QAcited by 1
- 2026DeepStress: Stress-Testing Deep Search Agentscited by 0
- 2026Same Agent, Different Answers: A Repeat-Aware Audit of Corpus-Induced Answer Churn in Retrieval-Augmented QA24 Aug 2026
- 2026DeepStress: Stress-Testing Deep Search Agents15 Jul 2026
- 2026Effective Reinforcement Learning for Agentic Search by Recycling Zero-Variance Queries During Training9 Jun 2026
- 2026Revision or Re-Solving? Decomposing Second-Pass Gains in Multi-LLM Pipelines1 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
- 2026Characterizing Web Search by Conversational LLM Agents: From Search Decisions and Strategies to Results and Responses
- 2025Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search
- 2026A Picture of Agentic Search
- 2026From Delivery to Stateful Exploration: Rethinking the Index for Agentic Search
- 2026DailyReport: An Open-ended Benchmark for Evaluating Search Agents on Daily Search Tasks
- 2025Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge
- 2025RAVine: Reality-Aligned Evaluation for Agentic Search