mlsanityData to 14 Oct 2026

Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests

arXiv 2601.17617 ↗First posted 24 Jan 2026cs.IR cs.CLcited by 4

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

LLM-powered search agents are increasingly being used for multi-step information seeking tasks, yet the IR community lacks empirical understanding of how agentic search sessions unfold and how retrieved evidence is reflected in later queries. This paper presents a large-scale log analysis of agentic search based on 14.44M search requests (3.97M sessions) collected from DeepResearchGym, i.e., an open-source search API accessed by external agentic clients. We sessionize the logs, assign session-level intents and step-wise query-reformulation labels using LLM-based annotation, and propose Context-driven Term Adoption Rate (CTAR) to quantify whether newly introduced query terms are lexically traceable to previously retrieved evidence. Our analyses reveal distinctive behavioral patterns. First, over 90% of multi-turn sessions contain at most ten steps, and 89% of inter-step intervals fall under one minute. Second, behavior varies by intent. Fact-seeking sessions exhibit high repetition that increases over time, while sessions requiring reasoning sustain broader exploration. Third, query reformulations are often traceable to retrieved evidence across steps. On average, 54% of newly introduced query terms appear in the accumulated evidence context, with additional traceability to earlier steps beyond the most recent retrieval. These findings provide candidate signals for repetition-aware stopping, intent-adaptive retrieval budgeting, and explicit cross-step context tracking. We released the anonymized logs, making them available at a public HuggingFace~chrefhttps://huggingface.co/datasets/cx-cmu/deepresearchgym-agentic-search-logsrepository.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 16 of its 60 references that are in the map. First posted on arXiv 24 Jan 2026.

Builds on

16 of 60 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
  2. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul

Other references · 14

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  3. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  5. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  6. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  7. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
  8. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
  9. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  10. 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
  11. 2025Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversationscited by 96
  12. 2025How Do AI Agents Do Human Work? Comparing AI and Human Workflows Across Diverse Occupationscited by 19
2 more
  1. 2025Human vs. Agent in Task-Oriented Conversationscited by 9
  2. 2025Psychological and behavioural responses in human-agent vs. human-human interactions: a systematic review and meta-analysiscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
  2. 2026Characterizing Web Search by Conversational LLM Agents: From Search Decisions and Strategies to Results and Responses
  3. 2025Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search
  4. 2026A Picture of Agentic Search
  5. 2026From Delivery to Stateful Exploration: Rethinking the Index for Agentic Search
  6. 2026DailyReport: An Open-ended Benchmark for Evaluating Search Agents on Daily Search Tasks
  7. 2025Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge
  8. 2025RAVine: Reality-Aligned Evaluation for Agentic Search