mlsanityData to 14 Oct 2026

Agentic AutoSurvey: Let LLMs Survey LLMs

arXiv 2509.18661 ↗First posted 23 Sep 2025cs.IR cs.CL cs.HCcited by 4

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

The exponential growth of scientific literature poses unprecedented challenges for researchers attempting to synthesize knowledge across rapidly evolving fields. We present Agentic AutoSurvey, a multi-agent framework for automated survey generation that addresses fundamental limitations in existing approaches. Our system employs four specialized agents (Paper Search Specialist, Topic Mining & Clustering, Academic Survey Writer, and Quality Evaluator) working in concert to generate comprehensive literature surveys with superior synthesis quality. Through experiments on six representative LLM research topics from COLM 2024 categories, we demonstrate that our multi-agent approach achieves significant improvements over existing baselines, scoring 8.18/10 compared to AutoSurvey's 4.77/10. The multi-agent architecture processes 75--443 papers per topic (847 total across six topics) while targeting high citation coverage (often ≥80% on 75--100-paper sets; lower on very large sets such as RLHF) through specialized agent orchestration. Our 12-dimension evaluation captures organization, synthesis integration, and critical analysis beyond basic metrics. These findings demonstrate that multi-agent architectures represent a meaningful advancement for automated literature survey generation in rapidly evolving scientific domains.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 45 of its 75 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

45 of 75 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025DataSciBench: An LLM Agent Benchmark for Data Science19 Feb
  2. 2025PaSa: An LLM Agent for Comprehensive Academic Paper Search17 Jan
  3. 2023TaskWeaver: A Code-First Agent Framework29 Nov
  4. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul

Other references · 41

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  7. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  9. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  11. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  12. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
29 more
  1. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  2. 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
  3. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  4. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 437
  5. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
  6. 2024Understanding the planning of LLM agents: A surveycited by 421
  7. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
  8. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 306
  9. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 288
  10. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
  11. 2024LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworkscited by 179
  12. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
  13. 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attackscited by 145
  14. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 137
  15. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoningcited by 124
  16. 2024AgentScope: A Flexible yet Robust Multi-Agent Platformcited by 121
  17. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
  18. 2023The Semantic Scholar Open Data Platformcited by 118
  19. 2024LLM Agents can Autonomously Hack Websitescited by 109
  20. 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 87
  21. 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
  22. 2024Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluationcited by 75
  23. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 55
  24. 2024LitSearch: A Retrieval Benchmark for Scientific Literature Searchcited by 50
  25. 2024When is Tree Search Useful for LLM Planning? It Depends on the Discriminatorcited by 47
  26. 2024Towards Efficient LLM Grounding for Embodied Multi-Agent Collaborationcited by 45
  27. 2024ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoningcited by 31
  28. 2024SurveyAgent: A Conversational System for Personalized and Efficient Research Surveycited by 11
  29. 2024Comprehensive Evaluation of Large Language Models for Topic Modelingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SurveyAgent-HKA: A multi-agent framework for scientific survey generation with LLMs and human knowledge augmentation
  2. 2025SurveyG: A Multi-Agent LLM Framework with Hierarchical Citation Graph for Automated Survey Generation
  3. 2025A Vision for Auto Research with LLM Agents
  4. 2025ARISE: Agentic Rubric-Guided Iterative Survey Engine for Automated Scholarly Paper Generation
  5. 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automation
  6. 2025SciSage: A Multi-Agent Framework for High-Quality Scientific Survey Generation
  7. 2025AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveys
  8. 2026STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generation