ARISE: Agentic Rubric-Guided Iterative Survey Engine for Automated Scholarly Paper Generation
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
The rapid expansion of scholarly literature presents significant challenges in synthesizing comprehensive, high-quality academic surveys. Recent advancements in agentic systems offer considerable promise for automating tasks that traditionally require human expertise, including literature review, synthesis, and iterative refinement. However, existing automated survey-generation solutions often suffer from inadequate quality control, poor formatting, and limited adaptability to iterative feedback, which are core elements intrinsic to scholarly writing. To address these limitations, we introduce ARISE, an Agentic Rubric-guided Iterative Survey Engine designed for automated generation and continuous refinement of academic survey papers. ARISE employs a modular architecture composed of specialized large language model agents, each mirroring distinct scholarly roles such as topic expansion, citation curation, literature summarization, manuscript drafting, and peer-review-based evaluation. Central to ARISE is a rubric-guided iterative refinement loop in which multiple reviewer agents independently assess manuscript drafts using a structured, behaviorally anchored rubric, systematically enhancing the content through synthesized feedback. Evaluating ARISE against state-of-the-art automated systems and recent human-written surveys, our experimental results demonstrate superior performance, achieving an average rubric-aligned quality score of 92.48. ARISE consistently surpasses baseline methods across metrics of comprehensiveness, accuracy, formatting, and overall scholarly rigor. All code, evaluation rubrics, and generated outputs are provided openly at https://github.com/ziwang11112/ARISE
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 39 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
25 of 39 references.
References · 25
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2023Evaluating Large Language Models: A Comprehensive Surveycited by 202
- 2020Open Problems in Cooperative AIcited by 168
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
13 more
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 94
- 2024A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendationscited by 85
- 2025SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writingcited by 49
- 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMscited by 38
- 2025100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Modelscited by 30
- 2025SurveyX: Academic Survey Automation via Large Language Modelscited by 29
- 2025MM-Agent: LLM as Agents for Real-world Mathematical Modeling Problemcited by 25
- 2023Automated Grading and Feedback Tools for Programming Education: A Systematic Reviewcited by 17
- 2025Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applicationscited by 10
- 2024Automated Review Generation Method Based on Large Language Modelscited by 7
- 2025A Methodological and Structural Review of Parkinsons Disease Detection Across Diverse Data Modalitiescited by 4
- 2025Generative Machine Learning in Adaptive Control of Dynamic Manufacturing Processes: A Reviewcited by 2
- 2025Understanding the Impact of Artificial Intelligence in Academic Writing: Metadata to the Rescuecited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026How Far Are We? Systematic Evaluation of LLMs vs. Human Experts in Mathematical Contest in Modelingcited by 0
- 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automationcited by 0
- 2026Paper Pilot: A Human-in-the-Loop Expert System for Evidence-Traceable Scientific Manuscript Generation in Applied Sciencescited by 0
- 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automation18 Aug 2026
- 2026Paper Pilot: A Human-in-the-Loop Expert System for Evidence-Traceable Scientific Manuscript Generation in Applied Sciences17 Jun 2026
- 2026How Far Are We? Systematic Evaluation of LLMs vs. Human Experts in Mathematical Contest in Modeling6 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Agentic AutoSurvey: Let LLMs Survey LLMs
- 2025SciSage: A Multi-Agent Framework for High-Quality Scientific Survey Generation
- 2026SurveyAgent-HKA: A multi-agent framework for scientific survey generation with LLMs and human knowledge augmentation
- 2026SurveyLens: A Discipline-Aware Benchmark for Automatic Survey Generation
- 2026Agentic AI-Empowered Dynamic Survey Framework
- 2026STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generation
- 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation
- 2026DeepSurvey: Agent-Oriented Automated Survey Generation with Analytical Depth and Citation Reliability