RAPID: Efficient Retrieval-Augmented Long Text Generation with Writing Planning and Information Discovery
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Generating knowledge-intensive and comprehensive long texts, such as encyclopedia articles, remains significant challenges for Large Language Models. It requires not only the precise integration of facts but also the maintenance of thematic coherence throughout the article. Existing methods, such as direct generation and multi-agent discussion, often struggle with issues like hallucinations, topic incoherence, and significant latency. To address these challenges, we propose RAPID, an efficient retrieval-augmented long text generation framework. RAPID consists of three main modules: (1) Retrieval-augmented preliminary outline generation to reduce hallucinations, (2) Attribute-constrained search for efficient information discovery, (3) Plan-guided article generation for enhanced coherence. Extensive experiments on our newly compiled benchmark dataset, FreshWiki-2024, demonstrate that RAPID significantly outperforms state-of-the-art methods across a wide range of evaluation metrics (e.g. long-text generation, outline quality, latency, etc). Our work provides a robust and efficient solution to the challenges of automated long-text generation.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 30 of its 47 references that are in the map. First posted on arXiv 2 Mar 2025.
Builds on
30 of 47 references.
Closest ancestors · 2
Same direction, newest first
- 2024ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities19 Jul
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs21 Jun
Other references · 28
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
- 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 431
- 2023A Survey on Large Language Models for Recommendationcited by 378
16 more
- 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 142
- 2023The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediationscited by 130
- 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 116
- 2023On Learning to Summarize with Large Language Models as Referencescited by 80
- 2021Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherencecited by 45
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
- 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
- 2023Exploring the Potential of Large Language Models in Computational Argumentationcited by 42
- 2024Suri: Multi-constraint Instruction Following for Long-form Text Generationcited by 34
- 2024GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translatorscited by 22
- 2023Beyond Summarization: Designing AI Support for Real-World Expository Writing Taskscited by 20
- 2024CharPoet: A Chinese Classical Poetry Generation System Based on Token-free LLMcited by 18
- 2024CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Controlcited by 13
- 2023EIPE-text: Evaluation-Guided Iterative Plan Extraction for Long-Form Narrative Text Generationcited by 12
- 2023Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Controlcited by 5
Built on by
Citing papers per year: 2025: 10; 2026: 9.
19 papers.
Sort:
By area:
- 2025Thought-Augmented Planning for LLM-Powered Interactive Recommender Agentcited by 17
- 2025CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steeringcited by 12
- 2025SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignmentcited by 9
- 2025Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generationcited by 7
- 2026DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytellingcited by 7
- 2025RAG-IGBench: Innovative Evaluation for RAG-based Interleaved Generation in Open-domain Question Answeringcited by 4
- 2026SPARD: Self-Paced Curriculum for RL Alignment via Integrating Reward Dynamics and Data Utilitycited by 4
- 2026Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibrationcited by 4
- 2026Deep-Reporter: Deep Research for Grounded Multimodal Long-Form Generationcited by 4
- 2025Revisiting scalable sequential recommendation with Multi-Embedding Approach and Mixture-of-Expertscited by 3
- 2026Efficient Personalized Reranking with Semi-Autoregressive Generation and Online Knowledge Distillationcited by 3
- 2026IE as Cache: Information Extraction Enhanced Agentic Reasoningcited by 3
7 more
- 2026Mind2Report: Expert-Level Commercial Report Synthesis via Cognitive Deep Research Agentcited by 2
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generationcited by 1
- 2025LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Modelscited by 1
- 2025DeepWriter: A Fact-Grounded Multimodal Writing Assistant Based On Offline Knowledge Basecited by 1
- 2026SPARC-RAG: Adaptive Sequential-Parallel Scaling with Context Management for Retrieval-Augmented Generationcited by 1
- 2025The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativitycited by 0
- 2026Rethinking the Necessity of Adaptive Retrieval-Augmented Generation through the Lens of Adaptive Listwise Rankingcited by 0
- 2026Rethinking the Necessity of Adaptive Retrieval-Augmented Generation through the Lens of Adaptive Listwise Ranking17 Apr 2026
- 2026IE as Cache: Information Extraction Enhanced Agentic Reasoning16 Apr 2026
- 2026Deep-Reporter: Deep Research for Grounded Multimodal Long-Form Generation12 Apr 2026
- 2026Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibration11 Apr 2026
- 2026SPARD: Self-Paced Curriculum for RL Alignment via Integrating Reward Dynamics and Data Utility9 Apr 2026
- 2026DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling7 Apr 2026
- 2026Efficient Personalized Reranking with Semi-Autoregressive Generation and Online Knowledge Distillation7 Mar 2026
- 2026SPARC-RAG: Adaptive Sequential-Parallel Scaling with Context Management for Retrieval-Augmented Generation22 Jan 2026
- 2026Mind2Report: Expert-Level Commercial Report Synthesis via Cognitive Deep Research Agent8 Jan 2026
- 2025The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativity3 Nov 2025
- 2025Revisiting scalable sequential recommendation with Multi-Embedding Approach and Mixture-of-Experts29 Oct 2025
- 2025RAG-IGBench: Innovative Evaluation for RAG-based Interleaved Generation in Open-domain Question Answering11 Oct 2025
7 more
- 2025SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment4 Sep 2025
- 2025DeepWriter: A Fact-Grounded Multimodal Writing Assistant Based On Offline Knowledge Base14 Jul 2025
- 2025CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steering7 Jul 2025
- 2025Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent30 Jun 2025
- 2025LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Models3 Jun 2025
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
- 2025Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation13 May 2025
- 2025SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignmentcited by 9
- 2025Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generationcited by 7
- 2026SPARC-RAG: Adaptive Sequential-Parallel Scaling with Context Management for Retrieval-Augmented Generationcited by 1
- 2026SPARC-RAG: Adaptive Sequential-Parallel Scaling with Context Management for Retrieval-Augmented Generation22 Jan 2026
- 2025SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment4 Sep 2025
- 2025Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation13 May 2025
- 2025CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steeringcited by 12
- 2026DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytellingcited by 7
- 2025RAG-IGBench: Innovative Evaluation for RAG-based Interleaved Generation in Open-domain Question Answeringcited by 4
- 2026SPARD: Self-Paced Curriculum for RL Alignment via Integrating Reward Dynamics and Data Utilitycited by 4
- 2026Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibrationcited by 4
- 2026Efficient Personalized Reranking with Semi-Autoregressive Generation and Online Knowledge Distillationcited by 3
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generationcited by 1
- 2025LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Modelscited by 1
- 2025DeepWriter: A Fact-Grounded Multimodal Writing Assistant Based On Offline Knowledge Basecited by 1
- 2025The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativitycited by 0
- 2026Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibration11 Apr 2026
- 2026SPARD: Self-Paced Curriculum for RL Alignment via Integrating Reward Dynamics and Data Utility9 Apr 2026
- 2026DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling7 Apr 2026
- 2026Efficient Personalized Reranking with Semi-Autoregressive Generation and Online Knowledge Distillation7 Mar 2026
- 2025The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativity3 Nov 2025
- 2025RAG-IGBench: Innovative Evaluation for RAG-based Interleaved Generation in Open-domain Question Answering11 Oct 2025
- 2025DeepWriter: A Fact-Grounded Multimodal Writing Assistant Based On Offline Knowledge Base14 Jul 2025
- 2025CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steering7 Jul 2025
- 2025LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Models3 Jun 2025
- 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation26 May 2025
Similar, not cited
Close in wording, no citation either way
- 2024Retrieval is Accurate Generation
- 2025Lost-in-the-Middle in Long-Text Generation: Synthetic Dataset, Evaluation Framework, and Mitigation
- 2024Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generation
- 2026Improving Attributed Long-form Question Answering with Intent Awareness
- 2023Active Retrieval Augmented Generation
- 2025ParetoRAG: Leveraging Sentence-Context Attention for Robust and Efficient Retrieval-Augmented Generation
- 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Models
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation