Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 1 more
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated remarkable fluency and versatility across natural language tasks but remain fundamentally limited by their static knowledge and susceptibility to hallucinations, especially in domains requiring up to date or attribute grounded information. Retrieval Augmented Generation (RAG) addresses these challenges by integrating external retrieval mechanisms with generative models, enabling dynamic, context aware generation grounded in verifiable data sources. This survey presents a comprehensive examination of RAG as a modular and evolving paradigm that enhances factual reliability, adaptability, and task alignment in LLM based systems. We formalize the RAG framework through its three foundational components retrieval, generation, and augmentation and survey state of the art methods spanning dense and sparse retrievers, fusion strategies, embedding optimizations, and reinforcement learning based retrieval policies. Anchored around four emerging axes efficiency, security, user centric interactivity, and complex reasoning we categorize recent innovations and highlight their implications for scalability, robustness, and personalization. The paper also reviews advances in evaluation protocols, domain specific applications, and architectural variants such as Na"ive RAG, Advanced RAG, and Modular RAG. Finally, we identify persistent challenges and outline future directions aimed at advancing the integration of retrieval with LLMs for more grounded, interpretable, and controllable generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 244 of its 273 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
244 of 273 references.
Closest ancestors · 8
Same direction, newest first
- 2025Chain-of-Retrieval Augmented Generation24 Jan
- 2024Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generation28 Oct
- 2024Retrieving, Rethinking and Revising: The Chain-of-Verification Can Improve Retrieval Augmented Generation8 Oct
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation19 Sep
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec
- 2023Knowledge Editing for Large Language Models: A Survey24 Oct
- 2023Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning20 Oct
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec
Other references · 236
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
38 more
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,038
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
- 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
- 2014Memory Networkscited by 354
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2020Autoregressive Entity Retrievalcited by 333
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
- 2023Benchmarking Large Language Models in Retrieval-Augmented Generationcited by 307
- 2022Teaching language models to support answers with verified quotescited by 290
- 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
- 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 258
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 242
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 241
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
- 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
- 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 233
- 2023TidyBot: Personalized Robot Assistance with Large Language Modelscited by 219
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 217
- 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
- 2019Structured Pruning of Large Language Modelscited by 201
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
- 2023Recommender Systems with Generative Retrievalcited by 191
50 most cited of 236 All 236 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025When Retrieval Succeeds and Fails: Rethinking Retrieval-Augmented Generation for LLMs
- 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
- 2024Toward Optimal Search and Retrieval for RAG
- 2024RAGGED: Towards Informed Design of Scalable and Stable RAG Systems
- 2025Synergizing RAG and Reasoning: A Systematic Review
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
- 2024Understanding the Fundamental Design Decisions of Retrieval-Augmented Generation Systems
- 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey