mlsanityData to 7 Oct 2026

Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning

arXiv 2610.01936 ↗First posted 1 Oct 2026cs.AIcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) have demonstrated remarkable fluency and versatility across natural language tasks but remain fundamentally limited by their static knowledge and susceptibility to hallucinations, especially in domains requiring up to date or attribute grounded information. Retrieval Augmented Generation (RAG) addresses these challenges by integrating external retrieval mechanisms with generative models, enabling dynamic, context aware generation grounded in verifiable data sources. This survey presents a comprehensive examination of RAG as a modular and evolving paradigm that enhances factual reliability, adaptability, and task alignment in LLM based systems. We formalize the RAG framework through its three foundational components retrieval, generation, and augmentation and survey state of the art methods spanning dense and sparse retrievers, fusion strategies, embedding optimizations, and reinforcement learning based retrieval policies. Anchored around four emerging axes efficiency, security, user centric interactivity, and complex reasoning we categorize recent innovations and highlight their implications for scalability, robustness, and personalization. The paper also reviews advances in evaluation protocols, domain specific applications, and architectural variants such as Na"ive RAG, Advanced RAG, and Modular RAG. Finally, we identify persistent challenges and outline future directions aimed at advancing the integration of retrieval with LLMs for more grounded, interpretable, and controllable generation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 244 of its 273 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

244 of 273 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Chain-of-Retrieval Augmented Generation24 Jan
  2. 2024Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generation28 Oct
  3. 2024Retrieving, Rethinking and Revising: The Chain-of-Verification Can Improve Retrieval Augmented Generation8 Oct
  4. 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation19 Sep
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec
  6. 2023Knowledge Editing for Large Language Models: A Survey24 Oct
  7. 2023Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning20 Oct
  8. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec

Other references · 236

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  7. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  8. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  9. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  10. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  11. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  12. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
38 more
  1. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,038
  2. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  3. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
  4. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  5. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  6. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  7. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  8. 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
  9. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
  10. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  11. 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
  12. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  13. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  14. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
  15. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
  16. 2014Memory Networkscited by 354
  17. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  18. 2020Autoregressive Entity Retrievalcited by 333
  19. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  20. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
  21. 2023Benchmarking Large Language Models in Retrieval-Augmented Generationcited by 307
  22. 2022Teaching language models to support answers with verified quotescited by 290
  23. 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
  24. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  25. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
  26. 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 258
  27. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
  28. 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 242
  29. 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 241
  30. 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
  31. 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
  32. 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 233
  33. 2023TidyBot: Personalized Robot Assistance with Large Language Modelscited by 219
  34. 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 217
  35. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
  36. 2019Structured Pruning of Large Language Modelscited by 201
  37. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
  38. 2023Recommender Systems with Generative Retrievalcited by 191

50 most cited of 236 All 236 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025When Retrieval Succeeds and Fails: Rethinking Retrieval-Augmented Generation for LLMs
  2. 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
  3. 2024Toward Optimal Search and Retrieval for RAG
  4. 2024RAGGED: Towards Informed Design of Scalable and Stable RAG Systems
  5. 2025Synergizing RAG and Reasoning: A Systematic Review
  6. 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
  7. 2024Understanding the Fundamental Design Decisions of Retrieval-Augmented Generation Systems
  8. 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey