Dynamic and Parametric Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However, conventional RAG systems typically adopt a static retrieve-then-generate pipeline and rely on in-context knowledge injection, which can be suboptimal for complex tasks that require multihop reasoning, adaptive information access, and deeper integration of external knowledge. Motivated by these limitations, the research community has moved beyond static retrieval and in-context knowledge injection. Among the emerging directions, this tutorial delves into two rapidly growing and complementary research areas on RAG: Dynamic RAG and Parametric RAG. Dynamic RAG adaptively determines when and what to retrieve during the LLM's generation process, enabling real-time adaptation to the LLM's evolving information needs. Parametric RAG rethinks how retrieved knowledge should be injected into LLMs, transitioning from input-level to parameter-level knowledge injection for enhanced efficiency and effectiveness. This tutorial offers a comprehensive overview of recent advances in these emerging research areas. It also shares theoretical foundations and practical insights to support and inspire further research in RAG.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 24 of its 47 references that are in the map. First posted on arXiv 7 Jun 2025.
Builds on
24 of 47 references.
Closest ancestors · 3
Same direction, newest first
- 2025Dynamic Parametric Retrieval Augmented Generation for Test-time Knowledge Enhancement31 Mar
- 2025Parametric Retrieval Augmented Generation27 Jan
- 2024DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Models15 Mar
Other references · 21
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2023Knowledge Editing for Large Language Models: A Surveycited by 194
- 2021Condenser: a Pre-training Architecture for Dense Retrievalcited by 162
- 2024Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Modelscited by 86
9 more
- 2022Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformercited by 45
- 2023Neuron-Level Knowledge Attribution in Large Language Modelscited by 37
- 2024Knowledge Editing through Chain-of-Thoughtcited by 26
- 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal Systemcited by 18
- 2024Mitigating Entity-Level Hallucination in Large Language Modelscited by 17
- 2023CaseEncoder: A Knowledge-enhanced Pre-trained Model for Legal Case Encodingcited by 14
- 2024LeKUBE: A Legal Knowledge Update BEnchmarkcited by 12
- 2025Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editingcited by 12
- 2023Caseformer: Pre-training for Legal Case Retrieval Based on Inter-Case Distinctionscited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey
- 2025RAGTrace: Understanding and Refining Retrieval-Generation Dynamics in Retrieval-Augmented Generation
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation
- 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey
- 2025When Retrieval Succeeds and Fails: Rethinking Retrieval-Augmented Generation for LLMs
- 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directions
- 2024Deploying Large Language Models With Retrieval Augmented Generation
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning