mlsanityData to 14 Oct 2026

Metacognitive Retrieval-Augmented Large Language Models

arXiv 2402.11626 ↗First posted 18 Feb 2024cs.CL cs.IRcited by 26

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Retrieval-augmented generation have become central in natural language processing due to their efficacy in generating factual content. While traditional methods employ single-time retrieval, more recent approaches have shifted towards multi-time retrieval for multi-hop reasoning tasks. However, these strategies are bound by predefined reasoning steps, potentially leading to inaccuracies in response generation. This paper introduces MetaRAG, an approach that combines the retrieval-augmented generation process with metacognition. Drawing from cognitive psychology, metacognition allows an entity to self-reflect and critically evaluate its cognitive processes. By integrating this, MetaRAG enables the model to monitor, evaluate, and plan its response strategies, enhancing its introspective reasoning abilities. Through a three-step metacognitive regulation pipeline, the model can identify inadequacies in initial cognitive responses and fixes them. Empirical evaluations show that MetaRAG significantly outperforms existing methods.

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 39 references that are in the map. First posted on arXiv 18 Feb 2024.

Builds on

28 of 39 references.

References · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  8. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  9. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  10. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  11. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  12. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
16 more
  1. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  2. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  3. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  4. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
  5. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  6. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
  7. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
  8. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  9. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  10. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  11. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
  12. 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
  13. 2020Detecting Hallucinated Content in Conditional Neural Sequence Generationcited by 152
  14. 2022Training Language Models with Memory Augmentationcited by 113
  15. 2021Efficient Nearest Neighbor Language Modelscited by 93
  16. 2022Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformercited by 45

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 10; 2026: 8.

26 papers.

Sort:

By area:

  1. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  2. 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 166
  3. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  4. 2024Sufficient Context: A New Lens on Retrieval Augmented Generation Systemscited by 72
  5. 2025Language Models Are Capable of Metacognitive Monitoring and Control of Their Internal Activationscited by 41
  6. 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 36
  7. 2024Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generationcited by 27
  8. 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Surveycited by 20
  9. 2024Imagining and building wise machines: The centrality of AI metacognitioncited by 12
  10. 2024Right this way: Can VLMs Guide Us to See More to Answer Questions?cited by 10
  11. 2025EviNote-RAG: Enhancing RAG Models via Answer-Supportive Evidence Notescited by 8
  12. 2024AssistRAG: Boosting the Potential of Large Language Models with an Intelligent Information Assistantcited by 5
14 more
  1. 2025AccessGuru: Leveraging LLMs to Detect and Correct Web Accessibility Violations in HTML Codecited by 4
  2. 2026The Alignment Tax: Response Homogenization in Aligned LLMs and Its Implications for Uncertainty Estimationcited by 4
  3. 2026Reinforcement Learning with Metacognitive Feedback Elicits Faithful Uncertainty Expression in LLMscited by 4
  4. 2025Identifying, Evaluating, and Mitigating Risks of AI Thought Partnershipscited by 3
  5. 2025MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generationcited by 3
  6. 2024SRSA: A Cost-Efficient Strategy-Router Search Agent for Real-world Human-Machine Interactionscited by 2
  7. 2025Confident RAG: Enhancing the Performance of LLMs for Mathematics Question Answering through Multi-Embedding and Confidence Scoringcited by 2
  8. 2026Fine-Tuning Language Models to Know What They Knowcited by 2
  9. 2026STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answeringcited by 1
  10. 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
  11. 2025A Pilot Empirical Study on When and How to Use Knowledge Graphs as Retrieval Augmented Generationcited by 0
  12. 2026A Reproducibility Study of Metacognitive Retrieval-Augmented Generationcited by 0
  13. 2026Metacognition Should Be the Scientific Framework for Bounded and Effective Self-Governance in Generative AIcited by 0
  14. 2026When Tools Silently Lie: Evaluating and Mitigating Blind Compliance in Tool-Augmented Data Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Self-cognitive Exploration: Metacognitive Knowledge Graph Retrieval Augmented Generation
  2. 2025DeepRAG: Thinking to Retrieve Step by Step for Large Language Models
  3. 2024RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation
  4. 2026Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning
  5. 2026CWM: Controllable White-Box Meta-Prompting for Adaptive Retrieval-Augmented Generation and Reasoning Ability
  6. 2026To Memorize or to Retrieve: Scaling the Interaction Between Pretraining and Retrieval
  7. 2026CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoning
  8. 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation