mlsanityData to 14 Oct 2026

SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation

arXiv 2406.19215 ↗First posted 27 Jun 2024cs.CLcited by 40

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

This paper introduces Self-aware Knowledge Retrieval (SeaKR), a novel adaptive RAG model that extracts self-aware uncertainty of LLMs from their internal states. SeaKR activates retrieval when the LLMs present high self-aware uncertainty for generation. To effectively integrate retrieved knowledge snippets, SeaKR re-ranks them based on LLM's self-aware uncertainty to preserve the snippet that reduces their uncertainty to the utmost. To facilitate solving complex tasks that require multiple retrievals, SeaKR utilizes their self-aware uncertainty to choose among different reasoning strategies. Our experiments on both complex and simple Question Answering datasets show that SeaKR outperforms existing adaptive RAG methods. We release our code at https://github.com/THU-KEG/SeaKR.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 38 of its 51 references that are in the map. First posted on arXiv 27 Jun 2024.

Builds on

38 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity21 Mar
  2. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection17 Oct

Other references · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  10. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  11. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  12. 2022Locating and Editing Factual Associations in GPTcited by 2,691
24 more
  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  3. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  4. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  5. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  6. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  7. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  8. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  9. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  10. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  11. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  12. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  13. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  14. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  15. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  16. 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
  17. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
  18. 2024Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words?cited by 87
  19. 2023On the Calibration of Large Language Models and Alignmentcited by 73
  20. 2020IIRC: A Dataset of Incomplete Information Reading Comprehension Questionscited by 53
  21. 2024Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluationcited by 38
  22. 2023Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questionscited by 19
  23. 2024LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generationcited by 17
  24. 2024Transferable and Efficient Non-Factual Content Detection via Probe Training with Offline Consistency Checkingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 15; 2026: 20.

40 papers.

Sort:

By area:

  1. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  2. 2024A Survey on the Honesty of Large Language Modelscited by 23
  3. 2024KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Modelscited by 20
  4. 2025UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularitiescited by 20
  5. 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
  6. 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generationcited by 16
  7. 2025Query-Level Uncertainty in Large Language Modelscited by 14
  8. 2025HiPRAG: Hierarchical Process Rewards for Efficient Agentic Retrieval Augmented Generationcited by 10
  9. 2025Self-Routing RAG: Binding Selective Retrieval with Knowledge Verbalizationcited by 9
  10. 2026Adaptive Stopping for Multi-Turn LLM Reasoningcited by 7
  11. 2026To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Callingcited by 7
  12. 2025Fast or Better? Balancing Accuracy and Cost in Retrieval-Augmented Generation with Flexible User Controlcited by 6
28 more
  1. 2026RAGRouter-Bench: A Dataset and Benchmark for Adaptive RAG Routingcited by 6
  2. 2026LLMs Should Express Uncertainty Explicitlycited by 6
  3. 2025Retrieval as a Decision: Training-Free Adaptive Gating for Efficient RAGcited by 5
  4. 2024XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generationcited by 3
  5. 2025To Retrieve or Not to Retrieve? Uncertainty Detection for Dynamic Retrieval Augmented Generationcited by 3
  6. 2025HetaRAG: Hybrid Deep Retrieval-Augmented Generation across Heterogeneous Data Storescited by 3
  7. 2025Prompting is not Enough: Exploring Knowledge Integration and Controllable Generationcited by 2
  8. 2025Fast, Slow, and Tool-augmented Thinking for LLMs: A Reviewcited by 2
  9. 2026DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoningcited by 2
  10. 2025Optimizing Retrieval for RAG via Reinforcement Learningcited by 1
  11. 2026ContiguousKV: Accelerating LLM Prefill with Granularity-Aligned KV Cache Managementcited by 1
  12. 2026CompactRAG: Reducing LLM Calls and Token Overhead in Multi-Hop Question Answeringcited by 1
  13. 2026Trust or Abstain? A Self-Aware RAG Approachcited by 1
  14. 2026SAGE: SLO-Aware Adaptive Retrieval for Production RAG Systemscited by 1
  15. 2026Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidationcited by 1
  16. 2024An Overview and Discussion on Using Large Language Models for Implementation Generation of Solutions to Open-Ended Problemscited by 0
  17. 2025ICA-RAG: Information Completeness Guided Adaptive Retrieval-Augmented Generation for Disease Diagnosiscited by 0
  18. 2025Rethinking LLM Parametric Knowledge as Post-retrieval Confidence for Dynamic Retrieval and Rerankingcited by 0
  19. 2026KA2L: A Knowledge-Aware Active Learning Framework for LLMscited by 0
  20. 2026Filling the Gaps: Selective Knowledge Augmentation for LLM Recommenderscited by 0
  21. 2026A Control Architecture for Training-Free Memory Usecited by 0
  22. 2026Chain of Evidence: Pixel-Level Visual Attribution for Iterative Retrieval-Augmented Generationcited by 0
  23. 2026DynaTree: Dynamic Agentic Retrieval Tree for Time-Sensitive News Retrievalcited by 0
  24. 2026KACE: Knowledge-Adaptive Context Engineering for Mathematical Reasoningcited by 0
  25. 2026LODESTAR: Robust Entropy-Based Answer Selection in Retrieval-Augmented Generation for Question Answering -- Directing Frozen-LLM Entropy with a Reinforcement-Learned Prompt Polarizer under Misleading Passagescited by 0
  26. 2026Knowing Before Answering: Decoding Language Models for Reliable RAGcited by 0
  27. 2026When Retrieval Helps: Selective Retrieval for Single-Turn Mental-Health QAcited by 0
  28. 2026Locating Answer-Correctness Signals in Frozen Large Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home
  2. 2026Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering
  3. 2025Towards Adaptive Memory-Based Optimization for Enhanced Retrieval-Augmented Generation
  4. 2025Optimizing Knowledge Integration in Retrieval-Augmented Generation with Self-Selection
  5. 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering
  6. 2026URAG: A Benchmark for Uncertainty Quantification in Retrieval-Augmented Large Language Models
  7. 2025MCTS-RAG: Enhancing Retrieval-Augmented Generation with Monte Carlo Tree Search
  8. 2026Decide Then Retrieve: A Training-Free Framework with Uncertainty-Guided Triggering and Dual-Path Retrieval