Mindscape-Aware Retrieval Augmented Generation for Improved Long Context Understanding
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Humans understand long and complex texts by relying on a holistic semantic representation of the content. This global view helps organize prior knowledge, interpret new information, and integrate evidence dispersed across a document, as revealed by the Mindscape-Aware Capability of humans in psychology. Current Retrieval-Augmented Generation (RAG) systems lack such guidance and therefore struggle with long-context tasks. In this paper, we propose Mindscape-Aware RAG (MiA-RAG), the first framework to formulate mindscape-aware retrieval and generation as a unified conditioning paradigm for LLM-based RAG. MiA-RAG builds a mindscape through hierarchical summarization and conditions both retrieval and generation on this global semantic representation. This enables the retriever to form enriched query embeddings and the generator to reason over retrieved evidence within a coherent global context. We evaluate MiA-RAG across diverse long-context and bilingual benchmarks for evidence-based understanding and global sense-making. It consistently surpasses baselines, and further analysis shows that it aligns local details with a coherent global representation, enabling more human-like long-context retrieval and reasoning.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 27 of its 54 references that are in the map. First posted on arXiv 19 Dec 2025.
Builds on
27 of 54 references.
References · 27
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
- 2017The NarrativeQA Reading Comprehension Challengecited by 597
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
- 2024∞Bench: Extending Long Context Evaluation Beyond 100K Tokenscited by 367
15 more
- 2024Titans: Learning to Memorize at Test Timecited by 328
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
- 2024PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inferencecited by 147
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
- 2024HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughlycited by 125
- 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 119
- 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 91
- 2024One Thousand and One Pairs: A "novel" challenge for long-context language modelscited by 80
- 2024On Large Language Models' Hallucination with Regard to Known Factscited by 43
- 2024DetectiveQA: Evaluating Long-Context Reasoning on Detective Novelscited by 21
- 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
- 2025LeanRAG: Knowledge-Graph-Based Generation with Semantic Aggregation and Hierarchical Retrievalcited by 16
- 2024Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questionscited by 11
- 2025SitEmb-v1.5: Improved Context-Aware Dense Retrieval for Semantic Association and Long Story Comprehensioncited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Query-focused and Memory-aware Reranker for Long Context Processingcited by 6
- 2026A New Role for Relevance: Guiding Corpus Interaction in Agentic Searchcited by 3
- 2026Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generationcited by 1
- 2026MiA-Signature: Approximating Global Activation for Long-Context Understandingcited by 1
- 2026ExDR: Explanation-driven Dynamic Retrieval Enhancement for Multimodal Fake News Detectioncited by 0
- 2026A New Role for Relevance: Guiding Corpus Interaction in Agentic Search27 Jul 2026
- 2026MiA-Signature: Approximating Global Activation for Long-Context Understanding7 May 2026
- 2026Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation2 May 2026
- 2026Query-focused and Memory-aware Reranker for Long Context Processing12 Feb 2026
- 2026ExDR: Explanation-driven Dynamic Retrieval Enhancement for Multimodal Fake News Detection22 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Grounding Long-Context Reasoning with Contextual Normalization for Retrieval-Augmented Generation
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
- 2024Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generation
- 2025HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation
- 2024Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts
- 2024Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learning
- 2025Beyond RAG vs. Long-Context: Learning Distraction-Aware Retrieval for Efficient Knowledge Grounding
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation