mlsanityData to 14 Oct 2026

Mindscape-Aware Retrieval Augmented Generation for Improved Long Context Understanding

arXiv 2512.17220 ↗First posted 19 Dec 2025cs.CLcited by 5

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

Humans understand long and complex texts by relying on a holistic semantic representation of the content. This global view helps organize prior knowledge, interpret new information, and integrate evidence dispersed across a document, as revealed by the Mindscape-Aware Capability of humans in psychology. Current Retrieval-Augmented Generation (RAG) systems lack such guidance and therefore struggle with long-context tasks. In this paper, we propose Mindscape-Aware RAG (MiA-RAG), the first framework to formulate mindscape-aware retrieval and generation as a unified conditioning paradigm for LLM-based RAG. MiA-RAG builds a mindscape through hierarchical summarization and conditions both retrieval and generation on this global semantic representation. This enables the retriever to form enriched query embeddings and the generator to reason over retrieved evidence within a coherent global context. We evaluate MiA-RAG across diverse long-context and bilingual benchmarks for evidence-based understanding and global sense-making. It consistently surpasses baselines, and further analysis shows that it aligns local details with a coherent global representation, enabling more human-like long-context retrieval and reasoning.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 27 of its 54 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

27 of 54 references.

References · 27

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  4. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  5. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  6. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
  7. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  8. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
  9. 2017The NarrativeQA Reading Comprehension Challengecited by 597
  10. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  11. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
  12. 2024∞Bench: Extending Long Context Evaluation Beyond 100K Tokenscited by 367
15 more
  1. 2024Titans: Learning to Memorize at Test Timecited by 328
  2. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
  3. 2024PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inferencecited by 147
  4. 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
  5. 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
  6. 2024HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughlycited by 125
  7. 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 119
  8. 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 91
  9. 2024One Thousand and One Pairs: A "novel" challenge for long-context language modelscited by 80
  10. 2024On Large Language Models' Hallucination with Regard to Known Factscited by 43
  11. 2024DetectiveQA: Evaluating Long-Context Reasoning on Detective Novelscited by 21
  12. 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Surveycited by 18
  13. 2025LeanRAG: Knowledge-Graph-Based Generation with Semantic Aggregation and Hierarchical Retrievalcited by 16
  14. 2024Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questionscited by 11
  15. 2025SitEmb-v1.5: Improved Context-Aware Dense Retrieval for Semantic Association and Long Story Comprehensioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Grounding Long-Context Reasoning with Contextual Normalization for Retrieval-Augmented Generation
  2. 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
  3. 2024Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generation
  4. 2025HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation
  5. 2024Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts
  6. 2024Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learning
  7. 2025Beyond RAG vs. Long-Context: Learning Distraction-Aware Retrieval for Efficient Knowledge Grounding
  8. 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation