mlsanityData to 14 Oct 2026

VikingRAG: Accurate and Token-efficient Retrieval-augmented Generation over Structured Documents

arXiv 2609.11390 ↗First posted 10 Sep 2026cs.IR cs.AI cs.CLcited by 0

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

also in 1 more
Abstract (arXiv)

State-of-the-art retrieval-augmented generation (RAG) methods exploit document structures to acquire sufficient evidence, but often incur substantial token costs. To reduce structural-context tokens without compromising high RAG accuracy, we present sf VikingRAG, a directory-aware semantic data management system that tightly integrates semantic and structural access to support structural-context-efficient, evidence-gap-driven multi-round retrieval. To further reduce token overhead of multi-round interaction, we materialize agentic multi-round retrieval traces as experience edges, and reuse these edges for similar queries, avoiding repeated multi-round exploration. To additionally reduce token costs when agentic multi-round retrieval is unnecessary, we introduce an adaptive escalation strategy that answers from one-round experience-augmented retrieval when the evidence is sufficient, and invokes agentic multi-round retrieval only otherwise. Experiments on real datasets show that the base system sf VikingRAG matches high accuracy of state-of-the-art methods while consuming only 11.6%--51.9% of their tokens. With retrieval-trace reuse and adaptive escalation, token costs drop to 5.1%--32.5% while maintaining competitive accuracy and practical document-storage performance, showing the utility of this work for emerging AI knowledge bases.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 45 of its 105 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

45 of 105 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspective1 Oct
  2. 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach23 Jul
  3. 2024Question-Based Retrieval using Atomic Units for Enterprise RAG20 May

Other references · 42

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  5. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  6. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  7. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  8. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  9. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
  10. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
  11. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
  12. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
30 more
  1. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
  2. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
  3. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
  4. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
  5. 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 376
  6. 2023Large Language Models are Effective Text Rankers with Pairwise Ranking Promptingcited by 307
  7. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
  8. 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
  9. 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
  10. 2024Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAcited by 122
  11. 2024Retrieval-Augmented Generation with Knowledge Graphs for Customer Service Question Answeringcited by 96
  12. 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
  13. 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
  14. 2019Neo: A Learned Query Optimizercited by 80
  15. 2020Bao: Learning to Steer Query Optimizerscited by 62
  16. 2025Rank-R1: Enhancing Reasoning in LLM-based Document Rerankers via Reinforcement Learningcited by 60
  17. 2025Retrieval-Augmented Generation with Hierarchical Knowledgecited by 47
  18. 2025In-depth Analysis of Graph-based RAG in a Unified Frameworkcited by 46
  19. 2024Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QAcited by 25
  20. 2025FinSage: A Multi-aspect RAG System for Financial Filings Question Answeringcited by 19
  21. 2025BookRAG: A Hierarchical Structure-aware Index-based Approach for Retrieval-Augmented Generation on Complex Documentscited by 16
  22. 2025Federated Retrieval Augmented Generation for Multi-Product Question Answeringcited by 10
  23. 2025QUEST: Query Optimization in Unstructured Document Analysiscited by 10
  24. 2024SyllabusQA: A Course Logistics Question Answering Datasetcited by 9
  25. 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 7
  26. 2024NeurDB: On the Design and Implementation of an AI-powered Autonomous Databasecited by 5
  27. 2025Enhancing Financial RAG with Agentic AI and Multi-HyDE: A Novel Approach to Knowledge Retrieval and Hallucination Reductioncited by 4
  28. 2026MoDora: Tree-Based Semi-Structured Document Analysis Systemcited by 3
  29. 2022JEDI: These aren't the JSON documents you're looking for... (Extended Version*)cited by 1
  30. 2026AIM: A practical approach to automated index management for SQL databasescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Orion-RAG: Path-Aligned Hybrid Retrieval for Graphless Data
  2. 2026M-RAG: Semantic Key-Value Indexing for Retrieval-Augmented Generation
  3. 2025Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generation
  4. 2026REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving
  5. 2026Rethinking Retrieval-Augmentation as Synthesis: A Query-Aware Context Merging Approach
  6. 2026RIT-RAG: Navigating Document Corpora with Retrieval-Induced Trees
  7. 2026ORDER: Task-Conditioned Routing for Retrieval-Augmented Generation
  8. 2025Enhancing Domain-Specific Retrieval-Augmented Generation: Synthetic Data Generation and Evaluation using Reasoning Models