VikingRAG: Accurate and Token-efficient Retrieval-augmented Generation over Structured Documents
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
also in 1 more
Abstract (arXiv)
State-of-the-art retrieval-augmented generation (RAG) methods exploit document structures to acquire sufficient evidence, but often incur substantial token costs. To reduce structural-context tokens without compromising high RAG accuracy, we present sf VikingRAG, a directory-aware semantic data management system that tightly integrates semantic and structural access to support structural-context-efficient, evidence-gap-driven multi-round retrieval. To further reduce token overhead of multi-round interaction, we materialize agentic multi-round retrieval traces as experience edges, and reuse these edges for similar queries, avoiding repeated multi-round exploration. To additionally reduce token costs when agentic multi-round retrieval is unnecessary, we introduce an adaptive escalation strategy that answers from one-round experience-augmented retrieval when the evidence is sufficient, and invokes agentic multi-round retrieval only otherwise. Experiments on real datasets show that the base system sf VikingRAG matches high accuracy of state-of-the-art methods while consuming only 11.6%--51.9% of their tokens. With retrieval-trace reuse and adaptive escalation, token costs drop to 5.1%--32.5% while maintaining competitive accuracy and practical document-storage performance, showing the utility of this work for emerging AI knowledge bases.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 45 of its 105 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
45 of 105 references.
Closest ancestors · 3
Same direction, newest first
- 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspective1 Oct
- 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach23 Jul
- 2024Question-Based Retrieval using Atomic Units for Enterprise RAG20 May
Other references · 42
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
30 more
- 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
- 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 376
- 2023Large Language Models are Effective Text Rankers with Pairwise Ranking Promptingcited by 307
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 236
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
- 2024Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAcited by 122
- 2024Retrieval-Augmented Generation with Knowledge Graphs for Customer Service Question Answeringcited by 96
- 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
- 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
- 2019Neo: A Learned Query Optimizercited by 80
- 2020Bao: Learning to Steer Query Optimizerscited by 62
- 2025Rank-R1: Enhancing Reasoning in LLM-based Document Rerankers via Reinforcement Learningcited by 60
- 2025Retrieval-Augmented Generation with Hierarchical Knowledgecited by 47
- 2025In-depth Analysis of Graph-based RAG in a Unified Frameworkcited by 46
- 2024Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QAcited by 25
- 2025FinSage: A Multi-aspect RAG System for Financial Filings Question Answeringcited by 19
- 2025BookRAG: A Hierarchical Structure-aware Index-based Approach for Retrieval-Augmented Generation on Complex Documentscited by 16
- 2025Federated Retrieval Augmented Generation for Multi-Product Question Answeringcited by 10
- 2025QUEST: Query Optimization in Unstructured Document Analysiscited by 10
- 2024SyllabusQA: A Course Logistics Question Answering Datasetcited by 9
- 2026DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Searchcited by 7
- 2024NeurDB: On the Design and Implementation of an AI-powered Autonomous Databasecited by 5
- 2025Enhancing Financial RAG with Agentic AI and Multi-HyDE: A Novel Approach to Knowledge Retrieval and Hallucination Reductioncited by 4
- 2026MoDora: Tree-Based Semi-Structured Document Analysis Systemcited by 3
- 2022JEDI: These aren't the JSON documents you're looking for... (Extended Version*)cited by 1
- 2026AIM: A practical approach to automated index management for SQL databasescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Orion-RAG: Path-Aligned Hybrid Retrieval for Graphless Data
- 2026M-RAG: Semantic Key-Value Indexing for Retrieval-Augmented Generation
- 2025Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generation
- 2026REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving
- 2026Rethinking Retrieval-Augmentation as Synthesis: A Query-Aware Context Merging Approach
- 2026RIT-RAG: Navigating Document Corpora with Retrieval-Induced Trees
- 2026ORDER: Task-Conditioned Routing for Retrieval-Augmented Generation
- 2025Enhancing Domain-Specific Retrieval-Augmented Generation: Synthetic Data Generation and Evaluation using Reasoning Models