When Is Graph Structure Worth Its Cost? The Case for Structure Pricing in Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
Graph-based retrieval-augmented generation (RAG) can help answer questions that require information from many documents. However, building a graph often requires many language-model calls during ingestion. It is therefore important to ask whether its quality gains justify the additional cost. We present EffiRAG, a graph-based RAG system designed to reduce this cost. It uses the graph to locate relevant passages and generates answers from the original text. This design preserves source information while keeping graph construction and query processing lightweight. We evaluate EffiRAG on UltraDomain, which contains 120 open-ended questions from four domains. Compared with LightRAG-hybrid, EffiRAG produces the preferred answer on 93 questions. LightRAG is preferred on 7, and the remaining 20 are splits. EffiRAG also reduces total system cost by 57 percent, from USD 0.952 to USD 0.408. The cost includes language-model calls during ingestion and querying. The advantage remains as the corpus grows. At 10 and 20 documents per domain, EffiRAG uses a lightweight, non-LLM filter to skip low-salience chunks. It remains preferred over LightRAG-hybrid. It costs 4.2 times and 4.5 times less, respectively. The comparisons identify different quality-cost trade-offs. Graph-based RAG systems should therefore be evaluated by both answer quality and cost. The results favor graph structure that locates and preserves source evidence.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 11 of its 21 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
11 of 21 references.
Closest ancestors · 5
Same direction, newest first
- 2025When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generation6 Jun
- 2025PathRAG: Pruning Graph-based Retrieval Augmented Generation with Relational Paths18 Feb
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generation8 Oct
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval31 Jan
Other references · 6
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 119
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RAG vs. GraphRAG: A Systematic Evaluation and Key Insights
- 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodes
- 2024Graph Retrieval-Augmented Generation: A Survey
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)
- 2025In-depth Analysis of Graph-based RAG in a Unified Framework
- 2025Graph-based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey
- 2025mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs
- 2025E^2GraphRAG: Streamlining Graph-based RAG for High Efficiency and Effectiveness