Three Sides of Retrieval: Factorial Evidence for Document-Side, Query-Side, and Answer-Side Complementarity in RAG
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
RAG systems rely on chunking, which destroys structural information in documents. Existing heading-based retrieval (Jeong et al., 2025) requires multiple LLM calls per document and returns sub-chunks within matched sections. We introduce ToC-guided page retrieval, which infers headings from visual formatting without LLM calls, embeds them as a parallel index, and loads full page sections. Across 1,280 conditions on 8 enterprise documents (5 to 195 pages), we find: (1) ToC is a significant main effect on answer quality (d = +0.41, p = 0.031), with the largest gains in completeness (+0.40) and usefulness (+0.40); (2) combined with answer-side verification, it outperforms query-side decomposition + verification (d = +0.32, p = 0.036); (3) ToC contributes 20% of citations despite adding only 2.9 pages per query; (4) gains are directionally larger on longer documents (up to +1.50 on 118 pages), though the trend does not reach significance with 8 documents; and (5) a 480-condition sensitivity analysis finds no significant parameter effects (all p > 0.38), confirming defaults are near-optimal. The contribution is both methodological (a new zero-LLM-cost retrieval algorithm) and empirical: factorial evidence that document-side, query-side, and answer-side enhancements are complementary, a three-way interaction not previously studied.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 2 of its 12 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
2 of 12 references.
Closest ancestors · 1
Same direction, newest first
Other references · 1
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Does Document Structure Help Dense Retrieval? A Placebo-Controlled Ablation of Four Mechanisms Across Two Corpora
- 2024Financial Report Chunking for Effective Retrieval Augmented Generation
- 2026Evaluating Chunking Strategies For Retrieval-Augmented Generation in Oil and Gas Enterprise Documents
- 2025A New HOPE: Domain-agnostic Automatic Evaluation of Text Chunking
- 2026Structure-Aware Semantic Chunking with Title-Chain Prefixes: A 1600-Query Evaluation and the Measurement Trap in Text-Transform Ablations
- 2026Testing Retrieval-Augmented Generation Systems with Chunk Coverage
- 2026KohakuRAG: A simple RAG framework with hierarchical document indexing
- 2026Adaptive Chunking: Optimizing Chunking-Method Selection for RAG