mlsanityData to 7 Oct 2026

Does Document Structure Help Dense Retrieval? A Placebo-Controlled Ablation of Four Mechanisms Across Two Corpora

arXiv 2610.10170 ↗First posted 7 Oct 2026cs.IR cs.AIcited by 0

On the map: Retrieval-augmented generation → Generation and context integration also fits: Multimodal RAG

Abstract (arXiv)

Retrieval-augmented generation systems increasingly rely on document-structure treatments: structure-aligned chunking, LLM-generated chunk contexts, heading-path metadata, and hierarchical two-stage retrieval. Separate studies support each on different corpora, embedders, and metrics, and none control for a shared confound: any text prepended to a chunk perturbs its embedding. We present a mechanism-isolating ablation testing all four treatments under one protocol, matching chunk sizes across conditions and adding a semantically null placebo---heading paths that are structurally valid but shuffled across documents. We score retrieval with a coverage-aware nDCG and test four pre-registered contrasts via document-clustered bootstrap with Holm correction, on two distant corpora: 200 Wikipedia Featured Articles (951 queries) and 1,585 QASPER papers (4,303 questions). Organization helps, and the cause is content, not tokens: structure-aligned chunks with real heading paths beat contextualized fixed windows (+0.022 / +0.012 cov-nDCG@10) and the placebo (+0.010 / +0.016). Naive two-stage hierarchical retrieval hurts (-0.033 / -0.015), traceable to first-stage section recall. Gold structure beats LLM-induced structure on Wikipedia but not on QASPER. Effects are small (dz 0.06-0.11) but Holm-significant and consistent across corpora.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 7 of its 26 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

7 of 26 references.

References · 7

  1. 2026Gemma 4 Technical Reportcited by 187
  2. 2024Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Modelscited by 70
  3. 2025Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysiscited by 17
  4. 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigmscited by 4
  5. 2026Beyond Chunk-Then-Embed: A Comprehensive Taxonomy and Evaluation of Document Chunking Strategies for Information Retrievalcited by 4
  6. 2026A Systematic Investigation of Document Chunking Strategies and Embedding Sensitivitycited by 3
  7. 2025Hierarchical Re-ranker Retriever (HRR)cited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Structure-Aware Semantic Chunking with Title-Chain Prefixes: A 1600-Query Evaluation and the Measurement Trap in Text-Transform Ablations
  2. 2026Evaluating Chunking Strategies For Retrieval-Augmented Generation in Oil and Gas Enterprise Documents
  3. 2026Utilizing Metadata for Better Retrieval-Augmented Generation
  4. 2025A New HOPE: Domain-agnostic Automatic Evaluation of Text Chunking
  5. 2026SPIRE: Structure-Preserving Interpretable Retrieval of Evidence
  6. 2025Equipping Retrieval-Augmented Large Language Models with Document Structure Awareness
  7. 2026Adaptive Chunking: Optimizing Chunking-Method Selection for RAG
  8. 2025Reconstructing Context: Evaluating Advanced Chunking Strategies for Retrieval-Augmented Generation