mlsanityData to 7 Oct 2026

M3DocDep: Multi-modal, Multi-page, Multi-document Dependency Chunking with Large Vision-Language Models

arXiv 2605.18774 ↗First posted 17 Apr 2026cs.IR cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

also in 1 more
Abstract (arXiv)

In long, multi-page industrial documents, retrieval-augmented generation (RAG) depends heavily on whether chunk boundaries follow the document's true structure. Existing text-centric chunkers and generative hierarchy parsers often miss cross-page parent-child relations, figure/table-caption bindings, and boundary cues, which leads to fragmented or redundant chunks and degrades both retrieval and answer quality. We propose M3DocDep, an LVLM-based pipeline that first recovers block-level dependencies and then constructs chunks along the recovered document tree. The pipeline uses SharedDet as a common DP+OCR preprocessing layer, extracts multimodal block embeddings with boundary-aware SoftROI pooling, scores candidate parent-child edges with a biaffine head, decodes a globally valid dependency tree with MST constraints, and builds tree-guided chunks annotated with section paths and page ranges. Under a shared-block evaluation protocol, M3DocDep improves STEDS by +28.5 to +39.6 percent on DHP benchmarks, retrieval nDCG by +1.1 to +15.3 percent, and QA ANLS by +4.5 to +15.3 percent on corpus-level RAG benchmarks. These results show that recovering document dependencies before chunking yields more coherent retrieval units for long, multi-page multimodal documents.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 48 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

25 of 48 references.

References · 25

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2017Mask R-CNNcited by 7,259
  4. 2017Deformable Convolutional Networkscited by 1,481
  5. 2023Large Language Modelscited by 774
  6. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  7. 2019Scene Text Visual Question Answeringcited by 327
  8. 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
  9. 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
  10. 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
  11. 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
  12. 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 102
13 more
  1. 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
  2. 2024Can LLM Graph Reasoning Generalize beyond Pattern Memorization?cited by 46
  3. 2024Is Semantic Chunking Worth the Computational Cost?cited by 43
  4. 2024LumberChunker: Long-Form Narrative Document Segmentationcited by 36
  5. 2020Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehensioncited by 29
  6. 2023A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecturecited by 28
  7. 2024LayoutLLM: Large Language Model Instruction Tuning for Visually Rich Document Understandingcited by 24
  8. 2023HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structurescited by 22
  9. 2018Revisiting the tree edit distance and its backtracing: A tutorialcited by 8
  10. 2024Multi-Page Document Visual Question Answering using Self-Attention Scoring Mechanismcited by 8
  11. 2025S2 Chunking: A Hybrid Framework for Document Segmentation Through Integrated Spatial and Semantic Analysiscited by 8
  12. 2023DSG: An End-to-End Document Structure Generatorcited by 6
  13. 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documentscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Vision-Guided Chunking Is All You Need: Enhancing RAG with Multimodal Document Understanding
  2. 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
  3. 2026Structure-Aware Semantic Chunking with Title-Chain Prefixes: A 1600-Query Evaluation and the Measurement Trap in Text-Transform Ablations
  4. 2026Evaluating Chunking Strategies For Retrieval-Augmented Generation in Oil and Gas Enterprise Documents
  5. 2026LFRAG: Layout-oriented Fine-grained Retrieval-Augmented Generation on Multimodal Document Understanding
  6. 2026A Systematic Investigation of Document Chunking Strategies and Embedding Sensitivity
  7. 2026Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion
  8. 2026MLDocRAG: Multimodal Long-Context Document Retrieval Augmented Generation