M3DocDep: Multi-modal, Multi-page, Multi-document Dependency Chunking with Large Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
also in 1 more
Abstract (arXiv)
In long, multi-page industrial documents, retrieval-augmented generation (RAG) depends heavily on whether chunk boundaries follow the document's true structure. Existing text-centric chunkers and generative hierarchy parsers often miss cross-page parent-child relations, figure/table-caption bindings, and boundary cues, which leads to fragmented or redundant chunks and degrades both retrieval and answer quality. We propose M3DocDep, an LVLM-based pipeline that first recovers block-level dependencies and then constructs chunks along the recovered document tree. The pipeline uses SharedDet as a common DP+OCR preprocessing layer, extracts multimodal block embeddings with boundary-aware SoftROI pooling, scores candidate parent-child edges with a biaffine head, decodes a globally valid dependency tree with MST constraints, and builds tree-guided chunks annotated with section paths and page ranges. Under a shared-block evaluation protocol, M3DocDep improves STEDS by +28.5 to +39.6 percent on DHP benchmarks, retrieval nDCG by +1.1 to +15.3 percent, and QA ANLS by +4.5 to +15.3 percent on corpus-level RAG benchmarks. These results show that recovering document dependencies before chunking yields more coherent retrieval units for long, multi-page multimodal documents.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 48 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
25 of 48 references.
References · 25
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Mask R-CNNcited by 7,259
- 2017Deformable Convolutional Networkscited by 1,481
- 2023Large Language Modelscited by 774
- 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
- 2019Scene Text Visual Question Answeringcited by 327
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2023Document Understanding Dataset and Evaluation (DUDE)cited by 132
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2022Hierarchical multimodal transformers for Multi-Page DocVQAcited by 102
13 more
- 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
- 2024Can LLM Graph Reasoning Generalize beyond Pattern Memorization?cited by 46
- 2024Is Semantic Chunking Worth the Computational Cost?cited by 43
- 2024LumberChunker: Long-Form Narrative Document Segmentationcited by 36
- 2020Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehensioncited by 29
- 2023A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecturecited by 28
- 2024LayoutLLM: Large Language Model Instruction Tuning for Visually Rich Document Understandingcited by 24
- 2023HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structurescited by 22
- 2018Revisiting the tree edit distance and its backtracing: A tutorialcited by 8
- 2024Multi-Page Document Visual Question Answering using Self-Attention Scoring Mechanismcited by 8
- 2025S2 Chunking: A Hybrid Framework for Document Segmentation Through Integrated Spatial and Semantic Analysiscited by 8
- 2023DSG: An End-to-End Document Structure Generatorcited by 6
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documentscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Vision-Guided Chunking Is All You Need: Enhancing RAG with Multimodal Document Understanding
- 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
- 2026Structure-Aware Semantic Chunking with Title-Chain Prefixes: A 1600-Query Evaluation and the Measurement Trap in Text-Transform Ablations
- 2026Evaluating Chunking Strategies For Retrieval-Augmented Generation in Oil and Gas Enterprise Documents
- 2026LFRAG: Layout-oriented Fine-grained Retrieval-Augmented Generation on Multimodal Document Understanding
- 2026A Systematic Investigation of Document Chunking Strategies and Embedding Sensitivity
- 2026Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion
- 2026MLDocRAG: Multimodal Long-Context Document Retrieval Augmented Generation