mlsanityData to 14 Oct 2026

XY-Cut++: Advanced Layout Ordering via Hierarchical Mask Mechanism on a Novel Benchmark

arXiv 2504.10258 ↗First posted 14 Apr 2025cs.CV cs.MMcited by 1

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

Document Reading Order Recovery is a fundamental task in document image understanding, playing a pivotal role in enhancing Retrieval-Augmented Generation (RAG) and serving as a critical preprocessing step for large language models (LLMs). Existing methods often struggle with complex layouts(e.g., multi-column newspapers), high-overhead interactions between cross-modal elements (visual regions and textual semantics), and a lack of robust evaluation benchmarks. We introduce XY-Cut++, an advanced layout ordering method that integrates pre-mask processing, multi-granularity segmentation, and cross-modal matching to address these challenges. Our method significantly enhances layout ordering accuracy compared to traditional XY-Cut techniques. Specifically, XY-Cut++ achieves state-of-the-art performance (98.8 BLEU overall) while maintaining simplicity and efficiency. It outperforms existing baselines by up to 24% and demonstrates consistent accuracy across simple and complex layouts on the newly introduced DocBench-100 dataset. This advancement establishes a reliable foundation for document structure recovery, setting a new standard for layout ordering tasks and facilitating more effective RAG and LLM preprocessing.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 15 of its 21 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

15 of 21 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations10 Dec

Other references · 14

  1. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
  2. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
  3. 2017Deep Layer Aggregationcited by 436
  4. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
  5. 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
  6. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
  7. 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
  8. 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 153
  9. 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
  10. 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
  11. 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 80
  12. 2022XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understandingcited by 68
2 more
  1. 2024DocRes: A Generalist Model Toward Unifying Document Image Restoration Taskscited by 27
  2. 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Structured Layout Priors for Robust Out-of-Distribution Visual Document Understanding
  2. 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
  3. 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Model
  4. 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understanding
  5. 2025SCAN: Semantic Document Layout Analysis for Textual and Visual Retrieval-Augmented Generation
  6. 2026FocalOrder: Focal Preference Optimization for Reading Order Detection
  7. 2026LFRAG: Layout-oriented Fine-grained Retrieval-Augmented Generation on Multimodal Document Understanding
  8. 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing