FocalOrder: Focal Preference Optimization for Reading Order Detection
On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods
Abstract (arXiv)
Reading order detection is the foundation of document understanding. Most existing methods rely on uniform supervision, implicitly assuming a constant difficulty distribution across layout regions. In this work, we challenge this assumption by revealing a critical flaw: Positional Disparity, a phenomenon where models demonstrate mastery over the deterministic start and end regions but suffer a performance collapse in the complex intermediate sections. This degradation arises because standard training allows the massive volume of easy patterns to drown out the learning signals from difficult layouts. To address this, we propose FocalOrder, a framework driven by Focal Preference Optimization (FPO). Specifically, FocalOrder employs adaptive difficulty discovery with exponential moving average mechanism to dynamically pinpoint hard-to-learn transitions, while introducing a difficulty-calibrated pairwise ranking objective to enforce global logical consistency. Extensive experiments demonstrate that FocalOrder establishes new state-of-the-art results on OmniDocBench v1.0 and Comp-HRDoc. Our compact model not only outperforms competitive specialized baselines but also significantly surpasses large-scale general VLMs. These results demonstrate that aligning the optimization with intrinsic structural ambiguity of documents is critical for mastering complex document structures.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 12 of its 31 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
12 of 31 references.
References · 12
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 150
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
- 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 82
- 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 80
- 2021Document AI: Benchmarks, Models and Applicationscited by 62
- 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26
- 2024Detect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysiscited by 15
- 2025MIRAGE: Scaling Test-Time Inference with Parallel Graph-Retrieval-Augmented Reasoning Chainscited by 7
- 2025UniHDSA: A Unified Relation Prediction Approach for Hierarchical Document Structure Analysiscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025XY-Cut++: Advanced Layout Ordering via Hierarchical Mask Mechanism on a Novel Benchmark
- 2026Structured Layout Priors for Robust Out-of-Distribution Visual Document Understanding
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
- 2025Infinity Parser: Layout Aware Reinforcement Learning for Scanned Document Parsing
- 2024Eliminating Position Bias of Language Models: A Mechanistic Approach
- 2026PARL: Position-Aware Relation Learning Network for Document Layout Analysis
- 2026HeadRank: Decoding-Free Passage Reranking via Preference-Aligned Attention Heads
- 2023Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classification