DocCogito: Aligning Layout Cognition and Step-Level Grounded Reasoning for Document Understanding
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Document understanding with multimodal large language models (MLLMs) requires not only accurate answers but also explicit, evidence-grounded reasoning, especially in high-stakes scenarios. However, current document MLLMs still fall short of forming a complete, human-like reasoning process, because even when they improve both layout encoding and CoT-style prompting, the interaction between the two is typically learned implicitly and remains loosely coupled rather than being enforced as a systematic mechanism. So we propose DocCogito, a unified framework that integrates global layout perception with structured, region-grounded reasoning. DocCogito introduces a lightweight layout tower that distills page structure into learnable global layout prior tokens, and a deterministic Visual-Semantic Chain (VSC)-a concise structured representation less ambiguous than free-form natural-language CoT-to supervise fine-grained intermediate reasoning aligned with evidence regions. Training follows a progressive recipe, including layout perception pretraining, VSC-guided cold start, rejection sampling, and GRPO. To further strengthen the internal coupling between layout priors and VSC execution, we augment standard rewards with a fine-grained region-confidence signal that encourages reasoning traces to stay aligned with corresponding evidence regions. Extensive experiments on six benchmarks (DocVQA, WTQ, ChartQA, TextVQA, OCRBench, and InfoVQA) demonstrate strong generalization, achieving state-of-the-art results on four benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 41 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
11 of 41 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
- 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokenscited by 32
- 2024Token-level Correlation-guided Compression for Efficient Multimodal Document Understandingcited by 22
- 2025Loong: Synthesize Long Chain-of-Thoughts at Scale through Verifierscited by 14
- 2025Explore-Execute Chain: Towards an Efficient Structured Reasoning Paradigmcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Doc-CoB: Enhancing Document Understanding with Visual Chain-of-Boxes Reasoning
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understanding
- 2023DocLLM: A layout-aware generative language model for multimodal document understanding
- 2026Thinking with Anchors: Grounded and Efficient Document Reasoning
- 2025A Simple yet Effective Layout Token in Large Language Models for Document Understanding
- 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation
- 2026Structured Layout Priors for Robust Out-of-Distribution Visual Document Understanding
- 2026SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding