Stop Thinking, Start Looking: Efficient Post-Training for Multimodal Document Question Answering via Reasoning-Free Alignment
Not on the map. Why?
Abstract (arXiv)
Efficient multimodal document question answering with explicit visual grounding, locating the precise document region that supports each answer remains an open challenge. Current approaches bifurcate into Supervised Fine-Tuning (SFT), which requires large annotated datasets and reaches optimization plateaus, and reasoning-centric Reinforcement Learning (RL), which depends on verbose intermediate traces that inflate inference token cost without clear benefit. We introduce Perception-RFT, a training framework that applies Group Relative Policy Optimization (GRPO) to multimodal document QA, bypassing intermediate reasoning tokens to directly align visual features with structured grounding outputs. To rigorously evaluate the necessity of reasoning, we construct a reasoning variant under identical reward settings. We find that reasoning-enabled models suppress their reasoning traces during training, converging to direct perception-based policies at the 4B parameter scale, reducing per-query inference token length by more than 60%, while reasoning-enabled RL underperforms perception-only training. Through a fine-grained analysis of Qwen3-VL-4B optimization dynamics, we confirm that SFT saturation and cold-start RL instability established in text-domain post-training extend to multimodal, and identify a previously uncharacterized Grounding Divergence: a selective trade-off between semantic robustness and geometric precision on two out of distribution (OOD) benchmarks (4,828 samples) under joint RL optimization. We further show that an early SFTrightarrowRL transition achieves comparable precision with 65% less training data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
26 of 33 references.
References · 26
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 891
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2019Scene Text Visual Question Answeringcited by 327
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2025PaddleOCR 3.0 Technical Reportcited by 136
14 more
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learningcited by 116
- 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2024Toward Visual Grounding: A Surveycited by 52
- 2025RL Fine-Tuning Heals OOD Forgetting in SFTcited by 27
- 2023Privacy-Aware Document Visual Question Answeringcited by 17
- 2023Form-NLU: Dataset for the Form Natural Language Understandingcited by 14
- 2025DocThinker: Explainable Multimodal Large Language Models with Rule-based Reinforcement Learning for Document Understandingcited by 11
- 2024DOGR: Towards Versatile Visual Document Grounding and Referringcited by 10
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Futurecited by 9
- 2025Towards Understanding Visual Grounding in Visual Language Modelscited by 9
- 2024DLaVA: Document Language and Vision Assistant for Answer Localization with Enhanced Interpretability and Trustworthinesscited by 8
- 2025BoundingDocs: a Unified Dataset for Document Question Answering with Spatial Annotationscited by 8
- 2025DRISHTIKON: Visual Grounding at Multiple Granularities in Documentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering
- 2026AutothinkRAG: Complexity-Aware Control of Retrieval-Augmented Reasoning for Image-Text Interaction
- 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning
- 2025SATORI-R1: Incentivizing Multimodal Reasoning through Explicit Visual Anchoring
- 2026ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward
- 2026Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum
- 2025Closing the Gap: Data-Centric Fine-Tuning of Vision Language Models for the Standardized Exam Questions
- 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking