APPO: Attention-guided Perception Policy Optimization for Video Reasoning
Not on the map. Why?
Abstract (arXiv)
Complex video reasoning, actually, relies excessively on fine-grained perception rather than on expert (e.g., Ph.D, Science)-level reasoning. Through extensive empirical observation, we have recognized the critical impact of perception. In particular, when perception ability is almost fixed, enhancing reasoning from Qwen3-8B to OpenAI-o3 yields only 0.7% performance improvement. Conversely, even minimal change in perception model scale (from 7B to 32B) boosts performance by 1.4%, indicating enhancing perception, rather than reasoning, is more critical to improve performance. Therefore, exploring how to enhance perception ability through reasoning without the need for expensive fine-grained annotation information is worthwhile. To achieve this goal, we specially propose APPO, the Attention-guided Perception Policy Optimization algorithm that leverages token-level dense rewards to improve model's fine-grained perception. The core idea behind APPO is to optimize those tokens from different responses that primarily focus on the same crucial video frame (called intra-group perception tokens). Experimental results on diverse video benchmarks and models with different scales (3/7B) demonstrate APPO consistently outperforms GRPO and DAPO (0.5%~4%). We hope our work provides a promising approach to effectively enhance model's perception abilities through reasoning in a low-cost manner, serving diverse scenarios and demands.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 31 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
29 of 31 references.
References · 29
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2025Group Sequence Policy Optimizationcited by 788
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
17 more
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
- 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 172
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 133
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 86
- 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learningcited by 86
- 2024Critical Tokens Matter: Token-Level Contrastive Estimation Enhances LLM's Reasoning Capabilitycited by 80
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learningcited by 46
- 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoningcited by 46
- 2024Forking Paths in Neural Text Generationcited by 30
- 2025Reinforcing Video Reasoning with Focused Thinkingcited by 26
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1cited by 24
- 2025Truth in the Few: High-Value Data Selection for Efficient Multi-Modal Reasoningcited by 11
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning
- 2026PerceptionComp: A Video Benchmark for Complex Perception-Centric Reasoning
- 2026Act2See: Emergent Active Visual Perception for Video Reasoning
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2026VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Prompting
- 2025VIDEOP2R: Video Understanding from Perception to Reasoning
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence
- 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answering