Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Visual reasoning through reinforcement learning with verifiable rewards (RLVR) has achieved remarkable progress. However, when dealing with multi-source inputs, existing approaches tend to treat them as a mere accumulation of information, lacking explicit mechanisms to distinguish whether integrating additional sources yields information gain or introduces interference. Therefore, they struggle to effectively model dynamic interaction when integrating multiple sources, particularly when they differ significantly in physical properties and semantics, e.g., infrared and depth, leading to inferior performance to mono-source reasoning when a certain source holds the dominant signal. To address this issue, we propose MARS, a novel mono-anchored multi-source reasoning framework that models each visual modality as an independent information source. Specifically, by treating mono-source rewards as dynamic anchors, our method explicitly incorporates the information gain introduced by multi-source fusion into advantage normalization and adaptively emphasizes mutual promotion between sources while suppressing potential noise or conflicts during RLVR. From theoretical analysis, our method effectively quantifies information gain introduced by multi-source integration in gradient estimation, enabling consistent modality regulation. Empirical results also show impressive 3.2% and 4.9% performance gains on GRPO and DAPO across diverse datasets, confirming the effectiveness of our method. Code is available at https://github.com/AI9Stars/MARS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 31 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
18 of 31 references.
Closest ancestors · 6
Same direction, newest first
- 2026Imagination Helps Visual Reasoning, But Not Yet in Latent Space26 Feb
- 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning20 May
- 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning17 May
- 2025Kimi-VL Technical Report10 Apr
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2024SPARK: Multi-Vision Sensor Perception and Reasoning Benchmark for Large-scale Vision-Language Models22 Aug
Other references · 12
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025Group Sequence Policy Optimizationcited by 835
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2025Learning to Reason under Off-Policy Guidancecited by 281
- 2025R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learningcited by 65
- 2025ExGRPO: Learning to Reason from Experiencecited by 53
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Modelscited by 22
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Thinking with Deltas: Incentivizing Reinforcement Learning via Differential Visual Reasoning Policy
- 2026Anchoring What Matters: A Dual-Level Learning Framework for Visually-Grounded Multimodal Reasoning
- 2026Reinforcing Multimodal Reasoning via Token-Level Perception-Grounded Advantage Estimation
- 2026Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning
- 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
- 2026Reflection Anchors for Propagation-Aware Visual Retention in Long-Chain Multimodal Reasoning
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning
- 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoning