mlsanityData to 7 Oct 2026

Saliency-R1: Incentivizing Unified Saliency Reasoning Capability in MLLM with Confidence-Guided Reinforcement Learning

arXiv 2511.00396 ↗First posted 1 Nov 2025cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Although multimodal large language models (MLLMs) excel in high-level vision-language reasoning, they lack inherent awareness of visual saliency, making it difficult to identify key visual elements. To bridge this gap, we propose Saliency-R1, the first unified MLLM framework that jointly tackles three representative and heterogeneous saliency tasks: Salient Object Detection (SOD), Salient Instance Segmentation (SIS), and Co-salient Object Detection (CoSOD), enhancing the model's capacity for saliency reasoning. We introduce a textual interface with structured tags (<rg>, <ins>) to encode region- and instance-level referring expressions, enabling a single referring segmenter to produce task-appropriate masks. To train the MLLM efficiently, we propose Confidence-Guided Policy Optimization (CGPO), a novel single-sample reinforcement learning algorithm. CGPO improves on GRPO by replacing group-normalized advantages with a per-sample signal based on reward-confidence discrepancy, thereby reducing computational waste, mitigating signal dilution, and lowering training overhead. Our model exceeds or matches the performance of robust open/closed-source MLLMs and specialized state-of-the-art methods across all three tasks, demonstrating the efficacy of our framework in saliency reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 73 references that are in the map. First posted on arXiv 1 Nov 2025.

Builds on

19 of 73 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024HyperSeg: Towards Universal Visual Segmentation with Large Language Model26 Nov
  2. 2024SegLLM: Multi-round Reasoning Segmentation24 Oct

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  9. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  10. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  11. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
  12. 2025Group Sequence Policy Optimizationcited by 788
5 more
  1. 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
  2. 2022SelfReformer: Self-Refined Network with Transformer for Salient Object Detectioncited by 20
  3. 2025Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectivescited by 17
  4. 2025Vision-Language Models Can't See the Obviouscited by 13
  5. 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Saliency-R1: Enforcing Interpretable and Faithful Vision-language Reasoning via Saliency-map Alignment Reward
  2. 2026Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?
  3. 2025SalQ-VLM: Fine-Grained Saliency-Guided Quantization for Vision-Language Models
  4. 2026Saliency-Aware Multi-Route Thinking: Revisiting Vision-Language Reasoning
  5. 2026Look Where You Say You're Looking: Self-Grounded Attention for Visual Reasoning
  6. 2025MMRPT: MultiModal Reinforcement Pre-Training via Masked Vision-Dependent Reasoning
  7. 2024CaRDiff: Video Salient Object Ranking Chain of Thought Reasoning for Saliency Prediction with Diffusion
  8. 2026ConsensusDrop: Fusing Visual and Cross-Modal Saliency for Efficient Vision Language Models