Graph-Based Uncertainty Modeling and Multimodal Fusion for Salient Object Detection
Not on the map. Why?
Abstract (arXiv)
In view of the problems that existing salient object detection (SOD) methods are prone to losing details, blurring edges, and insufficient fusion of single-modal information in complex scenes, this paper proposes a dynamic uncertainty propagation and multimodal collaborative reasoning network (DUP-MCRNet). Firstly, a dynamic uncertainty graph convolution module (DUGC) is designed to propagate uncertainty between layers through a sparse graph constructed based on spatial semantic distance, and combined with channel adaptive interaction, it effectively improves the detection accuracy of small structures and edge regions. Secondly, a multimodal collaborative fusion strategy (MCF) is proposed, which uses learnable modality gating weights to weightedly fuse the attention maps of RGB, depth, and edge features. It can dynamically adjust the importance of each modality according to different scenes, effectively suppress redundant or interfering information, and strengthen the semantic complementarity and consistency between cross-modalities, thereby improving the ability to identify salient regions under occlusion, weak texture or background interference. Finally, the detection performance at the pixel level and region level is optimized through multi-scale BCE and IoU loss, cross-scale consistency constraints, and uncertainty-guided supervision mechanisms. Extensive experiments show that DUP-MCRNet outperforms various SOD methods on most common benchmark datasets, especially in terms of edge clarity and robustness to complex backgrounds. Our code is publicly available at https://github.com/YukiBear426/DUP-MCRNet.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 28 Aug 2025.
Builds on
25 of 38 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 212
- 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
- 2014The Secrets of Salient Object Segmentationcited by 200
- 2016Deeply supervised salient object detection with short connectionscited by 196
- 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
- 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
- 2021Visual Saliency Transformercited by 175
13 more
- 2019Salient Object Detection in the Deep Learning Era: An In-Depth Surveycited by 164
- 2020Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentationcited by 144
- 2018Reverse Attention for Salient Object Detectioncited by 113
- 2020Label Decoupling Framework for Salient Object Detectioncited by 111
- 2017Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detectioncited by 93
- 2020RGB-D Salient Object Detection: A Surveycited by 73
- 2020Accurate RGB-D Salient Object Detection via Collaborative Learningcited by 52
- 2016RGBD Salient Object Detection via Deep Fusioncited by 46
- 2018PiCANet: Pixel-wise Contextual Attention Learning for Accurate Saliency Detectioncited by 28
- 2021Generative Transformer for Accurate and Reliable Salient Object Detectioncited by 18
- 2020Bifurcated backbone strategy for RGB-D salient object detectioncited by 15
- 2025Uncertainty Guided Refinement for Fine-Grained Salient Object Detectioncited by 4
- 2025Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanismcited by 2
Built on by
Not cited yet.