Split-Fuse-Transport: Annotation-Free Saliency via Dual Clustering and Optimal Transport Alignment
Not on the map. Why?
Abstract (arXiv)
Salient object detection (SOD) aims to segment visually prominent regions in images and serves as a foundational task for various computer vision applications. We posit that SOD can now reach near-supervised accuracy without a single pixel-level label, but only when reliable pseudo-masks are available. We revisit the prototype-based line of work and make two key observations. First, boundary pixels and interior pixels obey markedly different geometry; second, the global consistency enforced by optimal transport (OT) is underutilized if prototype quality is weak. To address this, we introduce POTNet, an adaptation of Prototypical Optimal Transport that replaces POT's single k-means step with an entropy-guided dual-clustering head: high-entropy pixels are organized by spectral clustering, low-entropy pixels by k-means, and the two prototype sets are subsequently aligned by OT. This split-fuse-transport design yields sharper, part-aware pseudo-masks in a single forward pass, without handcrafted priors. Those masks supervise a standard MaskFormer-style encoder-decoder, giving rise to AutoSOD, an end-to-end unsupervised SOD pipeline that eliminates SelfMask's offline voting yet improves both accuracy and training efficiency. Extensive experiments on five benchmarks show that AutoSOD outperforms unsupervised methods by up to 26% and weakly supervised methods by up to 36% in F-measure, further narrowing the gap to fully supervised models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
28 of 43 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
- 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
- 2016Simple Does It: Weakly Supervised Instance and Semantic Segmentationcited by 226
- 2016Deeply supervised salient object detection with short connectionscited by 196
- 2021Visual Saliency Transformercited by 175
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
16 more
- 2020Suppress and Balance: A Simple Gated Network for Salient Object Detectioncited by 126
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2020Weakly-Supervised Salient Object Detection via Scribble Annotationscited by 96
- 2020EDN: Salient Object Detection via Extremely-Downsampled Networkcited by 64
- 2022Unsupervised Salient Object Detection with Spectral Cluster Votingcited by 56
- 2017Learning Uncertain Convolutional Features for Accurate Saliency Detectioncited by 44
- 2019Multi-source weak supervision for saliency detectioncited by 43
- 2018Weakly Supervised Salient Object Detection Using Image Labelscited by 32
- 2020Learning Noise-Aware Encoder-Decoder from Noisy Labels by Alternating Back-Propagation for Saliency Detectioncited by 29
- 2021MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object Detectioncited by 27
- 2024SFC: Shared Feature Calibration in Weakly Supervised Semantic Segmentationcited by 19
- 2022Unsupervised Domain Adaptive Salient Object Detection Through Uncertainty-Aware Pseudo-Label Learningcited by 17
- 2025A Mutual Learning Method for Salient Object Detection with intertwined Multi-Supervision--Revisedcited by 5
- 2021TDIOT: Target-driven Inference for Deep Video Object Trackingcited by 4
- 2024Locally-Focused Face Representation for Sketch-to-Image Generation Using Noise-Induced Refinementcited by 3
- 2024Gated-Attention Feature-Fusion Based Framework for Poverty Predictioncited by 2
Built on by
Not cited yet.