Co-Salient Object Detection with Semantic-Level Consensus Extraction and Dispersion
Not on the map. Why?
Abstract (arXiv)
Given a group of images, co-salient object detection (CoSOD) aims to highlight the common salient object in each image. There are two factors closely related to the success of this task, namely consensus extraction, and the dispersion of consensus to each image. Most previous works represent the group consensus using local features, while we instead utilize a hierarchical Transformer module for extracting semantic-level consensus. Therefore, it can obtain a more comprehensive representation of the common object category, and exclude interference from other objects that share local similarities with the target object. In addition, we propose a Transformer-based dispersion module that takes into account the variation of the co-salient object in different scenes. It distributes the consensus to the image feature maps in an image-specific way while making full use of interactions within the group. These two modules are integrated with a ViT encoder and an FPN-like decoder to form an end-to-end trainable network, without additional branch and auxiliary loss. The proposed method is evaluated on three commonly used CoSOD datasets and achieves state-of-the-art performance.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 33 of its 48 references that are in the map. First posted on arXiv 14 Sep 2023.
Builds on
33 of 48 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2021Multiscale Vision Transformerscited by 896
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
21 more
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2021Visual Saliency Transformercited by 175
- 2020Re-thinking Co-Salient Object Detectioncited by 54
- 2022A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detectioncited by 51
- 2021TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Networkcited by 45
- 2016Low-rank Bilinear Pooling for Fine-Grained Classificationcited by 42
- 2020Gradient-Induced Co-Saliency Detectioncited by 39
- 2020Adaptive Graph Convolutional Network with Attention Graph Clustering for Co-saliency Detectioncited by 35
- 2021Group Collaborative Learning for Co-Salient Object Detectioncited by 32
- 2021Summarize and Search: Learning Consensus-aware Dynamic Convolution for Co-Saliency Detectioncited by 24
- 2022Democracy Does Matter: Comprehensive Feature Mining for Co-Salient Object Detectioncited by 18
- 2017Group-wise Deep Co-saliency Detectioncited by 15
- 2023Discriminative Co-Saliency and Background Mining Transformer for Co-Salient Object Detectioncited by 12
- 2022GCoNet+: A Stronger Group Collaborative Co-Salient Object Detectorcited by 11
- 2021CoSformer: Detecting Co-Salient Object with Transformerscited by 10
- 2023Memory-aided Contrastive Consensus Learning for Co-salient Object Detectioncited by 9
- 2023Co-Salient Object Detection with Co-Representation Purificationcited by 9
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 2.
6 papers.
- 2024Language-Driven Visual Consensus for Zero-Shot Semantic Segmentationcited by 6
- 2024Neural Assembler: Learning to Generate Fine-Grained Robotic Assembly Instructions from Multi-View Imagescited by 5
- 2025Visual Consensus Prompting for Co-Salient Object Detectioncited by 3
- 2024Self-supervised co-salient object detection via feature correspondence at multiple scalescited by 1
- 2026TF-SSD: A Strong Pipeline via Synergic Mask Filter for Training-free Co-salient Object Detectioncited by 1
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detectioncited by 0
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detection12 Sep 2026
- 2026TF-SSD: A Strong Pipeline via Synergic Mask Filter for Training-free Co-salient Object Detection1 Apr 2026
- 2025Visual Consensus Prompting for Co-Salient Object Detection19 Apr 2025
- 2024Neural Assembler: Learning to Generate Fine-Grained Robotic Assembly Instructions from Multi-View Images25 Apr 2024
- 2024Self-supervised co-salient object detection via feature correspondence at multiple scales17 Mar 2024
- 2024Language-Driven Visual Consensus for Zero-Shot Semantic Segmentation13 Mar 2024