# CoSformer: Detecting Co-Salient Object with Transformers

arXiv: https://arxiv.org/abs/2104.14729 · HTML: https://mlsanity.com/paper/2104.14729/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- Builds on 32 of its 66 references that are in the map.
- First posted on arXiv 30 Apr 2021.

## Builds on (most cited first, 30 of 32)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Microsoft COCO: Common Objects in Context](https://mlsanity.com/paper/1405.0312/) (2014)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://mlsanity.com/paper/1506.01497/) (2015)
- [Momentum Contrast for Unsupervised Visual Representation Learning](https://mlsanity.com/paper/1911.05722/) (2019)
- [End-to-End Object Detection with Transformers](https://mlsanity.com/paper/2005.12872/) (2020)
- [Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers](https://mlsanity.com/paper/2012.15840/) (2020)
- [Transformers in Vision: A Survey](https://mlsanity.com/paper/2101.01169/) (2021)
- [Pre-Trained Image Processing Transformer](https://mlsanity.com/paper/2012.00364/) (2020)
- [Structure-measure: A New Way to Evaluate Foreground Maps](https://mlsanity.com/paper/1708.00786/) (2017)
- [End-to-End Video Instance Segmentation with Transformers](https://mlsanity.com/paper/2011.14503/) (2020)
- [TransTrack: Multiple Object Tracking with Transformer](https://mlsanity.com/paper/2012.15460/) (2020)
- [Enhanced-alignment Measure for Binary Foreground Map Evaluation](https://mlsanity.com/paper/1805.10421/) (2018)
- [EGNet:Edge Guidance Network for Salient Object Detection](https://mlsanity.com/paper/1908.08297/) (2019)
- [Multi-scale Interactive Network for Salient Object Detection](https://mlsanity.com/paper/2007.09062/) (2020)
- [F3Net: Fusion, Feedback and Focus for Salient Object Detection](https://mlsanity.com/paper/1911.11445/) (2019)
- [Salient Object Detection in the Deep Learning Era: An In-Depth Survey](https://mlsanity.com/paper/1904.09146/) (2019)
- [Salient Object Detection: A Benchmark](https://mlsanity.com/paper/1501.02741/) (2015)
- [Label Decoupling Framework for Salient Object Detection](https://mlsanity.com/paper/2008.11048/) (2020)
- [Position Information in Transformers: An Overview](https://mlsanity.com/paper/2102.11090/) (2021)
- [Review of Visual Saliency Detection with Comprehensive Information](https://mlsanity.com/paper/1803.03391/) (2018)
- [Re-thinking Co-Salient Object Detection](https://mlsanity.com/paper/2007.03380/) (2020)
- [Gradient-Induced Co-Saliency Detection](https://mlsanity.com/paper/2004.13364/) (2020)
- [Adaptive Graph Convolutional Network with Attention Graph Clustering for Co-saliency Detection](https://mlsanity.com/paper/2003.06167/) (2020)
- [CoADNet: Collaborative Aggregation-and-Distribution Networks for Co-Salient Object Detection](https://mlsanity.com/paper/2011.04887/) (2020)
- [Group-wise Deep Co-saliency Detection](https://mlsanity.com/paper/1707.07381/) (2017)
- [Optimizing the F-measure for Threshold-free Salient Object Detection](https://mlsanity.com/paper/1805.07567/) (2018)

## Built on by (most cited first, 10 of 10)

- [Federated Learning with Label Distribution Skew via Logits Calibration](https://mlsanity.com/paper/2209.00189/) (2022)
- [HRTransNet: HRFormer-Driven Two-Modality Salient Object Detection](https://mlsanity.com/paper/2301.03036/) (2023)
- [Global-and-Local Collaborative Learning for Co-Salient Object Detection](https://mlsanity.com/paper/2204.08917/) (2022)
- [GCoNet+: A Stronger Group Collaborative Co-Salient Object Detector](https://mlsanity.com/paper/2205.15469/) (2022)
- [Memory-aided Contrastive Consensus Learning for Co-salient Object Detection](https://mlsanity.com/paper/2302.14485/) (2023)
- [GroupTransNet: Group Transformer Network for RGB-D Salient Object Detection](https://mlsanity.com/paper/2203.10785/) (2022)
- [Scene Matters: Model-based Deep Video Compression](https://mlsanity.com/paper/2303.04557/) (2023)
- [Co-Salient Object Detection with Semantic-Level Consensus Extraction and Dispersion](https://mlsanity.com/paper/2309.07753/) (2023)
- [Towards Stable Co-saliency Detection and Object Co-segmentation](https://mlsanity.com/paper/2209.12138/) (2022)
- [Discriminative Consensus Mining with A Thousand Groups for More Accurate Co-Salient Object Detection](https://mlsanity.com/paper/2403.12057/) (2024)

## Abstract (arXiv)

Co-Salient Object Detection (CoSOD) aims at simulating the human visual system to discover the common and salient objects from a group of relevant images. Recent methods typically develop sophisticated deep learning based models have greatly improved the performance of CoSOD task. But there are still two major drawbacks that need to be further addressed, 1) sub-optimal inter-image relationship modeling; 2) lacking consideration of inter-image separability. In this paper, we propose the Co-Salient Object Detection Transformer (CoSformer) network to capture both salient and common visual patterns from multiple images. By leveraging Transformer architecture, the proposed method address the influence of the input orders and greatly improve the stability of the CoSOD task. We also introduce a novel concept of inter-image separability. We construct a contrast learning scheme to modeling the inter-image separability and learn more discriminative embedding space to distinguish true common objects from noisy objects. Extensive experiments on three challenging benchmarks, i.e., CoCA, CoSOD3k, and Cosal2015, demonstrate that our CoSformer outperforms cutting-edge models and achieves the new state-of-the-art. We hope that CoSformer can motivate future research for more visual co-analysis tasks.