Rank-Consistent Set Reasoning for Co-Salient Object Detection
Not on the map. Why?
Abstract (arXiv)
Co-salient object detection (Co-SOD) requires a model to find foreground regions that are salient in individual images and supported by the image group. We present Rank-Consistent Set Reasoning (RCSR), a supervised dense-prediction framework that models a group as an unordered set rather than as a sequence of images or a semantic label. The core idea is to rank how strongly each spatial region agrees with a small collection of learned group slots at every image scale, and to aggregate these ranks with a robust trimmed statistic. This suppresses accidental pairwise matches and prevents one atypical group member from dominating the shared representation. A set encoder builds group slots directly from multi-scale visual features, while a rank-consistency gate measures whether the ordering of candidate regions is stable across group members. The gated slots are decoded jointly with per-image features to produce co-saliency maps. The model contains no natural-language branch, no open-vocabulary detector, and no external segmentation model. We further introduce a group permutation objective and hard-distractor augmentation so that the model learns the properties of a set-level target rather than memorizing image order or isolated visual saliency. We formulate an evaluation protocol for CoCA, CoSal2015, and CoSOD3k, together with tests of group-size robustness, distractor rejection, order invariance, and cross-dataset transfer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 66 of its 81 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
66 of 81 references.
References · 66
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2017Deep Setscited by 1,394
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
38 more
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2022Simple Open-Vocabulary Object Detection with Vision Transformerscited by 303
- 2020Multi-scale Interactive Network for Salient Object Detectioncited by 212
- 2016Deeply supervised salient object detection with short connectionscited by 196
- 2021Visual Saliency Transformercited by 175
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2015Salient Object Detection: A Benchmarkcited by 130
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
- 2014Salient Object Detection: A Discriminative Regional Feature Integration Approachcited by 89
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
- 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
- 2020Re-thinking Co-Salient Object Detectioncited by 54
- 2024Harmonizing Visual Text Comprehension and Generationcited by 54
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2022A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detectioncited by 51
- 2024ParGo: Bridging Vision-Language with Partial and Global Viewscited by 40
- 2020Gradient-Induced Co-Saliency Detectioncited by 39
- 2025Vision as LoRAcited by 37
- 2020Adaptive Graph Convolutional Network with Attention Graph Clustering for Co-saliency Detectioncited by 35
- 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 34
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
- 2021Group Collaborative Learning for Co-Salient Object Detectioncited by 32
- 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmarkcited by 26
- 2025WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild?cited by 26
- 2021Summarize and Search: Learning Consensus-aware Dynamic Convolution for Co-Saliency Detectioncited by 24
- 2022Global-and-Local Collaborative Learning for Co-Salient Object Detectioncited by 24
- 2026Dolphin-v2: Universal Document Parsing via Scalable Anchor Promptingcited by 20
- 2022Democracy Does Matter: Comprehensive Feature Mining for Co-Salient Object Detectioncited by 18
- 2025Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoningcited by 18
- 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understandingcited by 18
- 2025CME-CAD: Heterogeneous Collaborative Multi-Expert Reinforcement Learning for CAD Code Generationcited by 18
50 most cited of 66 All 66 (JSON)
Built on by
Not cited yet.