mlsanityData to 7 Oct 2026

ClickAttention: Click Region Similarity Guided Interactive Segmentation

arXiv 2408.06021 ↗First posted 12 Aug 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Interactive segmentation algorithms based on click points have garnered significant attention from researchers in recent years. However, existing studies typically use sparse click maps as model inputs to segment specific target objects, which primarily affect local regions and have limited abilities to focus on the whole target object, leading to increased times of clicks. In addition, most existing algorithms can not balance well between high performance and efficiency. To address this issue, we propose a click attention algorithm that expands the influence range of positive clicks based on the similarity between positively-clicked regions and the whole input. We also propose a discriminative affinity loss to reduce the attention coupling between positive and negative click regions to avoid an accuracy decrease caused by mutual interference between positive and negative clicks. Extensive experiments demonstrate that our approach is superior to existing methods and achieves cutting-edge performance in fewer parameters. An interactive demo and all reproducible codes will be released at https://github.com/hahamyt/ClickAttention.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 55 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

26 of 55 references.

References · 26

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  6. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  7. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  8. 2018Dual Attention Network for Scene Segmentationcited by 1,001
  9. 2023Segment Anything in High Qualitycited by 373
  10. 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 271
  11. 2022Visual Attention Networkcited by 210
  12. 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 187
14 more
  1. 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 162
  2. 2016Deep Interactive Object Selectioncited by 160
  3. 2020f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentationcited by 117
  4. 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
  5. 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
  6. 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
  7. 2021MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learningcited by 45
  8. 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
  9. 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
  10. 2022Visualizing and Understanding Patch Interactions in Vision Transformercited by 26
  11. 2024Rethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Promptscited by 22
  12. 2020Getting to 99% Accuracy in Interactive Segmentationcited by 19
  13. 2023AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentationcited by 11
  14. 2022SASFormer: Transformers for Sparsely Annotated Semantic Segmentationcited by 6

Built on by

Not cited yet.