PseudoClick: Interactive Image Segmentation with Click Imitation
Not on the map. Why?
Abstract (arXiv)
The goal of click-based interactive image segmentation is to obtain precise object segmentation masks with limited user interaction, i.e., by a minimal number of user clicks. Existing methods require users to provide all the clicks: by first inspecting the segmentation mask and then providing points on mislabeled regions, iteratively. We ask the question: can our model directly predict where to click, so as to further reduce the user interaction cost? To this end, we propose PseudoClick, a generic framework that enables existing segmentation networks to propose candidate next clicks. These automatically generated clicks, termed pseudo clicks in this work, serve as an imitation of human clicks to refine the segmentation mask.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 30 of its 58 references that are in the map. First posted on arXiv 12 Jul 2022.
Builds on
30 of 58 references.
References · 30
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2018An Algorithmic Perspective on Imitation Learningcited by 455
- 2017Deep Learning for Medical Image Analysiscited by 399
- 2019Video Instance Segmentationcited by 391
18 more
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
- 2019Learning Loss for Active Learningcited by 335
- 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 286
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 162
- 2016Deep Interactive Object Selectioncited by 160
- 2021HRFormer: High-Resolution Transformer for Dense Predictioncited by 149
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
- 2017Deep Extreme Cut: From Extreme Points to Object Segmentationcited by 127
- 2017A Review on Deep Learning Techniques Applied to Semantic Segmentationcited by 122
- 2020f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentationcited by 117
- 2019Large-scale interactive object segmentation with human annotatorscited by 109
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
- 2019Fast Interactive Object Annotation with Curve-GCNcited by 95
- 2020Local Temperature Scaling for Probability Calibrationcited by 95
- 2019AdaptIS: Adaptive Instance Selection Networkcited by 64
- 2018Iteratively Trained Interactive Segmentationcited by 52
- 2019Continuous Adaptation for Interactive Object Segmentation by Learning from Correctionscited by 36
- 2017Deep GrabCut for Object Selectioncited by 33
Built on by
Citing papers per year: 2022: 1; 2023: 14; 2024: 17; 2025: 5; 2026: 5.
42 papers.
Sort:
By area:
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentationcited by 33
- 2024Rethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Promptscited by 22
- 2023InterFormer: Real-time Interactive Image Segmentationcited by 20
- 2023CFR-ICL: Cascade-Forward Refinement with Iterative Click Loss for Interactive Image Segmentationcited by 17
- 2023DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformercited by 14
- 2024GraCo: Granularity-Controllable Interactive Segmentationcited by 13
- 2023AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentationcited by 11
- 2023ScribbleSeg: Scribble-based Interactive Image Segmentationcited by 10
- 2023Scene-Generalizable Interactive Segmentation of Radiance Fieldscited by 10
- 2023Multi-granularity Interaction Simulation for Unsupervised Interactive Segmentationcited by 9
30 more
- 2024LiVOS: Light Video Object Segmentation with Gated Linear Matchingcited by 7
- 2024What is Point Supervision Worth in Video Instance Segmentation?cited by 5
- 2024MFP: Making Full Use of Probability Maps for Interactive Image Segmentationcited by 5
- 2023PiClick: Picking the desired mask from multiple candidates in click-based interactive segmentationcited by 4
- 2024FocSAM: Delving Deeply into Focused Objects in Segmenting Anythingcited by 4
- 2023Interactive Image Segmentation with Cross-Modality Vision Transformerscited by 3
- 2023Feature Decoupling-Recycling Network for Fast Interactive Segmentationcited by 3
- 2024ClickSAM: Fine-tuning Segment Anything Model using click prompts for ultrasound image segmentationcited by 3
- 2024Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentationcited by 3
- 2024Learning Trimaps via Clicks for Image Mattingcited by 3
- 2025DC-TTA: Divide-and-Conquer Framework for Test-Time Adaptation of Interactive Segmentationcited by 3
- 2023PVPUFormer: Probabilistic Visual Prompt Unified Transformer for Interactive Image Segmentationcited by 2
- 2024ISCUTE: Instance Segmentation of Cables Using Text Embeddingcited by 2
- 2024SAM-REF: Introducing Image-Prompt Synergy during Interaction for Detail Enhancement in the Segment Anything Modelcited by 2
- 2024Order-aware Interactive Segmentationcited by 2
- 2023Evaluation and improvement of Segment Anything Model for interactive histopathology image segmentationcited by 1
- 2024SimSAM: Zero-shot Medical Image Segmentation via Simulated Interactioncited by 1
- 2024Bones Can't Be Triangles: Accurate and Efficient Vertebrae Keypoint Estimation through Collaborative Error Revisioncited by 1
- 2025SkipClick: Combining Quick Responses and Low-Level Features for Interactive Segmentation in Winter Sports Contextscited by 1
- 2026From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Taskscited by 1
- 2024TraceNet: Segment one thing efficientlycited by 0
- 2024ClickAttention: Click Region Similarity Guided Interactive Segmentationcited by 0
- 2024An Augmentation-based Model Re-adaptation Framework for Robust Image Segmentationcited by 0
- 2025Downstream Analysis of Foundational Medical Vision Models for Disease Progressioncited by 0
- 2025RefCut: Interactive Segmentation with Reference Guidancecited by 0
- 2025FocalClick-XL: Towards Unified and High-quality Interactive Segmentationcited by 0
- 2026A Systematic Study of Behavioral Cloning for Scientific Data Annotationcited by 0
- 2026U-CFR: Uncertainty-Guided Cascade Forward Refinement for Interactive Segmentationcited by 0
- 2026From Few-Shot Segmentation to Clinician-in-the-Loop Medical Image Analysiscited by 0
- 2026IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasetscited by 0
- 2026IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasets15 Sep 2026
- 2026From Few-Shot Segmentation to Clinician-in-the-Loop Medical Image Analysis9 Sep 2026
- 2026U-CFR: Uncertainty-Guided Cascade Forward Refinement for Interactive Segmentation22 Jul 2026
- 2026A Systematic Study of Behavioral Cloning for Scientific Data Annotation26 May 2026
- 2026From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Tasks8 Apr 2026
- 2025DC-TTA: Divide-and-Conquer Framework for Test-Time Adaptation of Interactive Segmentation29 Jun 2025
- 2025FocalClick-XL: Towards Unified and High-quality Interactive Segmentation17 Jun 2025
- 2025RefCut: Interactive Segmentation with Reference Guidance22 Mar 2025
- 2025Downstream Analysis of Foundational Medical Vision Models for Disease Progression21 Mar 2025
- 2025SkipClick: Combining Quick Responses and Low-Level Features for Interactive Segmentation in Winter Sports Contexts14 Jan 2025
- 2024LiVOS: Light Video Object Segmentation with Gated Linear Matching5 Nov 2024
- 2024Order-aware Interactive Segmentation16 Oct 2024
30 more
- 2024An Augmentation-based Model Re-adaptation Framework for Robust Image Segmentation14 Sep 2024
- 2024Bones Can't Be Triangles: Accurate and Efficient Vertebrae Keypoint Estimation through Collaborative Error Revision5 Sep 2024
- 2024SAM-REF: Introducing Image-Prompt Synergy during Interaction for Detail Enhancement in the Segment Anything Model21 Aug 2024
- 2024ClickAttention: Click Region Similarity Guided Interactive Segmentation12 Aug 2024
- 2024TraceNet: Segment one thing efficiently21 Jun 2024
- 2024SimSAM: Zero-shot Medical Image Segmentation via Simulated Interaction2 Jun 2024
- 2024FocSAM: Delving Deeply into Focused Objects in Segmenting Anything29 May 2024
- 2024GraCo: Granularity-Controllable Interactive Segmentation1 May 2024
- 2024MFP: Making Full Use of Probability Maps for Interactive Image Segmentation29 Apr 2024
- 2024What is Point Supervision Worth in Video Instance Segmentation?1 Apr 2024
- 2024Rethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Prompts31 Mar 2024
- 2024Learning Trimaps via Clicks for Image Matting30 Mar 2024
- 2024Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentation11 Mar 2024
- 2024ISCUTE: Instance Segmentation of Cables Using Text Embedding19 Feb 2024
- 2024ClickSAM: Fine-tuning Segment Anything Model using click prompts for ultrasound image segmentation8 Feb 2024
- 2023Evaluation and improvement of Segment Anything Model for interactive histopathology image segmentation16 Oct 2023
- 2023Scene-Generalizable Interactive Segmentation of Radiance Fields9 Aug 2023
- 2023Feature Decoupling-Recycling Network for Fast Interactive Segmentation7 Aug 2023
- 2023Interactive Image Segmentation with Cross-Modality Vision Transformers5 Jul 2023
- 2023PVPUFormer: Probabilistic Visual Prompt Unified Transformer for Interactive Image Segmentation11 Jun 2023
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation1 Jun 2023
- 2023AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentation7 May 2023
- 2023PiClick: Picking the desired mask from multiple candidates in click-based interactive segmentation23 Apr 2023
- 2023Segment Everything Everywhere All at Once13 Apr 2023
- 2023DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformer13 Apr 2023
- 2023InterFormer: Real-time Interactive Image Segmentation6 Apr 2023
- 2023Multi-granularity Interaction Simulation for Unsupervised Interactive Segmentation23 Mar 2023
- 2023ScribbleSeg: Scribble-based Interactive Image Segmentation20 Mar 2023
- 2023CFR-ICL: Cascade-Forward Refinement with Iterative Click Loss for Interactive Image Segmentation9 Mar 2023
- 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformers20 Oct 2022
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentationcited by 33
- 2024Rethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Promptscited by 22
- 2023InterFormer: Real-time Interactive Image Segmentationcited by 20
- 2023CFR-ICL: Cascade-Forward Refinement with Iterative Click Loss for Interactive Image Segmentationcited by 17
- 2023DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformercited by 14
- 2024GraCo: Granularity-Controllable Interactive Segmentationcited by 13
- 2023AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentationcited by 11
- 2023ScribbleSeg: Scribble-based Interactive Image Segmentationcited by 10
- 2023Scene-Generalizable Interactive Segmentation of Radiance Fieldscited by 10
- 2023Multi-granularity Interaction Simulation for Unsupervised Interactive Segmentationcited by 9
12 most cited of 41 All 41 (JSON)
- 2026IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasets15 Sep 2026
- 2026From Few-Shot Segmentation to Clinician-in-the-Loop Medical Image Analysis9 Sep 2026
- 2026U-CFR: Uncertainty-Guided Cascade Forward Refinement for Interactive Segmentation22 Jul 2026
- 2026From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Tasks8 Apr 2026
- 2025DC-TTA: Divide-and-Conquer Framework for Test-Time Adaptation of Interactive Segmentation29 Jun 2025
- 2025FocalClick-XL: Towards Unified and High-quality Interactive Segmentation17 Jun 2025
- 2025RefCut: Interactive Segmentation with Reference Guidance22 Mar 2025
- 2025Downstream Analysis of Foundational Medical Vision Models for Disease Progression21 Mar 2025
- 2025SkipClick: Combining Quick Responses and Low-Level Features for Interactive Segmentation in Winter Sports Contexts14 Jan 2025
- 2024LiVOS: Light Video Object Segmentation with Gated Linear Matching5 Nov 2024
- 2024Order-aware Interactive Segmentation16 Oct 2024
- 2024An Augmentation-based Model Re-adaptation Framework for Robust Image Segmentation14 Sep 2024
12 newest of 41 All 41 (JSON)