Iteratively Trained Interactive Segmentation
Not on the map. Why?
Abstract (arXiv)
Deep learning requires large amounts of training data to be effective. For the task of object segmentation, manually labeling data is very expensive, and hence interactive methods are needed. Following recent approaches, we develop an interactive object segmentation system which uses user input in the form of clicks as the input to a convolutional network. While previous methods use heuristic click sampling strategies to emulate user clicks during training, we propose a new iterative training strategy. During training, we iteratively add clicks based on the errors of the currently predicted segmentation. We show that our iterative training strategy together with additional improvements to the network architecture results in improved results over the state-of-the-art.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 8; 2023: 19; 2024: 8; 2025: 5; 2026: 2.
52 papers.
Sort:
- 2023Segment Anythingcited by 8,158
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2023SegGPT: Segmenting Everything In Contextcited by 193
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 162
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
- 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 98
- 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
- 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentationcited by 33
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2022Interactive Object Segmentation in 3D Point Cloudscited by 23
38 more
- 2024A Simple Image Segmentation Framework via In-Context Examplescited by 19
- 2023CFR-ICL: Cascade-Forward Refinement with Iterative Click Loss for Interactive Image Segmentationcited by 17
- 2023Focused and Collaborative Feedback Integration for Interactive Image Segmentationcited by 17
- 2021Personal Fixations-Based Object Segmentation with Object Localization and Boundary Preservationcited by 14
- 2023DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformercited by 14
- 2021Probabilistic Attention for Interactive Segmentationcited by 12
- 2022EISeg: An Efficient Interactive Segmentation Tool based on PaddlePaddlecited by 10
- 2023ScribbleSeg: Scribble-based Interactive Image Segmentationcited by 10
- 2024Adapting the Segment Anything Model During Usage in Novel Situationscited by 9
- 2023Interactive Class-Agnostic Object Countingcited by 8
- 2021UCP-Net: Unstructured Contour Points for Instance Segmentationcited by 7
- 2022Revisiting Click-based Interactive Video Object Segmentationcited by 5
- 2023Guiding the Guidance: A Comparative Analysis of User Guidance Signals for Interactive Segmentation of Volumetric Imagescited by 5
- 2024Point-VOS: Pointing Up Video Object Segmentationcited by 5
- 2022Morphology-Aware Interactive Keypoint Estimationcited by 4
- 2024Interactive4D: Interactive 4D LiDAR Segmentationcited by 4
- 2021Interactive Object Segmentation with Dynamic Click Transformcited by 3
- 2021Generalizing Interactive Backpropagating Refinement for Dense Predictioncited by 3
- 2023Interactive Image Segmentation with Cross-Modality Vision Transformerscited by 3
- 2023Interactive Segmentation for Diverse Gesture Types Without Contextcited by 3
- 2024Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentationcited by 3
- 2024Learning Trimaps via Clicks for Image Mattingcited by 3
- 2021Clicking Matters:Towards Interactive Human Parsingcited by 2
- 2021Split GCN: Effective Interactive Annotation for Segmentation of Disconnected Instancecited by 2
- 2022Exploring the Interactive Guidance for Unified and Effective Image Mattingcited by 2
- 2022RAIS: Robust and Accurate Interactive Segmentation via Continual Learningcited by 2
- 2024Learning from Exemplars for Interactive Image Segmentationcited by 2
- 2025Easy3D: A Simple Yet Effective Method for 3D Interactive Segmentationcited by 2
- 2025PromptTSS: A Prompting-Based Approach for Interactive Multi-Granularity Time Series Segmentationcited by 2
- 2026Whole-Slide Image Analysis under Realistic Few-Shot Annotation Protocolscited by 2
- 2021iSeg3D: An Interactive 3D Shape Segmentation Toolcited by 1
- 2023Panoptic One-Click Segmentation: Applied to Agricultural Datacited by 1
- 2023Evaluation and improvement of Segment Anything Model for interactive histopathology image segmentationcited by 1
- 2024Fusing Forces: Deep-Human-Guided Refinement of Segmentation Maskscited by 1
- 2025Attend-and-Refine: Interactive keypoint estimation and quantitative cervical vertebrae analysis for bone age assessmentcited by 1
- 2026From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Taskscited by 1
- 2023SonoSAMTrack -- Segment and Track Anything on Ultrasound Imagescited by 0
- 2023Variance-insensitive and Target-preserving Mask Refinement for Interactive Image Segmentationcited by 0
50 most cited of 52 All 52 (JSON)
- 2026Whole-Slide Image Analysis under Realistic Few-Shot Annotation Protocols31 Aug 2026
- 2026From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Tasks8 Apr 2026
- 2025Attend-and-Refine: Interactive keypoint estimation and quantitative cervical vertebrae analysis for bone age assessment10 Jul 2025
- 2025FocalClick-XL: Towards Unified and High-quality Interactive Segmentation17 Jun 2025
- 2025PromptTSS: A Prompting-Based Approach for Interactive Multi-Granularity Time Series Segmentation12 Jun 2025
- 2025Easy3D: A Simple Yet Effective Method for 3D Interactive Segmentation15 Apr 2025
- 2025RefCut: Interactive Segmentation with Reference Guidance22 Mar 2025
- 2024Interactive4D: Interactive 4D LiDAR Segmentation10 Oct 2024
- 2024A Simple Image Segmentation Framework via In-Context Examples7 Oct 2024
- 2024Fusing Forces: Deep-Human-Guided Refinement of Segmentation Masks6 Aug 2024
- 2024Learning from Exemplars for Interactive Image Segmentation17 Jun 2024
- 2024Adapting the Segment Anything Model During Usage in Novel Situations12 Apr 2024
38 more
- 2024Learning Trimaps via Clicks for Image Matting30 Mar 2024
- 2024Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentation11 Mar 2024
- 2024Point-VOS: Pointing Up Video Object Segmentation8 Feb 2024
- 2023Variance-insensitive and Target-preserving Mask Refinement for Interactive Image Segmentation22 Dec 2023
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy23 Nov 2023
- 2023SonoSAMTrack -- Segment and Track Anything on Ultrasound Images25 Oct 2023
- 2023Evaluation and improvement of Segment Anything Model for interactive histopathology image segmentation16 Oct 2023
- 2023Interactive Class-Agnostic Object Counting11 Sep 2023
- 2023Interactive Segmentation for Diverse Gesture Types Without Context20 Jul 2023
- 2023Interactive Image Segmentation with Cross-Modality Vision Transformers5 Jul 2023
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentation1 Jun 2023
- 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controls4 May 2023
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation25 Apr 2023
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Study20 Apr 2023
- 2023DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformer13 Apr 2023
- 2023SegGPT: Segmenting Everything In Context6 Apr 2023
- 2023Segment Anything5 Apr 2023
- 2023Focused and Collaborative Feedback Integration for Interactive Image Segmentation21 Mar 2023
- 2023ScribbleSeg: Scribble-based Interactive Image Segmentation20 Mar 2023
- 2023Panoptic One-Click Segmentation: Applied to Agricultural Data15 Mar 2023
- 2023Guiding the Guidance: A Comparative Analysis of User Guidance Signals for Interactive Segmentation of Volumetric Images13 Mar 2023
- 2023CFR-ICL: Cascade-Forward Refinement with Iterative Click Loss for Interactive Image Segmentation9 Mar 2023
- 2022RAIS: Robust and Accurate Interactive Segmentation via Continual Learning20 Oct 2022
- 2022EISeg: An Efficient Interactive Segmentation Tool based on PaddlePaddle17 Oct 2022
- 2022Morphology-Aware Interactive Keypoint Estimation15 Sep 2022
- 2022PseudoClick: Interactive Image Segmentation with Click Imitation12 Jul 2022
- 2022Exploring the Interactive Guidance for Unified and Effective Image Matting17 May 2022
- 2022Interactive Object Segmentation in 3D Point Clouds14 Apr 2022
- 2022FocalClick: Towards Practical Interactive Image Segmentation6 Apr 2022
- 2022Revisiting Click-based Interactive Video Object Segmentation3 Mar 2022
- 2021iSeg3D: An Interactive 3D Shape Segmentation Tool24 Dec 2021
- 2021Generalizing Interactive Backpropagating Refinement for Dense Prediction21 Dec 2021
- 2021Split GCN: Effective Interactive Annotation for Segmentation of Disconnected Instance13 Dec 2021
- 2021Clicking Matters:Towards Interactive Human Parsing11 Nov 2021
- 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flow20 Sep 2021
- 2021UCP-Net: Unstructured Contour Points for Instance Segmentation15 Sep 2021
- 2021Probabilistic Attention for Interactive Segmentation23 Jun 2021
- 2021Interactive Object Segmentation with Dynamic Click Transform19 Jun 2021
50 newest of 52 All 52 (JSON)
- 2023Segment Anythingcited by 8,158
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2023SegGPT: Segmenting Everything In Contextcited by 193
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 162
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
- 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 98
- 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
- 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentationcited by 33
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2022Interactive Object Segmentation in 3D Point Cloudscited by 23
12 most cited of 52 All 52 (JSON)
- 2026Whole-Slide Image Analysis under Realistic Few-Shot Annotation Protocols31 Aug 2026
- 2026From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Tasks8 Apr 2026
- 2025Attend-and-Refine: Interactive keypoint estimation and quantitative cervical vertebrae analysis for bone age assessment10 Jul 2025
- 2025FocalClick-XL: Towards Unified and High-quality Interactive Segmentation17 Jun 2025
- 2025PromptTSS: A Prompting-Based Approach for Interactive Multi-Granularity Time Series Segmentation12 Jun 2025
- 2025Easy3D: A Simple Yet Effective Method for 3D Interactive Segmentation15 Apr 2025
- 2025RefCut: Interactive Segmentation with Reference Guidance22 Mar 2025
- 2024Interactive4D: Interactive 4D LiDAR Segmentation10 Oct 2024
- 2024A Simple Image Segmentation Framework via In-Context Examples7 Oct 2024
- 2024Fusing Forces: Deep-Human-Guided Refinement of Segmentation Masks6 Aug 2024
- 2024Learning from Exemplars for Interactive Image Segmentation17 Jun 2024
- 2024Adapting the Segment Anything Model During Usage in Novel Situations12 Apr 2024
12 newest of 52 All 52 (JSON)