DeepCut: Object Segmentation from Bounding Box Annotations using Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose DeepCut, a method to obtain pixelwise object segmentations given an image dataset labelled with bounding box annotations. It extends the approach of the well-known GrabCut method to include machine learning by training a neural network classifier from bounding box annotations. We formulate the problem as an energy minimisation problem over a densely-connected conditional random field and iteratively update the training targets to obtain pixelwise object segmentations. Additionally, we propose variants of the DeepCut method and compare those to a naive approach to CNN training under weak supervision. We test its applicability to solve brain and lung segmentation problems on a challenging fetal magnetic resonance dataset and obtain encouraging results in terms of accuracy.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 14; 2023: 18; 2024: 10; 2025: 9; 2026: 4.
79 papers.
Sort:
By area:
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2023ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Imagecited by 47
- 2021MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learningcited by 45
- 2021Source-Free Domain Adaptation for Image Segmentationcited by 45
- 2021Every Annotation Counts: Multi-label Deep Supervision for Medical Image Segmentationcited by 37
- 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baselinecited by 30
- 2021iSegFormer: Interactive Segmentation via Transformers with Application to 3D Knee MR Imagescited by 27
- 2022LE-UDA: Label-efficient unsupervised domain adaptation for medical image segmentationcited by 27
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2021Medical Image Segmentation with Limited Supervision: A Review of Deep Network Modelscited by 21
- 2021Inter Extreme Points Geodesics for End-to-End Weakly Supervised Image Segmentationcited by 21
- 2023Mask-Free Video Instance Segmentationcited by 20
38 more
- 2021Bounding Box Tightness Prior for Weakly Supervised Image Segmentationcited by 19
- 2021Weakly supervised segmentation with cross-modality equivariant constraintscited by 18
- 2023Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learningcited by 18
- 2024Interactive 3D Medical Image Segmentation with SAM 2cited by 17
- 2022PA-Seg: Learning from Point Annotations for 3D Medical Image Segmentation using Contextual Regularization and Cross Knowledge Distillationcited by 16
- 2021A survey on shape-constraint deep learning for medical image segmentationcited by 15
- 2021Challenges for machine learning in clinical translation of big data imaging studiescited by 15
- 2022Scribble2D5: Weakly-Supervised Volumetric Image Segmentation via Scribble Annotationscited by 15
- 2022PyMIC: A deep learning toolkit for annotation-efficient medical image segmentationcited by 14
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directionscited by 14
- 2023Boundary-aware Supervoxel-level Iteratively Refined Interactive 3D Image Segmentation with Multi-agent Reinforcement Learningcited by 13
- 2021Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentationcited by 12
- 2022ECONet: Efficient Convolutional Online Likelihood Network for Scribble-based Interactive Segmentationcited by 11
- 2022Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaborationcited by 11
- 2024Clustering Propagation for Universal Medical Image Segmentationcited by 11
- 2023Weakly-Supervised 3D Medical Image Segmentation using Geometric Prior and Contrastive Similaritycited by 9
- 2023Temporally-Extended Prompts Optimization for SAM in Interactive Medical Image Segmentationcited by 9
- 2025WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM with Sub-Class Exploration and Prompt Affinity Miningcited by 8
- 2025MediSee: Reasoning-based Pixel-level Perception in Medical Imagescited by 8
- 2022Learning to segment fetal brain tissue from noisy annotationscited by 7
- 2021Segmentation with mixed supervision: Confidence maximization helps knowledge distillationcited by 6
- 2023Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learningcited by 6
- 2023Data efficient deep learning for medical image analysis: A surveycited by 6
- 2021Beyond pixel-wise supervision for segmentation: A few global shape descriptors might be surprisingly good!cited by 5
- 2022Neural Annotation Refinement: Development of a New 3D Dataset for Adrenal Gland Analysiscited by 5
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Modelscited by 5
- 2024Automating MedSAM by Learning Prompts with Weak Few-Shot Supervisioncited by 5
- 2021Active learning using weakly supervised signals for quality inspectioncited by 4
- 2021Quality-Aware Memory Network for Interactive Volumetric Image Segmentationcited by 4
- 2021Rapid head-pose detection for automated slice prescription of fetal-brain MRIcited by 4
- 2021Interactive Segmentation via Deep Learning and B-Spline Explicit Active Surfacescited by 4
- 2021Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibrationcited by 4
- 2022Applications of Deep Learning in Fish Habitat Monitoring: A Tutorial and Surveycited by 4
- 2024Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Modelscited by 4
- 2023Weakly Supervised Image Segmentation Beyond Tight Bounding Box Annotationscited by 3
- 2023Adaptive Multi-scale Online Likelihood Network for AI-assisted Interactive Segmentationcited by 3
- 2024DiffSeg: A Segmentation Model for Skin Lesions Based on Diffusion Differencecited by 3
- 2025Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasoundcited by 3
50 most cited of 79 All 79 (JSON)
- 2026Report Supervision27 Aug 2026
- 2026Pseudo-Text-Conditioned 3D Grounding DINO for Organ Localization in Abdominal CT25 Jun 2026
- 2026A Comprehensive Survey of Medical Image Segmentation: Challenges, Benchmarks, and Beyond15 Jun 2026
- 2026Weakly Supervised Segmentation as Semantic-Based Regularization13 May 2026
- 2025Sim4Seg: Boosting Multimodal Multi-disease Medical Diagnosis Segmentation with Region-Aware Vision-Language Similarity Masks10 Nov 2025
- 2025Weakly Supervised Intracranial Aneurysm Detection and Segmentation in MR angiography via Multi-task UNet with Vesselness Prior1 Aug 2025
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025CmFNet: Cross-modal Fusion Network for Weakly-supervised Segmentation of Medical Images22 Jun 2025
- 2025MediSee: Reasoning-based Pixel-level Perception in Medical Images15 Apr 2025
- 2025Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasound26 Mar 2025
- 2025Diff-CL: A Novel Cross Pseudo-Supervision Method for Semi-supervised Medical Image Segmentation12 Mar 2025
- 2025WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM with Sub-Class Exploration and Prompt Affinity Mining6 Mar 2025
38 more
- 2025EAUWSeg: Eliminating annotation uncertainty in weakly-supervised medical image segmentation3 Jan 2025
- 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline19 Nov 2024
- 2024Automating MedSAM by Learning Prompts with Weak Few-Shot Supervision30 Sep 2024
- 2024Interactive 3D Medical Image Segmentation with SAM 25 Aug 2024
- 2024Can Foundation Models Reliably Identify Spatial Hazards? A Case Study on Curb Segmentation11 Jun 2024
- 2024A Classifier-Free Incremental Learning Framework for Scalable Medical Image Segmentation25 May 2024
- 2024Enhancing Generalized Fetal Brain MRI Segmentation using A Cascade Network with Depth-wise Separable Convolution and Attention Mechanism24 May 2024
- 2024DiffSeg: A Segmentation Model for Skin Lesions Based on Diffusion Difference25 Apr 2024
- 2024Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Models20 Apr 2024
- 2024Weakly-Supervised Learning via Multi-Lateral Decoder Branching for Tool Segmentation in Robot-Assisted Cardiovascular Catheterization11 Apr 2024
- 2024Clustering Propagation for Universal Medical Image Segmentation25 Mar 2024
- 2023ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Image12 Dec 2023
- 2023VINNA for Neonates -- Orientation Independence through Latent Augmentations29 Nov 2023
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy23 Nov 2023
- 2023Leveraging point annotations in segmentation learning with boundary loss6 Nov 2023
- 2023Volumetric Medical Image Segmentation via Scribble Annotations and Shape Priors12 Oct 2023
- 2023Data efficient deep learning for medical image analysis: A survey10 Oct 2023
- 2023Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learning31 Aug 2023
- 2023Weakly supervised segmentation of intracranial aneurysms using a novel 3D focal modulation UNet6 Aug 2023
- 2023Review of Large Vision Models and Visual Prompt Engineering3 Jul 2023
- 2023Temporally-Extended Prompts Optimization for SAM in Interactive Medical Image Segmentation15 Jun 2023
- 2023Single-Image-Based Deep Learning for Segmentation of Early Esophageal Cancer Lesions9 Jun 2023
- 2023Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learning11 Apr 2023
- 2023Mask-Free Video Instance Segmentation28 Mar 2023
- 2023Adaptive Multi-scale Online Likelihood Network for AI-assisted Interactive Segmentation23 Mar 2023
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directions22 Mar 2023
- 2023Boundary-aware Supervoxel-level Iteratively Refined Interactive 3D Image Segmentation with Multi-agent Reinforcement Learning19 Mar 2023
- 2023Weakly-Supervised 3D Medical Image Segmentation using Geometric Prior and Contrastive Similarity4 Feb 2023
- 2023Weakly Supervised Image Segmentation Beyond Tight Bounding Box Annotations28 Jan 2023
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Models29 Dec 2022
- 2022Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaboration15 Dec 2022
- 2022LE-UDA: Label-efficient unsupervised domain adaptation for medical image segmentation5 Dec 2022
- 2022PyMIC: A deep learning toolkit for annotation-efficient medical image segmentation19 Aug 2022
- 2022PA-Seg: Learning from Point Annotations for 3D Medical Image Segmentation using Contextual Regularization and Cross Knowledge Distillation11 Aug 2022
- 2022Neural Annotation Refinement: Development of a New 3D Dataset for Adrenal Gland Analysis30 Jun 2022
- 2022Attention-based Dynamic Subspace Learners for Medical Image Analysis18 Jun 2022
- 2022Applications of Deep Learning in Fish Habitat Monitoring: A Tutorial and Survey11 Jun 2022
- 2022An automatic pipeline for atlas-based fetal and neonatal brain segmentation and analysis16 May 2022
50 newest of 79 All 79 (JSON)
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2023ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Imagecited by 47
- 2021MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learningcited by 45
- 2021Source-Free Domain Adaptation for Image Segmentationcited by 45
- 2021Every Annotation Counts: Multi-label Deep Supervision for Medical Image Segmentationcited by 37
- 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baselinecited by 30
- 2021iSegFormer: Interactive Segmentation via Transformers with Application to 3D Knee MR Imagescited by 27
- 2022LE-UDA: Label-efficient unsupervised domain adaptation for medical image segmentationcited by 27
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2021Medical Image Segmentation with Limited Supervision: A Review of Deep Network Modelscited by 21
- 2021Inter Extreme Points Geodesics for End-to-End Weakly Supervised Image Segmentationcited by 21
- 2023Mask-Free Video Instance Segmentationcited by 20
12 most cited of 78 All 78 (JSON)
- 2026Report Supervision27 Aug 2026
- 2026Pseudo-Text-Conditioned 3D Grounding DINO for Organ Localization in Abdominal CT25 Jun 2026
- 2026A Comprehensive Survey of Medical Image Segmentation: Challenges, Benchmarks, and Beyond15 Jun 2026
- 2026Weakly Supervised Segmentation as Semantic-Based Regularization13 May 2026
- 2025Sim4Seg: Boosting Multimodal Multi-disease Medical Diagnosis Segmentation with Region-Aware Vision-Language Similarity Masks10 Nov 2025
- 2025Weakly Supervised Intracranial Aneurysm Detection and Segmentation in MR angiography via Multi-task UNet with Vesselness Prior1 Aug 2025
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025CmFNet: Cross-modal Fusion Network for Weakly-supervised Segmentation of Medical Images22 Jun 2025
- 2025MediSee: Reasoning-based Pixel-level Perception in Medical Images15 Apr 2025
- 2025Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasound26 Mar 2025
- 2025Diff-CL: A Novel Cross Pseudo-Supervision Method for Semi-supervised Medical Image Segmentation12 Mar 2025
- 2025WeakMedSAM: Weakly-Supervised Medical Image Segmentation via SAM with Sub-Class Exploration and Prompt Affinity Mining6 Mar 2025
12 newest of 78 All 78 (JSON)