Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction
Not on the map. Why?
Abstract (arXiv)
In the recent years, convolutional neural networks have transformed the field of medical image analysis due to their capacity to learn discriminative image features for a variety of classification and regression tasks. However, successfully learning these features requires a large amount of manually annotated data, which is expensive to acquire and limited by the available resources of expert image analysts. Therefore, unsupervised, weakly-supervised and self-supervised feature learning techniques receive a lot of attention, which aim to utilise the vast amount of available data, while at the same time avoid or substantially reduce the effort of manual annotation. In this paper, we propose a novel way for training a cardiac MR image segmentation network, in which features are learnt in a self-supervised manner by predicting anatomical positions. The anatomical positions serve as a supervisory signal and do not require extra manual annotation. We demonstrate that this seemingly simple task provides a strong signal for feature learning and with self-supervised learning, we achieve a high segmentation accuracy that is better than or comparable to a U-net trained from scratch, especially at a small data setting. When only five annotated subjects are available, the proposed method improves the mean Dice metric from 0.811 to 0.852 for short-axis image segmentation, compared to the baseline U-net.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 20; 2023: 13; 2024: 7; 2025: 2; 2026: 3.
70 papers.
Sort:
By area:
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021SimCVD: Simple Contrastive Voxel-Wise Representation Distillation for Semi-Supervised Medical Image Segmentationcited by 86
- 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2023Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Datacited by 68
- 2021Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentationcited by 49
- 2021Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentationcited by 43
- 2022Anomaly Detection-Inspired Few-Shot Medical Image Segmentation Through Self-Supervision With Supervoxelscited by 42
- 2021Self-supervised driven consistency training for annotation efficient histopathology image analysiscited by 39
- 2021ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Geneticscited by 35
38 more
- 2021How Transferable Are Self-supervised Features in Medical Image Classification Tasks?cited by 32
- 2022LE-UDA: Label-efficient unsupervised domain adaptation for medical image segmentationcited by 27
- 2025Scaling up self-supervised learning for improved surgical foundation modelscited by 25
- 2024Self-Supervised Learning for Medical Image Data with Anatomy-Oriented Imaging Planescited by 17
- 2021A Spatial Guided Self-supervised Clustering Network for Medical Image Segmentationcited by 14
- 2022Metadata-enhanced contrastive learning from retinal optical coherence tomography imagescited by 14
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directionscited by 14
- 2021Improving Self-supervised Learning with Hardness-aware Dynamic Curriculum Learning: An Application to Digital Pathologycited by 13
- 2022Translation Consistent Semi-supervised Segmentation for 3D Medical Imagescited by 13
- 2021An Evaluation of Self-Supervised Pre-Training for Skin-Lesion Analysiscited by 10
- 2023A Review of Predictive and Contrastive Self-supervised Learning for Medical Imagescited by 10
- 2022Unsupervised pre-training of graph transformers on patient population graphscited by 9
- 2022Anatomy-Aware Contrastive Representation Learning for Fetal Ultrasoundcited by 8
- 2021Understand and Improve Contrastive Learning Methods for Visual Representation: A Reviewcited by 7
- 2021Recent Advances in Fibrosis and Scar Segmentation from Cardiac MRI: A State-of-the-Art Review and Future Perspectivescited by 7
- 2021DeepMCAT: Large-Scale Deep Clustering for Medical Image Categorizationcited by 7
- 2022Prior Knowledge-Guided Attention in Self-Supervised Vision Transformerscited by 7
- 2021Knowledge-Augmented Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loopcited by 6
- 2022Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-Viewcited by 6
- 2023Data efficient deep learning for medical image analysis: A surveycited by 6
- 2021Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentationcited by 5
- 2021Self-supervised Multi-scale Consistency for Weakly Supervised Segmentation Learningcited by 4
- 2021Self-supervised Tumor Segmentation through Layer Decompositioncited by 4
- 2022Self-Supervised Learning as a Means To Reduce the Need for Labeled Data in Medical Image Analysiscited by 4
- 2022Self-Supervised Endoscopic Image Key-Points Matchingcited by 4
- 2023Multimodal Representation Learning of Cardiovascular Magnetic Resonance Imagingcited by 4
- 2021Semantic-Aware Contrastive Learning for Multi-object Medical Image Segmentationcited by 3
- 2021Training Automatic View Planner for Cardiac MR Imaging via Self-Supervision by Spatial Relationship between Viewscited by 3
- 2023A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labelscited by 3
- 2024Exploring Foundation Models in Remote Sensing Image Change Detection: A Comprehensive Surveycited by 3
- 2021Bootstrap Representation Learning for Segmentation on Medical Volumes and Sequencescited by 2
- 2022Boundary-aware Information Maximization for Self-supervised Medical Image Segmentationcited by 2
- 2023A Novel Collaborative Self-Supervised Learning Method for Radiomic Datacited by 2
- 2023A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Imagescited by 2
- 2021One-shot Weakly-Supervised Segmentation in Medical Imagescited by 1
- 2022Intelligent Masking: Deep Q-Learning for Context Encoding in Medical Image Analysiscited by 1
- 2022Interaction of a priori Anatomic Knowledge with Self-Supervised Contrastive Learning in Cardiac Magnetic Resonance Imagingcited by 1
- 2022Adaptive Contrastive Learning with Dynamic Correlation for Multi-Phase Organ Segmentationcited by 1
50 most cited of 70 All 70 (JSON)
- 2026Do Medical Vision Models Reason About Anatomy? Probing the Spatial Inductive Biases of Learned Visual Representations28 Aug 2026
- 2026Task-Aligned Self-Supervised Learning for Medical Image Analysis: A Task-Oriented Review with Practical Design Guidelines18 May 2026
- 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Task7 May 2026
- 2025Deep Learning Approaches for Medical Imaging Under Varying Degrees of Label Availability: A Comprehensive Survey15 Apr 2025
- 2025Scaling up self-supervised learning for improved surgical foundation models16 Jan 2025
- 2024ISImed: A Framework for Self-Supervised Learning using Intrinsic Spatial Information in Medical Images22 Oct 2024
- 2024Exploring Foundation Models in Remote Sensing Image Change Detection: A Comprehensive Survey10 Oct 2024
- 2024Enhancing 3D Transformer Segmentation Model for Medical Image with Token-level Representation Learning12 Aug 2024
- 2024Assistive Image Annotation Systems with Deep Learning and Natural Language Capabilities: A Review28 Jun 2024
- 2024PoCo: A Self-Supervised Approach via Polar Transformation Based Progressive Contrastive Learning for Ophthalmic Disease Diagnosis28 Mar 2024
- 2024Self-Supervised Learning for Medical Image Data with Anatomy-Oriented Imaging Planes25 Mar 2024
- 2024Multi-organ Self-supervised Contrastive Learning for Breast Lesion Segmentation21 Feb 2024
38 more
- 2023A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labels26 Dec 2023
- 2023Data efficient deep learning for medical image analysis: A survey10 Oct 2023
- 2023Automatic view plane prescription for cardiac magnetic resonance imaging via supervision by spatial relationship between views22 Sep 2023
- 2023A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Images5 Sep 2023
- 2023Sparse annotation strategies for segmentation of short axis cardiac MRI24 Jul 2023
- 2023Automatic retrieval of corresponding US views in longitudinal examinations7 Jun 2023
- 2023Additional Positive Enables Better Representation Learning for Medical Images31 May 2023
- 2023Multimodal Representation Learning of Cardiovascular Magnetic Resonance Imaging16 Apr 2023
- 2023Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Data24 Mar 2023
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directions22 Mar 2023
- 2023DrasCLR: A Self-supervised Framework of Learning Disease-related and Anatomy-specific Representation for 3D Medical Images21 Feb 2023
- 2023A Novel Collaborative Self-Supervised Learning Method for Radiomic Data20 Feb 2023
- 2023A Review of Predictive and Contrastive Self-supervised Learning for Medical Images10 Feb 2023
- 2022LE-UDA: Label-efficient unsupervised domain adaptation for medical image segmentation5 Dec 2022
- 2022Robust Alzheimer's Progression Modeling using Cross-Domain Self-Supervised Deep Learning15 Nov 2022
- 2022Adaptive Contrastive Learning with Dynamic Correlation for Multi-Phase Organ Segmentation16 Oct 2022
- 2022Dive into Self-Supervised Learning for Medical Image Analysis: Data, Models and Tasks25 Sep 2022
- 2022Prior Knowledge-Guided Attention in Self-Supervised Vision Transformers7 Sep 2022
- 2022Artifact-Tolerant Clustering-Guided Contrastive Embedding Learning for Ophthalmic Images2 Sep 2022
- 2022Self-Supervised Endoscopic Image Key-Points Matching24 Aug 2022
- 2022Anatomy-Aware Contrastive Representation Learning for Fetal Ultrasound22 Aug 2022
- 2022Metadata-enhanced contrastive learning from retinal optical coherence tomography images4 Aug 2022
- 2022Unsupervised pre-training of graph transformers on patient population graphs21 Jul 2022
- 2022Context-aware Self-supervised Learning for Medical Images Using Graph Neural Network6 Jul 2022
- 2022Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-View29 Jun 2022
- 2022Self-Supervised Learning as a Means To Reduce the Need for Labeled Data in Medical Image Analysis1 Jun 2022
- 2022Learning to segment with limited annotations: Self-supervised pretraining with regression and contrastive loss in MRI26 May 2022
- 2022Interaction of a priori Anatomic Knowledge with Self-Supervised Contrastive Learning in Cardiac Magnetic Resonance Imaging25 May 2022
- 2022Masked Image Modeling Advances 3D Medical Image Analysis25 Apr 2022
- 2022Translation Consistent Semi-supervised Segmentation for 3D Medical Images28 Mar 2022
- 2022Intelligent Masking: Deep Q-Learning for Context Encoding in Medical Image Analysis25 Mar 2022
- 2022Anomaly Detection-Inspired Few-Shot Medical Image Segmentation Through Self-Supervision With Supervoxels3 Mar 2022
- 2022Boundary-aware Information Maximization for Self-supervised Medical Image Segmentation4 Feb 2022
- 2021Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentation17 Dec 2021
- 2021ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Genetics26 Nov 2021
- 2021One-shot Weakly-Supervised Segmentation in Medical Images21 Nov 2021
- 2021Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentation1 Oct 2021
- 2021DeepMCAT: Large-Scale Deep Clustering for Medical Image Categorization30 Sep 2021
50 newest of 70 All 70 (JSON)
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021SimCVD: Simple Contrastive Voxel-Wise Representation Distillation for Semi-Supervised Medical Image Segmentationcited by 86
- 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2023Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Datacited by 68
- 2021Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentationcited by 49
- 2021Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentationcited by 43
- 2022Anomaly Detection-Inspired Few-Shot Medical Image Segmentation Through Self-Supervision With Supervoxelscited by 42
- 2021Self-supervised driven consistency training for annotation efficient histopathology image analysiscited by 39
- 2021ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Geneticscited by 35
12 most cited of 69 All 69 (JSON)
- 2026Task-Aligned Self-Supervised Learning for Medical Image Analysis: A Task-Oriented Review with Practical Design Guidelines18 May 2026
- 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Task7 May 2026
- 2025Deep Learning Approaches for Medical Imaging Under Varying Degrees of Label Availability: A Comprehensive Survey15 Apr 2025
- 2025Scaling up self-supervised learning for improved surgical foundation models16 Jan 2025
- 2024ISImed: A Framework for Self-Supervised Learning using Intrinsic Spatial Information in Medical Images22 Oct 2024
- 2024Exploring Foundation Models in Remote Sensing Image Change Detection: A Comprehensive Survey10 Oct 2024
- 2024Enhancing 3D Transformer Segmentation Model for Medical Image with Token-level Representation Learning12 Aug 2024
- 2024Assistive Image Annotation Systems with Deep Learning and Natural Language Capabilities: A Review28 Jun 2024
- 2024PoCo: A Self-Supervised Approach via Polar Transformation Based Progressive Contrastive Learning for Ophthalmic Disease Diagnosis28 Mar 2024
- 2024Self-Supervised Learning for Medical Image Data with Anatomy-Oriented Imaging Planes25 Mar 2024
- 2024Multi-organ Self-supervised Contrastive Learning for Breast Lesion Segmentation21 Feb 2024
- 2023A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labels26 Dec 2023
12 newest of 69 All 69 (JSON)