TMS-Net: A Segmentation Network Coupled With A Run-time Quality Control Method For Robust Cardiac Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Recently, deep networks have shown impressive performance for the segmentation of cardiac Magnetic Resonance Imaging (MRI) images. However, their achievement is proving slow to transition to widespread use in medical clinics because of robustness issues leading to low trust of clinicians to their results. Predicting run-time quality of segmentation masks can be useful to warn clinicians against poor results. Despite its importance, there are few studies on this problem. To address this gap, we propose a quality control method based on the agreement across decoders of a multi-view network, TMS-Net, measured by the cosine similarity. The network takes three view inputs resliced from the same 3D image along different axes. Different from previous multi-view networks, TMS-Net has a single encoder and three decoders, leading to better noise robustness, segmentation performance and run-time quality estimation in our experiments on the segmentation of the left atrium on STACOM 2013 and STACOM 2018 challenge datasets. We also present a way to generate poor segmentation masks by using noisy images generated with engineered noise and Rician noise to simulate undertraining, high anisotropy and poor imaging settings problems. Our run-time quality estimation method show a good classification of poor and good quality segmentation masks with an AUC reaching to 0.97 on STACOM 2018. We believe that TMS-Net and our run-time quality estimation method has a high potential to increase the thrust of clinicians to automatic image analysis tools.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 61 references that are in the map. First posted on arXiv 21 Dec 2022.
Builds on
29 of 61 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2016Adversarial examples in the physical worldcited by 1,762
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
17 more
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 278
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2019CE-Net: Context Encoder Network for 2D Medical Image Segmentationcited by 219
- 2020U-Net and its variants for medical image segmentation: theory and applicationscited by 169
- 2019Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentationcited by 162
- 2019Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systemscited by 151
- 2015Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networkscited by 138
- 2021Transparency of Deep Neural Networks for Medical Image Analysis: A Review of Interpretability Methodscited by 83
- 20203D Deep Learning on Medical Images: A Reviewcited by 76
- 2019Assessing Reliability and Challenges of Uncertainty Estimations for Medical Image Segmentationcited by 75
- 2019Multi-level Wavelet Convolutional Neural Networkscited by 59
- 2017Reverse Classification Accuracy: Predicting Segmentation Performance in the Absence of Ground Truthcited by 35
- 2018Inherent Brain Segmentation Quality Control from Fully ConvNet Monte Carlo Samplingcited by 20
- 2018Multi-Task Learning for Left Atrial Segmentation on GE-MRIcited by 16
- 2018Automatically Segmenting the Left Atrium from Cardiac Images Using Successive 3D U-Nets and a Contour Losscited by 8
- 2017CardiacNET: Segmentation of Left Atrium and Proximal Pulmonary Veins from MRI Using Multi-View CNNcited by 7
- 2018Combating Uncertainty with Novel Losses for Automatic Left Atrium Segmentationcited by 7
Built on by
Not cited yet.