CT Image Synthesis Using Weakly Supervised Segmentation and Geometric Inter-Label Relations For COVID Image Analysis
Not on the map. Why?
Abstract (arXiv)
While medical image segmentation is an important task for computer aided diagnosis, the high expertise requirement for pixelwise manual annotations makes it a challenging and time consuming task. Since conventional data augmentations do not fully represent the underlying distribution of the training set, the trained models have varying performance when tested on images captured from different sources. Most prior work on image synthesis for data augmentation ignore the interleaved geometric relationship between different anatomical labels. We propose improvements over previous GAN-based medical image synthesis methods by learning the relationship between different anatomical labels. We use a weakly supervised segmentation method to obtain pixel level semantic label map of images which is used learn the intrinsic relationship of geometry and shape across semantic labels. Latent space variable sampling results in diverse generated images from a base image and improves robustness. We use the synthetic images from our method to train networks for segmenting COVID-19 infected areas from lung CT images. The proposed method outperforms state-of-the-art segmentation methods on a public dataset. Ablation studies also demonstrate benefits of integrating geometry and diversity.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 46 of its 156 references that are in the map. First posted on arXiv 15 Jun 2021.
Builds on
46 of 156 references.
References · 46
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Going Deeper with Convolutionscited by 4,241
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2015Spatial Transformer Networkscited by 1,429
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
- 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 283
- 2017Data Augmentation Generative Adversarial Networkscited by 278
- 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2020Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Imagescited by 184
34 more
- 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 147
- 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
- 2019PHiSeg: Capturing Uncertainty in Medical Image Segmentationcited by 128
- 2016Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypothesescited by 97
- 2020COVID-CT-Dataset: A CT Scan Dataset about COVID-19cited by 94
- 2018Efficient Active Learning for Image Classification and Segmentation using a Sample Selection and Conditional Generative Adversarial Networkcited by 74
- 2019CAMEL: A Weakly Supervised Learning Framework for Histopathology Image Segmentationcited by 73
- 2020Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation and Diagnosis for COVID-19cited by 62
- 2018CT-Realistic Lung Nodule Simulation from 3D Conditional Generative Adversarial Networks for Robust Lung Segmentationcited by 34
- 2018Chest X-rays Classification: A Multi-Label and Fine-Grained Problemcited by 31
- 2020Lung Infection Quantification of COVID-19 in CT Images with Deep Learningcited by 28
- 2020Viral Pneumonia Screening on Chest X-ray Images Using Confidence-Aware Anomaly Detectioncited by 28
- 2021Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognitioncited by 27
- 2020Structure Preserving Stain Normalization of Histopathology Images Using Self-Supervised Semantic Guidancecited by 22
- 2021Interpretability-Driven Sample Selection Using Self Supervised Learning For Disease Classification And Segmentationcited by 22
- 2018Joint Segmentation and Uncertainty Visualization of Retinal Layers in Optical Coherence Tomography Images using Bayesian Deep Learningcited by 19
- 2020Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentationcited by 14
- 2021Improving Medical Image Classification with Label Noise Using Dual-uncertainty Estimationcited by 13
- 2018Deep multiscale convolutional feature learning for weakly supervised localization of chest pathologies in X-ray imagescited by 12
- 2019Night Time Haze and Glow Removal using Deep Dilated Convolutional Networkcited by 11
- 2019Progressive Generative Adversarial Networks for Medical Image Super resolutioncited by 11
- 2019Adversarial Pulmonary Pathology Translation for Pairwise Chest X-ray Data Augmentationcited by 11
- 2020Registration of Histopathogy Images Using Structural Information From Fine Grained Feature Mapscited by 11
- 2019Informative sample generation using class aware generative adversarial networks for classification of chest Xrayscited by 10
- 2017Retinal Vasculature Segmentation Using Local Saliency Maps and Generative Adversarial Networks For Image Super Resolutioncited by 9
- 2018GAN Based Medical Image Registrationcited by 9
- 2020Anomaly Detection on X-Rays Using Self-Supervised Aggregation Learningcited by 9
- 2016Consensus Based Medical Image Segmentation Using Semi-Supervised Learning And Graph Cutscited by 8
- 2019Training Data Independent Image Registration With GANs Using Transfer Learning And Segmentation Informationcited by 8
- 2019AMD Severity Prediction And Explainability Using Image Registration And Deep Embedded Clusteringcited by 8
- 2019sZoom: A Framework for Automatic Zoom into High Resolution Surveillance Videoscited by 8
- 2021Multi-scale Deep Learning Architecture for Nucleus Detection in Renal Cell Carcinoma Microscopy Imagecited by 7
- 2020Automated Quantification of CT Patterns Associated with COVID-19 from Chest CTcited by 3
- 2020Harmony-Search and Otsu based System for Coronavirus Disease (COVID-19) Detection using Lung CT Scan Imagescited by 3
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 1; 2024: 0; 2025: 1.
8 papers.
- 2021Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentationcited by 5
- 2022Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classificationcited by 5
- 2021Multimodal Generalized Zero Shot Learning for Gleason Grading using Self-Supervised Learningcited by 4
- 2023DACov: A Deeper Analysis of Data Augmentation on the Computed Tomography Segmentation Problemcited by 3
- 2022Interpretable Saliency Maps And Self-Supervised Learning For Generalized Zero Shot Medical Image Classificationcited by 2
- 2022Improved Super Resolution of MR Images Using CNNs and Vision Transformerscited by 1
- 2022Cyclic Generative Adversarial Networks With Congruent Image-Report Generation For Explainable Medical Image Analysiscited by 0
- 2025Sound Signal Synthesis with Auxiliary Classifier GAN, COVID-19 cough as an examplecited by 0
- 2025Sound Signal Synthesis with Auxiliary Classifier GAN, COVID-19 cough as an example12 Aug 2025
- 2023DACov: A Deeper Analysis of Data Augmentation on the Computed Tomography Segmentation Problem10 Mar 2023
- 2022Cyclic Generative Adversarial Networks With Congruent Image-Report Generation For Explainable Medical Image Analysis16 Nov 2022
- 2022Improved Super Resolution of MR Images Using CNNs and Vision Transformers24 Jul 2022
- 2022Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classification27 Jun 2022
- 2022Interpretable Saliency Maps And Self-Supervised Learning For Generalized Zero Shot Medical Image Classification4 Apr 2022
- 2021Multimodal Generalized Zero Shot Learning for Gleason Grading using Self-Supervised Learning15 Nov 2021
- 2021Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentation1 Oct 2021