Cyclic Generative Adversarial Networks With Congruent Image-Report Generation For Explainable Medical Image Analysis
Not on the map. Why?
Abstract (arXiv)
We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from prior methods that focus on medical report generation from images or vice-versa, we novelly generate congruent image--report pairs employing a cyclic-Generative Adversarial Network (cycleGAN); thereby, the generated report will adequately explain a medical image, while a report-generated image that effectively characterizes the text visually should (sufficiently) resemble the original. The aim of the work is to generate trustworthy and faithful explanations for the outputs of a model diagnosing chest x-ray images by pointing a human user to similar cases in support of a diagnostic decision. Apart from enabling transparent medical image labeling and interpretation, we achieve report and image-based labeling comparable to prior methods, including state-of-the-art performance in some cases as evidenced by experiments on the Indiana Chest X-ray dataset
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 137 references that are in the map. First posted on arXiv 16 Nov 2022.
Builds on
34 of 137 references.
References · 34
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2018Efficient Active Learning for Image Classification and Segmentation using a Sample Selection and Conditional Generative Adversarial Networkcited by 74
- 2018Chest X-rays Classification: A Multi-Label and Fine-Grained Problemcited by 31
- 2021Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognitioncited by 27
- 2020Structure Preserving Stain Normalization of Histopathology Images Using Self-Supervised Semantic Guidancecited by 22
- 2021Interpretability-Driven Sample Selection Using Self Supervised Learning For Disease Classification And Segmentationcited by 22
- 2018Joint Segmentation and Uncertainty Visualization of Retinal Layers in Optical Coherence Tomography Images using Bayesian Deep Learningcited by 19
- 2020Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentationcited by 14
- 2021Improving Medical Image Classification with Label Noise Using Dual-uncertainty Estimationcited by 13
- 2018Deep multiscale convolutional feature learning for weakly supervised localization of chest pathologies in X-ray imagescited by 12
- 2019Night Time Haze and Glow Removal using Deep Dilated Convolutional Networkcited by 11
- 2019Progressive Generative Adversarial Networks for Medical Image Super resolutioncited by 11
22 more
- 2019Adversarial Pulmonary Pathology Translation for Pairwise Chest X-ray Data Augmentationcited by 11
- 2020Registration of Histopathogy Images Using Structural Information From Fine Grained Feature Mapscited by 11
- 2019Informative sample generation using class aware generative adversarial networks for classification of chest Xrayscited by 10
- 2022Probabilistic Integration of Object Level Annotations in Chest X-ray Classificationcited by 10
- 2017Retinal Vasculature Segmentation Using Local Saliency Maps and Generative Adversarial Networks For Image Super Resolutioncited by 9
- 2018GAN Based Medical Image Registrationcited by 9
- 2020Anomaly Detection on X-Rays Using Self-Supervised Aggregation Learningcited by 9
- 2016Consensus Based Medical Image Segmentation Using Semi-Supervised Learning And Graph Cutscited by 8
- 2019Training Data Independent Image Registration With GANs Using Transfer Learning And Segmentation Informationcited by 8
- 2019AMD Severity Prediction And Explainability Using Image Registration And Deep Embedded Clusteringcited by 8
- 2019sZoom: A Framework for Automatic Zoom into High Resolution Surveillance Videoscited by 8
- 2021CT Image Synthesis Using Weakly Supervised Segmentation and Geometric Inter-Label Relations For COVID Image Analysiscited by 8
- 2019Generative Adversarial Networks And Domain Adaptation For Training Data Independent Image Registrationcited by 7
- 2021Multi-scale Deep Learning Architecture for Nucleus Detection in Renal Cell Carcinoma Microscopy Imagecited by 7
- 2021Gated Fusion Network for SAO Filter and Inter Frame Prediction in Versatile Video Codingcited by 6
- 2022Anomaly Detection in Retinal Images using Multi-Scale Deep Feature Sparse Codingcited by 6
- 2021Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentationcited by 5
- 2022Outlier-based Autism Detection using Longitudinal Structural MRIcited by 5
- 2022Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classificationcited by 5
- 2021Multimodal Generalized Zero Shot Learning for Gleason Grading using Self-Supervised Learningcited by 4
- 2022Interpretable Saliency Maps And Self-Supervised Learning For Generalized Zero Shot Medical Image Classificationcited by 2
- 2022Improved Super Resolution of MR Images Using CNNs and Vision Transformerscited by 1
Built on by
Not cited yet.