Weakly Supervised Thoracic Disease Localization via Disease Masks
Not on the map. Why?
Abstract (arXiv)
To enable a deep learning-based system to be used in the medical domain as a computer-aided diagnosis system, it is essential to not only classify diseases but also present the locations of the diseases. However, collecting instance-level annotations for various thoracic diseases is expensive. Therefore, weakly supervised localization methods have been proposed that use only image-level annotation. While the previous methods presented the disease location as the most discriminative part for classification, this causes a deep network to localize wrong areas for indistinguishable X-ray images. To solve this issue, we propose a spatial attention method using disease masks that describe the areas where diseases mainly occur. We then apply the spatial attention to find the precise disease area by highlighting the highest probability of disease occurrence. Meanwhile, the various sizes, rotations and noise in chest X-ray images make generating the disease masks challenging. To reduce the variation among images, we employ an alignment module to transform an input X-ray image into a generalized image. Through extensive experiments on the NIH-Chest X-ray dataset with eight kinds of diseases, we show that the proposed method results in superior localization performances compared to state-of-the-art methods.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 25 Jan 2021.
Builds on
29 of 42 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2015VQA: Visual Question Answeringcited by 2,489
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2017Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localizationcited by 207
17 more
- 2018Adversarial Complementary Learning for Weakly Supervised Object Localizationcited by 166
- 2020When Radiology Report Generation Meets Knowledge Graphcited by 144
- 2018TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-rayscited by 139
- 2019Clinically Accurate Chest X-Ray Report Generationcited by 138
- 2019Attention-based Dropout Layer for Weakly Supervised Object Localizationcited by 125
- 2014From Captions to Visual Concepts and Backcited by 109
- 2015Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answeringcited by 80
- 2018Self-produced Guidance for Weakly-supervised Object Localizationcited by 72
- 2017Thoracic Disease Identification and Localization with Limited Supervisioncited by 55
- 2020Weakly Supervised Lesion Localization With Probabilistic-CAM Poolingcited by 35
- 2019InfoMask: Masked Variational Latent Representation to Localize Chest Diseasecited by 15
- 2019Discretely-constrained deep network for weakly supervised segmentationcited by 12
- 2018Iterative Attention Mining for Weakly Supervised Thoracic Disease Pattern Localization in Chest X-Rayscited by 10
- 2019TUNA-Net: Task-oriented UNsupervised Adversarial Network for Disease Recognition in Cross-Domain Chest X-rayscited by 10
- 2019Adversarial regression training for visualizing the progression of chronic obstructive pulmonary disease with chest x-rayscited by 6
- 2018Multi-Scale Gradual Integration CNN for False Positive Reduction in Pulmonary Nodule Detectioncited by 5
- 2019Dual-attention Focused Module for Weakly Supervised Object Localizationcited by 2
Built on by
Citing papers per year: 2023: 4; 2024: 1.
5 papers.
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directionscited by 14
- 2023HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Imagescited by 6
- 2023Leveraging Anatomical Constraints with Uncertainty for Pneumothorax Segmentationcited by 3
- 2023Learning to Generalize towards Unseen Domains via a Content-Aware Style Invariant Model for Disease Detection from Chest X-rayscited by 2
- 2024Clinical Domain Knowledge-Derived Template Improves Post Hoc AI Explanations in Pneumothorax Classificationcited by 1
- 2024Clinical Domain Knowledge-Derived Template Improves Post Hoc AI Explanations in Pneumothorax Classification26 Mar 2024
- 2023Leveraging Anatomical Constraints with Uncertainty for Pneumothorax Segmentation26 Nov 2023
- 2023HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Images9 Oct 2023
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directions22 Mar 2023
- 2023Learning to Generalize towards Unseen Domains via a Content-Aware Style Invariant Model for Disease Detection from Chest X-rays27 Feb 2023