Learning to diagnose from scratch by exploiting dependencies among labels
Not on the map. Why?
Abstract (arXiv)
The field of medical diagnostics contains a wealth of challenges which closely resemble classical machine learning problems; practical constraints, however, complicate the translation of these endpoints naively into classical architectures. Many tasks in radiology, for example, are largely problems of multi-label classification wherein medical images are interpreted to indicate multiple present or suspected pathologies. Clinical settings drive the necessity for high accuracy simultaneously across a multitude of pathological outcomes and greatly limit the utility of tools which consider only a subset. This issue is exacerbated by a general scarcity of training data and maximizes the need to extract clinically relevant features from available samples -- ideally without the use of pre-trained models which may carry forward undesirable biases from tangentially related tasks. We present and evaluate a partial solution to these constraints in using LSTMs to leverage interdependencies among target labels in predicting 14 pathologic patterns from chest x-rays and establish state of the art results on the largest publicly available chest x-ray dataset from the NIH without pre-training. Furthermore, we propose and discuss alternative evaluation metrics and their relevance in clinical practice.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 4; 2023: 3; 2024: 3; 2025: 7; 2026: 5.
33 papers.
Sort:
By area:
- 2021Label-Assemble: Leveraging Multiple Datasets with Partial Labelscited by 20
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2021RadBERT-CL: Factually-Aware Contrastive Learning For Radiology Report Classificationcited by 13
- 2021SCALP -- Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadatacited by 9
- 2022Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rayscited by 7
- 2021Knowledge-Augmented Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loopcited by 6
- 2021Robust Classification from Noisy Labels: Integrating Additional Knowledge for Chest Radiography Abnormality Assessmentcited by 6
- 2023HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Imagescited by 6
- 2021Beyond Fine-tuning: Classifying High Resolution Mammograms using Function-Preserving Transformationscited by 5
- 2021Multi-Label Generalized Zero Shot Learning for the Classification of Disease in Chest Radiographscited by 5
- 2022ThoraX-PriorNet: A Novel Attention-Based Architecture Using Anatomical Prior Probability Maps for Thoracic Disease Classificationcited by 5
- 2023SynthEnsemble: A Fusion of CNN, Vision Transformer, and Hybrid Models for Multi-Label Chest X-Ray Classificationcited by 5
21 more
- 2024MedMAE: A Self-Supervised Backbone for Medical Imaging Taskscited by 5
- 2022RoS-KD: A Robust Stochastic Knowledge Distillation Approach for Noisy Medical Imagingcited by 4
- 2023BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognitioncited by 4
- 2021A Relational-learning Perspective to Multi-label Chest X-ray Classificationcited by 3
- 2024Computer-Aided Diagnosis of Thoracic Diseases in Chest X-rays using hybrid CNN-Transformer Architecturecited by 3
- 2021Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for Thoracic Disease Identificationcited by 2
- 2025DeepChest: Dynamic Gradient-Free Task Weighting for Effective Multi-Task Learning in Chest X-ray Classificationcited by 2
- 2025In-Model Merging for Enhancing the Robustness of Medical Imaging Classification Modelscited by 1
- 2025CLARiTy: A Vision Transformer for Multi-Label Classification and Weakly-Supervised Localization of Chest X-ray Pathologiescited by 1
- 2021Weighing Features of Lung and Heart Regions for Thoracic Disease Classificationcited by 0
- 2022Early Diagnosis of Chronic Obstructive Pulmonary Disease from Chest X-Rays using Transfer Learning and Fusion Strategiescited by 0
- 2024More Than Positive and Negative: Communicating Fine Granularity in Medical Diagnosiscited by 0
- 2025Diagnosis of Patients with Viral, Bacterial, and Non-Pneumonia Based on Chest X-Ray Images Using Convolutional Neural Networkscited by 0
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rayscited by 0
- 2025MedDChest: A Content-Aware Multimodal Foundational Vision Model for Thoracic Imagingcited by 0
- 2025Learning Sparse Label Couplings for Multilabel Chest X-Ray Diagnosiscited by 0
- 2026CBAM-Enhanced DenseNet121 for Multi-Class Chest X-Ray Classification with Grad-CAM Explainabilitycited by 0
- 2026Improving Imbalanced Multi-Label Chest X-Ray Diagnosis via CBAM-Enhanced CNN Backbonescited by 0
- 2026Leveraging Pathology Co-occurrence for Test-Time Adaptation in Chest X-Ray Diagnosiscited by 0
- 2026PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classificationcited by 0
- 2026AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via α-Corrected Binary Cross Entropy and Factorized Latent Supervisioncited by 0
- 2026AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via α-Corrected Binary Cross Entropy and Factorized Latent Supervision1 Sep 2026
- 2026PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification5 Jul 2026
- 2026Leveraging Pathology Co-occurrence for Test-Time Adaptation in Chest X-Ray Diagnosis4 Jul 2026
- 2026Improving Imbalanced Multi-Label Chest X-Ray Diagnosis via CBAM-Enhanced CNN Backbones4 May 2026
- 2026CBAM-Enhanced DenseNet121 for Multi-Class Chest X-Ray Classification with Grad-CAM Explainability14 Apr 2026
- 2025CLARiTy: A Vision Transformer for Multi-Label Classification and Weakly-Supervised Localization of Chest X-ray Pathologies18 Dec 2025
- 2025Learning Sparse Label Couplings for Multilabel Chest X-Ray Diagnosis11 Nov 2025
- 2025MedDChest: A Content-Aware Multimodal Foundational Vision Model for Thoracic Imaging6 Nov 2025
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rays29 Sep 2025
- 2025DeepChest: Dynamic Gradient-Free Task Weighting for Effective Multi-Task Learning in Chest X-ray Classification29 May 2025
- 2025Diagnosis of Patients with Viral, Bacterial, and Non-Pneumonia Based on Chest X-Ray Images Using Convolutional Neural Networks3 Mar 2025
- 2025In-Model Merging for Enhancing the Robustness of Medical Imaging Classification Models27 Feb 2025
21 more
- 2024More Than Positive and Negative: Communicating Fine Granularity in Medical Diagnosis5 Aug 2024
- 2024MedMAE: A Self-Supervised Backbone for Medical Imaging Tasks20 Jul 2024
- 2024Computer-Aided Diagnosis of Thoracic Diseases in Chest X-rays using hybrid CNN-Transformer Architecture18 Apr 2024
- 2023SynthEnsemble: A Fusion of CNN, Vision Transformer, and Hybrid Models for Multi-Label Chest X-Ray Classification13 Nov 2023
- 2023HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Images9 Oct 2023
- 2023BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognition22 Feb 2023
- 2022Early Diagnosis of Chronic Obstructive Pulmonary Disease from Chest X-Rays using Transfer Learning and Fusion Strategies13 Nov 2022
- 2022RoS-KD: A Robust Stochastic Knowledge Distillation Approach for Noisy Medical Imaging15 Oct 2022
- 2022ThoraX-PriorNet: A Novel Attention-Based Architecture Using Anatomical Prior Probability Maps for Thoracic Disease Classification6 Oct 2022
- 2022Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rays10 Jul 2022
- 2021RadBERT-CL: Factually-Aware Contrastive Learning For Radiology Report Classification28 Oct 2021
- 2021SCALP -- Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadata27 Oct 2021
- 2021Label-Assemble: Leveraging Multiple Datasets with Partial Labels25 Sep 2021
- 2021Multi-Label Generalized Zero Shot Learning for the Classification of Disease in Chest Radiographs14 Jul 2021
- 2021Weighing Features of Lung and Heart Regions for Thoracic Disease Classification26 May 2021
- 2021Robust Classification from Noisy Labels: Integrating Additional Knowledge for Chest Radiography Abnormality Assessment12 Apr 2021
- 2021Knowledge-Augmented Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop11 Apr 2021
- 2021A Relational-learning Perspective to Multi-label Chest X-ray Classification10 Mar 2021
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attack5 Mar 2021
- 2021Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for Thoracic Disease Identification26 Feb 2021
- 2021Beyond Fine-tuning: Classifying High Resolution Mammograms using Function-Preserving Transformations20 Jan 2021
- 2021Label-Assemble: Leveraging Multiple Datasets with Partial Labelscited by 20
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2021RadBERT-CL: Factually-Aware Contrastive Learning For Radiology Report Classificationcited by 13
- 2021SCALP -- Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadatacited by 9
- 2022Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rayscited by 7
- 2021Knowledge-Augmented Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loopcited by 6
- 2021Robust Classification from Noisy Labels: Integrating Additional Knowledge for Chest Radiography Abnormality Assessmentcited by 6
- 2023HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Imagescited by 6
- 2021Beyond Fine-tuning: Classifying High Resolution Mammograms using Function-Preserving Transformationscited by 5
- 2021Multi-Label Generalized Zero Shot Learning for the Classification of Disease in Chest Radiographscited by 5
- 2022ThoraX-PriorNet: A Novel Attention-Based Architecture Using Anatomical Prior Probability Maps for Thoracic Disease Classificationcited by 5
- 2023SynthEnsemble: A Fusion of CNN, Vision Transformer, and Hybrid Models for Multi-Label Chest X-Ray Classificationcited by 5
12 most cited of 32 All 32 (JSON)
- 2026PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification5 Jul 2026
- 2026Leveraging Pathology Co-occurrence for Test-Time Adaptation in Chest X-Ray Diagnosis4 Jul 2026
- 2026Improving Imbalanced Multi-Label Chest X-Ray Diagnosis via CBAM-Enhanced CNN Backbones4 May 2026
- 2026CBAM-Enhanced DenseNet121 for Multi-Class Chest X-Ray Classification with Grad-CAM Explainability14 Apr 2026
- 2025CLARiTy: A Vision Transformer for Multi-Label Classification and Weakly-Supervised Localization of Chest X-ray Pathologies18 Dec 2025
- 2025Learning Sparse Label Couplings for Multilabel Chest X-Ray Diagnosis11 Nov 2025
- 2025MedDChest: A Content-Aware Multimodal Foundational Vision Model for Thoracic Imaging6 Nov 2025
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rays29 Sep 2025
- 2025DeepChest: Dynamic Gradient-Free Task Weighting for Effective Multi-Task Learning in Chest X-ray Classification29 May 2025
- 2025Diagnosis of Patients with Viral, Bacterial, and Non-Pneumonia Based on Chest X-Ray Images Using Convolutional Neural Networks3 Mar 2025
- 2025In-Model Merging for Enhancing the Robustness of Medical Imaging Classification Models27 Feb 2025
- 2024More Than Positive and Negative: Communicating Fine Granularity in Medical Diagnosis5 Aug 2024
12 newest of 32 All 32 (JSON)