A foundation model for generalizable disease diagnosis in chest X-ray images
Not on the map. Why?
Abstract (arXiv)
Medical artificial intelligence (AI) is revolutionizing the interpretation of chest X-ray (CXR) images by providing robust tools for disease diagnosis. However, the effectiveness of these AI models is often limited by their reliance on large amounts of task-specific labeled data and their inability to generalize across diverse clinical settings. To address these challenges, we introduce CXRBase, a foundational model designed to learn versatile representations from unlabelled CXR images, facilitating efficient adaptation to various clinical tasks. CXRBase is initially trained on a substantial dataset of 1.04 million unlabelled CXR images using self-supervised learning methods. This approach allows the model to discern meaningful patterns without the need for explicit labels. After this initial phase, CXRBase is fine-tuned with labeled data to enhance its performance in disease detection, enabling accurate classification of chest diseases. CXRBase provides a generalizable solution to improve model performance and alleviate the annotation workload of experts to enable broad clinical AI applications from chest imaging.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
23 of 37 references.
References · 23
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 641
- 2022Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Taskscited by 511
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
- 2020COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Imagescited by 264
- 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 239
11 more
- 2020Can AI help in screening Viral and COVID-19 pneumonia?cited by 200
- 2022Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learningcited by 159
- 2022What to Hide from Your Students: Attention-Guided Masked Image Modelingcited by 118
- 2020COVID-19 Image Data Collectioncited by 101
- 2020BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patientscited by 82
- 2023Advancing Radiograph Representation Learning with Masked Record Modelingcited by 75
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2020Reliable Tuberculosis Detection using Chest X-ray with Deep Learning, Segmentation and Visualizationcited by 50
- 2021A Structure-Aware Relation Network for Thoracic Diseases Detection and Segmentationcited by 34
- 2024MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generationcited by 17
- 2023Learning A Multi-Task Transformer Via Unified And Customized Instruction Tuning For Chest Radiograph Interpretationcited by 14
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 11.
12 papers.
- 2024Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directionscited by 18
- 2026The Model Knows Which Tokens Matter: Automatic Token Selection via Noise Gatingcited by 11
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learningcited by 10
- 2026Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Modelscited by 7
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compressioncited by 6
- 2026A unified multi-task framework enables interpretable chest radiograph analysiscited by 6
- 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosiscited by 5
- 2026Stepwise Token Selection for Efficient Multimodal Large Language Modelscited by 5
- 2026Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoningcited by 4
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathologycited by 2
- 2026DiffPrune: differentiable information throttling for token pruning in vision-language modelscited by 1
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactionscited by 0
- 2026DiffPrune: differentiable information throttling for token pruning in vision-language models3 Aug 2026
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathology26 Jul 2026
- 2026Stepwise Token Selection for Efficient Multimodal Large Language Models14 Jun 2026
- 2026Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoning7 Jun 2026
- 2026A unified multi-task framework enables interpretable chest radiograph analysis2 Jun 2026
- 2026Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Models27 May 2026
- 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosis3 Apr 2026
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression19 Mar 2026
- 2026From Snapshots to Symphonies: The Evolution of Protein Prediction from Static Structures to Generative Dynamics and Multimodal Interactions19 Mar 2026
- 2026The Model Knows Which Tokens Matter: Automatic Token Selection via Noise Gating7 Mar 2026
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learning7 Mar 2026
- 2024Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions3 Dec 2024