Chest X-ray Foundation Model with Global and Local Representations Integration
Not on the map. Why?
Abstract (arXiv)
Chest X-ray (CXR) is the most frequently ordered imaging test, supporting diverse clinical tasks from thoracic disease detection to postoperative monitoring. However, task-specific classification models are limited in scope, require costly labeled data, and lack generalizability to out-of-distribution datasets. To address these challenges, we introduce CheXFound, a self-supervised vision foundation model that learns robust CXR representations and generalizes effectively across a wide range of downstream tasks. We pretrain CheXFound on a curated CXR-1M dataset, comprising over one million unique CXRs from publicly available sources. We propose a Global and Local Representations Integration (GLoRI) module for downstream adaptations, by incorporating disease-specific local features with global image features for enhanced performance in multilabel classification. Our experimental results show that CheXFound outperforms state-of-the-art models in classifying 40 disease findings across different prevalence levels on the CXR-LT 24 dataset and exhibits superior label efficiency on downstream tasks with limited training data. Additionally, CheXFound achieved significant improvements on new tasks with out-of-distribution datasets, including opportunistic cardiovascular disease risk estimation and mortality prediction. These results highlight CheXFound's strong generalization capabilities, enabling diverse adaptations with improved label efficiency. The project source code is publicly available at https://github.com/RPIDIAL/CheXFound.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 59 references that are in the map. First posted on arXiv 7 Feb 2025.
Builds on
35 of 59 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2022A ConvNet for the 2020scited by 3,545
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
23 more
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
- 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 236
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
- 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
- 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
- 2020BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patientscited by 81
- 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretationcited by 79
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2021CheXtransfer: Performance and Parameter Efficiency of ImageNet Models for Chest X-Ray Interpretationcited by 57
- 2021MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretationcited by 52
- 2021VinDr-RibCXR: A Benchmark Dataset for Automatic Segmentation and Labeling of Individual Ribs on Chest X-rayscited by 22
- 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 22
- 2024Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learningcited by 18
- 2023Towards Foundation Models Learned from Anatomy in Medical Imaging via Self-Supervisioncited by 11
- 2023Foundation Ark: Accruing and Reusing Knowledge for Superior and Robust Performancecited by 11
- 2024Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mambacited by 9
- 2023COVIDx CXR-4: An Expanded Multi-Institutional Open-Source Benchmark Dataset for Chest X-ray Image-Based Computer-Aided COVID-19 Diagnosticscited by 6
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Xray2Xray: World Model from Chest X-rays with Volumetric Contextcited by 4
- 2025X-WIN: Building Chest Radiograph World Model via Predictive Sensingcited by 2
- 2026Evidential Reasoning Advances Interpretable Real-World Disease Screeningcited by 0
- 2026Vision Foundation Models in Radiology: A Scoping Review of Data, Methodology, Evaluation and Clinical Translationcited by 0
- 2026Med-RADIO: Reducing All Medical Domains Into One via Multi-Teacher Distillationcited by 0
- 2026Med-RADIO: Reducing All Medical Domains Into One via Multi-Teacher Distillation29 Sep 2026
- 2026Vision Foundation Models in Radiology: A Scoping Review of Data, Methodology, Evaluation and Clinical Translation8 Jul 2026
- 2026Evidential Reasoning Advances Interpretable Real-World Disease Screening14 May 2026
- 2025X-WIN: Building Chest Radiograph World Model via Predictive Sensing18 Nov 2025
- 2025Xray2Xray: World Model from Chest X-rays with Volumetric Context17 Jun 2025