mlsanityData to 7 Oct 2026

Chest X-ray Foundation Model with Global and Local Representations Integration

arXiv 2502.05142 ↗First posted 7 Feb 2025eess.IV cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Chest X-ray (CXR) is the most frequently ordered imaging test, supporting diverse clinical tasks from thoracic disease detection to postoperative monitoring. However, task-specific classification models are limited in scope, require costly labeled data, and lack generalizability to out-of-distribution datasets. To address these challenges, we introduce CheXFound, a self-supervised vision foundation model that learns robust CXR representations and generalizes effectively across a wide range of downstream tasks. We pretrain CheXFound on a curated CXR-1M dataset, comprising over one million unique CXRs from publicly available sources. We propose a Global and Local Representations Integration (GLoRI) module for downstream adaptations, by incorporating disease-specific local features with global image features for enhanced performance in multilabel classification. Our experimental results show that CheXFound outperforms state-of-the-art models in classifying 40 disease findings across different prevalence levels on the CXR-LT 24 dataset and exhibits superior label efficiency on downstream tasks with limited training data. Additionally, CheXFound achieved significant improvements on new tasks with out-of-distribution datasets, including opportunistic cardiovascular disease risk estimation and mortality prediction. These results highlight CheXFound's strong generalization capabilities, enabling diverse adaptations with improved label efficiency. The project source code is publicly available at https://github.com/RPIDIAL/CheXFound.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 59 references that are in the map. First posted on arXiv 7 Feb 2025.

Builds on

35 of 59 references.

References · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  7. 2022A ConvNet for the 2020scited by 3,545
  8. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  9. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  10. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  11. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  12. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
23 more
  1. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  2. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  3. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
  4. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  5. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  6. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
  7. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  8. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 236
  9. 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
  10. 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
  11. 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
  12. 2020BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patientscited by 81
  13. 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretationcited by 79
  14. 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
  15. 2021CheXtransfer: Performance and Parameter Efficiency of ImageNet Models for Chest X-Ray Interpretationcited by 57
  16. 2021MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretationcited by 52
  17. 2021VinDr-RibCXR: A Benchmark Dataset for Automatic Segmentation and Labeling of Individual Ribs on Chest X-rayscited by 22
  18. 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 22
  19. 2024Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learningcited by 18
  20. 2023Towards Foundation Models Learned from Anatomy in Medical Imaging via Self-Supervisioncited by 11
  21. 2023Foundation Ark: Accruing and Reusing Knowledge for Superior and Robust Performancecited by 11
  22. 2024Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mambacited by 9
  23. 2023COVIDx CXR-4: An Expanded Multi-Institutional Open-Source Benchmark Dataset for Chest X-ray Image-Based Computer-Aided COVID-19 Diagnosticscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.