mlsanityData to 7 Oct 2026

MedDChest: A Content-Aware Multimodal Foundational Vision Model for Thoracic Imaging

arXiv 2511.04016 ↗First posted 6 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The performance of vision models in medical imaging is often hindered by the prevailing paradigm of fine-tuning backbones pre-trained on out-of-domain natural images. To address this fundamental domain gap, we propose MedDChest, a new foundational Vision Transformer (ViT) model optimized specifically for thoracic imaging. We pre-trained MedDChest from scratch on a massive, curated, multimodal dataset of over 1.2 million images, encompassing different modalities including Chest X-ray and Computed Tomography (CT) compiled from 10 public sources. A core technical contribution of our work is Guided Random Resized Crops, a novel content-aware data augmentation strategy that biases sampling towards anatomically relevant regions, overcoming the inefficiency of standard cropping techniques on medical scans. We validate our model's effectiveness by fine-tuning it on a diverse set of downstream diagnostic tasks. Comprehensive experiments empirically demonstrate that MedDChest significantly outperforms strong, publicly available ImageNet-pretrained models. By establishing the superiority of large-scale, in-domain pre-training combined with domain-specific data augmentation, MedDChest provides a powerful and robust feature extractor that serves as a significantly better starting point for a wide array of thoracic diagnostic tasks. The model weights will be made publicly available to foster future research and applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 40 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

19 of 40 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  8. 2016Densely Connected Convolutional Networkscited by 6,691
  9. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  10. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  11. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  12. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
7 more
  1. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
  2. 2017Deep Learning for Medical Image Analysiscited by 399
  3. 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 366
  4. 2017Learning to diagnose from scratch by exploiting dependencies among labelscited by 33
  5. 2019Evolutionary Neural AutoML for Deep Learningcited by 20
  6. 2020MUXConv: Information Multiplexing in Convolutional Neural Networkscited by 12
  7. 2024MedMAE: A Self-Supervised Backbone for Medical Imaging Taskscited by 5

Built on by

Not cited yet.