Resolution scaling governs DINOv3 transfer performance in chest radiograph classification
Not on the map. Why?
Abstract (arXiv)
Self-supervised learning (SSL) has improved visual representation learning, but its value in chest radiography remains uncertain. DINOv3 extends earlier SSL models through Gram-anchored self-distillation and explicit high-resolution adaptation. Whether these changes improve transfer learning for chest radiograph classification has not been established. We benchmarked DINOv3 against DINOv2 and supervised ImageNet initialization across seven chest radiograph datasets comprising 816,183 radiographs from pediatric and adult cohorts. ViT-B/16 and ConvNeXt-B were evaluated under full fine-tuning at 224 and 512 pixels, with targeted 1024 experiments on three cohorts. Additional analyses examined parameter-efficient adaptation, synthetic label corruption, external validation, frozen 7B features, and computational efficiency. The primary outcome was mean AUROC across labels. In adult cohorts, DINOv3 did not consistently outperform DINOv2 at 224 x 224 pixels, but became the strongest initialization at 512 x 512, especially with ConvNeXt-B. Gains were greatest for small focal and boundary-dependent abnormalities, whereas large-structure findings changed little. The pediatric cohort showed no significant benefit from DINOv3, higher resolution, or backbone choice. Scaling to 1024 x 1024 rarely improved performance and markedly increased computational cost. ConvNeXt-B remained superior to ViT-B/16 under both full and parameter-efficient adaptation. External validation preserved the 512 x 512 DINOv3 advantage, whereas synthetic label corruption showed that this benefit should not be interpreted simply as superior noise robustness. For adult chest radiograph classification, DINOv3 provides its most reliable benefit at 512 x 512 pixels, particularly with ConvNeXt-B. Fully adapted mid-sized models at 512 x 512 pixels provided the best performance-cost trade-off in our benchmark.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 66 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
30 of 66 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Layer Normalizationcited by 5,669
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2022A ConvNet for the 2020scited by 3,579
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
18 more
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 514
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
- 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 239
- 2018Spreading vectors for similarity searchcited by 118
- 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretationcited by 81
- 2021CheXtransfer: Performance and Parameter Efficiency of ImageNet Models for Chest X-Ray Interpretationcited by 57
- 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
- 2025MedDINOv3: How to adapt vision foundation models for medical image segmentation?cited by 25
- 2023Large Language Models Streamline Automated Machine Learning for Clinical Studiescited by 24
- 2025SegDINO: An Efficient Design for Medical and Natural Image Segmentation with DINO-V3cited by 20
- 2022PediCXR: An open, large-scale chest radiograph dataset for interpretation of common thoracic diseases in childrencited by 19
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imagingcited by 17
- 2023Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Imagescited by 11
- 2022Collaborative Training of Medical Artificial Intelligence Models with non-uniform Labelscited by 10
- 2024RadioRAG: Online Retrieval-augmented Generation for Radiology Question Answeringcited by 10
- 2023Preserving privacy in domain transfer of medical AI models comes at no performance costs: The integral role of differential privacycited by 6
- 2025Boosting multi-demographic federated learning for chest radiograph analysis using general-purpose self-supervised representationscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025DiSSECT: Structuring Transfer-Ready Medical Image Representations through Discrete Self-Supervision
- 2026CoralBay: A Self-Supervised CT Foundation Model
- 2026Feature-level Site Leakage Reduction for Cross-Hospital Chest X-ray Transfer via Self-Supervised Learning
- 2024DiNO-Diffusion. Scaling Medical Diffusion via Self-Supervised Pre-Training
- 2023Exploring Image Augmentations for Siamese Representation Learning with Chest X-Rays
- 2025Fixed-Budget Parameter-Efficient Training with Frozen Encoders Improves Multimodal Chest X-Ray Classification
- 2026Scaling Generative Foundation Models for Chest Radiography with Rectified Flow Transformers
- 2025Curriculum Learning with Synthetic Data for Enhanced Pulmonary Nodule Detection in Chest Radiographs