mlsanityData to 14 Oct 2026

Beyond Natural-Image Foundation Models: Benchmarking Satellite Pretraining for Ophthalmic Image Analysis

arXiv 2608.15195 ↗First posted 15 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision Foundation Models (VFMs) have emerged as a promising approach in medical imaging, producing broadly applicable systems that can be efficiently adapted across diverse imaging modalities, anatomical regions, and clinical tasks. However, VFMs require extensive training data, and their progress in medical image analysis is constrained by limited data availability, privacy concerns, and high development costs. To alleviate these constraints, medical VFMs (MedVFMs) are often built upon weights from generalist models pretrained on vast amounts of publicly available natural images, introducing a substantial distribution shift for medical task adaptation. To address this, we propose satellite imagery as a novel pretraining domain for MedVFM development and benchmarking, motivated by its closer visual alignment with medical data and its freedom from the privacy constraints that limit medical datasets. Across multiple ophthalmic imaging modalities, we compare DINOv3-SAT493m pretrained on 493 million satellite images against DINOv3-LVD1689m pretrained on 1.7 billion natural images, together with two medical specialist baselines: DINOv3-RETFound and MAE-RETFound. Our experiments show that satellite imagery is a stronger pretraining source than natural images for ophthalmic tasks, particularly on en face vascular-rich modalities. On several tasks, satellite pretraining matches or exceeds the medical specialists on high-resolution en face inputs, despite using no medical data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 37 references that are in the map. First posted on arXiv 15 Aug 2026.

Builds on

15 of 37 references.

References · 15

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  5. 2025DINOv3cited by 1,414
  6. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  7. 2020OCTA-500: A Retinal Dataset for Optical Coherence Tomography Angiography Studycited by 52
  8. 2021A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detectioncited by 34
  9. 2025MedDINOv3: How to adapt vision foundation models for medical image segmentation?cited by 25
  10. 2025Dino U-Net: Exploiting High-Fidelity Dense Features from Foundation Models for Medical Image Segmentationcited by 16
  11. 2024Training a high-performance retinal foundation model with half-the-data and 400 times less computecited by 9
  12. 2025Foundation Models in Medical Imaging: A Review and Outlookcited by 8
3 more
  1. 2025MIRAGE: Multimodal foundation model and benchmark for comprehensive retinal OCT image analysiscited by 7
  2. 2025Generalist versus Specialist Vision Foundation Models for Ocular Disease and Oculomicscited by 5
  3. 2026NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initializationcited by 2

Built on by

Not cited yet.