Vascular anatomy-aware self-supervised pre-training for X-ray angiogram analysis
Not on the map. Why?
Abstract (arXiv)
X-ray angiography is the gold standard imaging modality for cardiovascular diseases. However, current deep learning approaches for X-ray angiogram analysis are severely constrained by the scarcity of annotated data. While large-scale self-supervised learning (SSL) has emerged as a promising solution, its potential in this domain remains largely unexplored, primarily due to the lack of effective SSL frameworks and large-scale datasets. To bridge this gap, we introduce a vascular anatomy-aware masked image modeling (VasoMIM) framework that explicitly integrates domain-specific anatomical knowledge. Specifically, VasoMIM comprises two key designs: an anatomy-guided masking strategy and an anatomical consistency loss. The former strategically masks vessel-containing patches to compel the model to learn robust vascular semantics, while the latter preserves structural consistency of vessels between original and reconstructed images, enhancing the discriminability of the learned representations. In conjunction with VasoMIM, we curate XA-170K, the largest X-ray angiogram pre-training dataset to date. We validate VasoMIM on four downstream tasks across six datasets, where it demonstrates superior transferability and achieves state-of-the-art performance compared to existing methods. These findings highlight the significant potential of VasoMIM as a foundation model for advancing a wide range of X-ray angiogram analysis tasks. VasoMIM and XA-170K will be available at https://github.com/Dxhuang-CASIA/XA-SSL.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 66 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
41 of 66 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2025DINOv3cited by 1,297
29 more
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 286
- 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 286
- 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
- 2022UNeXt: MLP-based Rapid Medical Image Segmentation Networkcited by 185
- 2018The Contextual Loss for Image Transformation with Non-Aligned Datacited by 135
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
- 2020Comparing to Learn: Surpassing ImageNet Pretraining on Radiographs By Comparing Image Representationscited by 69
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2023Masked Image Modeling with Local Multi-Scale Reconstructioncited by 43
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
- 2023HAP: Structure-Aware Masked Image Modeling for Human-Centric Perceptioncited by 33
- 2025MedDINOv3: How to adapt vision foundation models for medical image segmentation?cited by 25
- 2025CheXWorld: Exploring Image World Modeling for Radiograph Representation Learningcited by 18
- 2024MiM: Mask in Mask Self-Supervised Pre-Training for 3D Medical Image Analysiscited by 17
- 2025Towards a general-purpose foundation model for fMRI analysiscited by 15
- 2024DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentationcited by 13
- 2024CADICA: a new dataset for coronary artery disease detection by using invasive coronary angiographycited by 11
- 2024AnatoMask: Enhancing Medical Image Segmentation with Reconstruction-guided Self-maskingcited by 10
- 2024Improving Representation of High-frequency Components for Medical Visual Foundation Modelscited by 8
- 2024MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentationcited by 7
- 2025RWKV-UNet: Improving UNet with Long-Range Cooperation for Effective Medical Image Segmentationcited by 7
- 2024SPIRONet: Spatial-Frequency Learning and Graph-based Channel Interaction Network for Vessel Segmentationcited by 6
- 2025Large-scale Multi-sequence Pretraining for Generalizable MRI Analysis in Versatile Clinical Applicationscited by 2
- 2025VasoMIM: Vascular Anatomy-Aware Masked Image Modeling for Vessel Segmentationcited by 2
Built on by
Not cited yet.