Multi-view analysis of unregistered medical images using cross-view transformers
Not on the map. Why?
Abstract (arXiv)
Multi-view medical image analysis often depends on the combination of information from multiple views. However, differences in perspective or other forms of misalignment can make it difficult to combine views effectively, as registration is not always possible. Without registration, views can only be combined at a global feature level, by joining feature vectors after global pooling. We present a novel cross-view transformer method to transfer information between unregistered views at the level of spatial feature maps. We demonstrate this method on multi-view mammography and chest X-ray datasets. On both datasets, we find that a cross-view transformer that links spatial feature maps can outperform a baseline model that joins feature vectors after global pooling.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 8 of its 19 references that are in the map. First posted on arXiv 21 Mar 2021.
Builds on
8 of 19 references.
References · 8
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 333
- 2019Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screeningcited by 94
- 2018Large Scale Automated Reading of Frontal and Lateral Chest X-Rays using Dual Convolutional Neural Networkscited by 20
- 2020Quantifying the Value of Lateral Views in Deep Learning for Chest X-rayscited by 16
- 2019Cross-view Relation Networks for Mammogram Mass Detectioncited by 11
Built on by
Citing papers per year: 2021: 1; 2022: 8; 2023: 11; 2024: 6; 2025: 6; 2026: 3.
35 papers.
Sort:
By area:
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2021A Survey of Visual Transformerscited by 117
- 2022A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localizationcited by 55
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2022Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysiscited by 25
- 2023Towards Evaluating Explanations of Vision Transformers for Medical Imagingcited by 22
- 2023Transformers in Healthcare: A Surveycited by 17
- 2022Transformers Improve Breast Cancer Diagnosis from Unregistered Multi-View Mammogramscited by 11
- 2024MV-Swin-T: Mammogram Classification with Multi-view Swin Transformercited by 11
- 2022Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Imagescited by 9
- 2024Mammo-CLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Enhanced Breast Cancer Diagnosis with Multi-view Mammographycited by 9
- 2024Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mambacited by 9
23 more
- 2022Multi-View Hypercomplex Learning for Breast Cancer Screeningcited by 7
- 2023Detecting Heart Disease from Multi-View Ultrasound Images via Supervised Attention Multiple Instance Learningcited by 7
- 2023MoViT: Memorizing Vision Transformers for Medical Image Analysiscited by 6
- 2024A Deep Network for Explainable Prediction of Non-Imaging Phenotypes using Anatomical Multi-View Datacited by 6
- 2025XFMamba: Cross-Fusion Mamba for Multi-View Medical Image Classificationcited by 5
- 2023MultiNet with Transformers: A Model for Cancer Diagnosis Using Imagescited by 3
- 2023DisAsymNet: Disentanglement of Asymmetrical Abnormality on Bilateral Mammograms using Self-adversarial Learningcited by 3
- 2023M&M: Tackling False Positives in Mammography with a Multi-view and Multi-instance Learning Sparse Detectorcited by 2
- 2023TransReg: Cross-transformer as auto-registration module for multi-view mammogram mass detectioncited by 2
- 2025A Hybrid CNN-VSSM model for Multi-View, Multi-Task Mammography Analysis: Robust Diagnosis with Attention-Based Fusioncited by 2
- 2022Deep is a Luxury We Don't Havecited by 1
- 2023End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformerscited by 1
- 2023Case-level Breast Cancer Prediction for Real Hospital Settingscited by 1
- 2023HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial Viewcited by 1
- 2025Breast Cancer Detection from Multi-View Screening Mammograms with Visual Prompt Tuningcited by 1
- 2025MammoClean: Toward Reproducible and Bias-Aware AI in Mammography through Dataset Harmonizationcited by 1
- 2024Random Token Fusion for Multi-View Medical Diagnosiscited by 0
- 2024Hierarchical mutual distillation for multi-view fusion: Learning from all possible view combinationscited by 0
- 2025Integrating AI for Human-Centric Breast Cancer Diagnostics: A Multi-Scale and Multi-View Swin Transformer Frameworkcited by 0
- 2025Convolutional Set Transformercited by 0
- 2026Axial-Centric Cross-Plane Attention for 3D Medical Image Classificationcited by 0
- 2026OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classificationcited by 0
- 2026Token-Based Dual-view Fusion and Adaptation of Large Vision Models for Breast Cancer Classificationcited by 0
- 2026Token-Based Dual-view Fusion and Adaptation of Large Vision Models for Breast Cancer Classification7 Jul 2026
- 2026OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classification18 Jun 2026
- 2026Axial-Centric Cross-Plane Attention for 3D Medical Image Classification25 Feb 2026
- 2025MammoClean: Toward Reproducible and Bias-Aware AI in Mammography through Dataset Harmonization4 Nov 2025
- 2025Convolutional Set Transformer26 Sep 2025
- 2025A Hybrid CNN-VSSM model for Multi-View, Multi-Task Mammography Analysis: Robust Diagnosis with Attention-Based Fusion22 Jul 2025
- 2025Breast Cancer Detection from Multi-View Screening Mammograms with Visual Prompt Tuning28 Apr 2025
- 2025Integrating AI for Human-Centric Breast Cancer Diagnostics: A Multi-Scale and Multi-View Swin Transformer Framework17 Mar 2025
- 2025XFMamba: Cross-Fusion Mamba for Multi-View Medical Image Classification4 Mar 2025
- 2024Hierarchical mutual distillation for multi-view fusion: Learning from all possible view combinations15 Nov 2024
- 2024Random Token Fusion for Multi-View Medical Diagnosis21 Oct 2024
- 2024Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mamba28 May 2024
23 more
- 2024Mammo-CLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Enhanced Breast Cancer Diagnosis with Multi-view Mammography24 Apr 2024
- 2024MV-Swin-T: Mammogram Classification with Multi-view Swin Transformer26 Feb 2024
- 2024A Deep Network for Explainable Prediction of Non-Imaging Phenotypes using Anatomical Multi-View Data9 Jan 2024
- 2023HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View27 Nov 2023
- 2023TransReg: Cross-transformer as auto-registration module for multi-view mammogram mass detection9 Nov 2023
- 2023Case-level Breast Cancer Prediction for Real Hospital Settings19 Oct 2023
- 2023M&M: Tackling False Positives in Mammography with a Multi-view and Multi-instance Learning Sparse Detector11 Aug 2023
- 2023DisAsymNet: Disentanglement of Asymmetrical Abnormality on Bilateral Mammograms using Self-adversarial Learning6 Jul 2023
- 2023End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers3 Jul 2023
- 2023Transformers in Healthcare: A Survey30 Jun 2023
- 2023Detecting Heart Disease from Multi-View Ultrasound Images via Supervised Attention Multiple Instance Learning25 May 2023
- 2023Towards Evaluating Explanations of Vision Transformers for Medical Imaging12 Apr 2023
- 2023MoViT: Memorizing Vision Transformers for Medical Image Analysis27 Mar 2023
- 2023MultiNet with Transformers: A Model for Cancer Diagnosis Using Images21 Jan 2023
- 2022Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Images26 Nov 2022
- 2022Deep is a Luxury We Don't Have11 Aug 2022
- 2022Transformers Improve Breast Cancer Diagnosis from Unregistered Multi-View Mammograms21 Jun 2022
- 2022Multi-View Hypercomplex Learning for Breast Cancer Screening12 Apr 2022
- 2022Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysis30 Mar 2022
- 2022Transformers in Medical Image Analysis: A Review24 Feb 2022
- 2022Transformers in Medical Imaging: A Survey24 Jan 2022
- 2022A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localization23 Jan 2022
- 2021A Survey of Visual Transformers11 Nov 2021
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2021A Survey of Visual Transformerscited by 117
- 2022A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localizationcited by 55
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2022Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysiscited by 25
- 2023Towards Evaluating Explanations of Vision Transformers for Medical Imagingcited by 22
- 2023Transformers in Healthcare: A Surveycited by 17
- 2022Transformers Improve Breast Cancer Diagnosis from Unregistered Multi-View Mammogramscited by 11
- 2024MV-Swin-T: Mammogram Classification with Multi-view Swin Transformercited by 11
- 2022Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Imagescited by 9
- 2024Mammo-CLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Enhanced Breast Cancer Diagnosis with Multi-view Mammographycited by 9
- 2022Multi-View Hypercomplex Learning for Breast Cancer Screeningcited by 7
12 most cited of 33 All 33 (JSON)
- 2026Token-Based Dual-view Fusion and Adaptation of Large Vision Models for Breast Cancer Classification7 Jul 2026
- 2026OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classification18 Jun 2026
- 2026Axial-Centric Cross-Plane Attention for 3D Medical Image Classification25 Feb 2026
- 2025MammoClean: Toward Reproducible and Bias-Aware AI in Mammography through Dataset Harmonization4 Nov 2025
- 2025Convolutional Set Transformer26 Sep 2025
- 2025A Hybrid CNN-VSSM model for Multi-View, Multi-Task Mammography Analysis: Robust Diagnosis with Attention-Based Fusion22 Jul 2025
- 2025Breast Cancer Detection from Multi-View Screening Mammograms with Visual Prompt Tuning28 Apr 2025
- 2025Integrating AI for Human-Centric Breast Cancer Diagnostics: A Multi-Scale and Multi-View Swin Transformer Framework17 Mar 2025
- 2024Hierarchical mutual distillation for multi-view fusion: Learning from all possible view combinations15 Nov 2024
- 2024Random Token Fusion for Multi-View Medical Diagnosis21 Oct 2024
- 2024Mammo-CLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Enhanced Breast Cancer Diagnosis with Multi-view Mammography24 Apr 2024
- 2024MV-Swin-T: Mammogram Classification with Multi-view Swin Transformer26 Feb 2024
12 newest of 33 All 33 (JSON)