RFR-WWANet: Weighted Window Attention-Based Recovery Feature Resolution Network for Unsupervised Image Registration
Not on the map. Why?
Abstract (arXiv)
The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for establishing more distant relationships between corresponding voxels in different positions in complex abdominal image registration tasks. However, the registration models based on transformers combine multiple voxels into a single semantic token. This merging process limits the transformers to model and generate coarse-grained spatial information. To address this issue, we propose Recovery Feature Resolution Network (RFRNet), which allows the transformer to contribute fine-grained spatial information and rich semantic correspondences to higher resolution levels. Furthermore, shifted window partitioning operations are inflexible, indicating that they cannot perceive the semantic information over uncertain distances and automatically bridge the global connections between windows. Therefore, we present a Weighted Window Attention (WWA) to build global interactions between windows automatically. It is implemented after the regular and cyclic shift window partitioning operations within the Swin transformer block. The proposed unsupervised deformable image registration model, named RFR-WWANet, detects the long-range correlations, and facilitates meaningful semantic relevance of anatomical structures. Qualitative and quantitative results show that RFR-WWANet achieves significant improvements over the current state-of-the-art methods. Ablation experiments demonstrate the effectiveness of the RFRNet and WWA designs. Our code is available at urlhttps://github.com/MingR-Ma/RFR-WWANet.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 59 references that are in the map. First posted on arXiv 7 May 2023.
Builds on
29 of 59 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2015Spatial Transformer Networkscited by 1,423
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
17 more
- 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
- 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
- 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 176
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
- 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
- 2020Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networkscited by 107
- 2019Recursive Cascaded Networks for Unsupervised Medical Image Registrationcited by 105
- 2019Deep Learning in Medical Image Registration: A Reviewcited by 98
- 2021ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registrationcited by 87
- 2020CycleMorph: Cycle Consistent Unsupervised Deformable Image Registrationcited by 78
- 2017End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Networkcited by 75
- 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
- 2022VSA: Learning Varied-Size Window Attention in Vision Transformerscited by 43
- 2020DeepFLASH: An Efficient Network for Learning-based Medical Image Registrationcited by 37
- 2022Symmetric Transformer-based Network for Unsupervised Image Registrationcited by 9
- 2019Deep Morphological Simplification Network (MS-Net) for Guided Registration of Brain Magnetic Resonance Imagescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.