Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Network
Not on the map. Why?
Abstract (arXiv)
3D medical image registration is of great clinical importance. However, supervised learning methods require a large amount of accurately annotated corresponding control points (or morphing), which are very difficult to obtain. Unsupervised learning methods ease the burden of manual annotation by exploiting unlabeled data without supervision. In this paper, we propose a new unsupervised learning method using convolutional neural networks under an end-to-end framework, Volume Tweening Network (VTN), for 3D medical image registration. We propose three innovative technical components: (1) An end-to-end cascading scheme that resolves large displacement; (2) An efficient integration of affine registration network; and (3) An additional invertibility loss that encourages backward consistency. Experiments demonstrate that our algorithm is 880x faster (or 3.3x faster without GPU acceleration) than traditional optimization-based methods and achieves state-of-theart performance in medical image registration.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 14; 2023: 14; 2024: 13; 2025: 9; 2026: 1.
62 papers.
Sort:
By area:
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Reviewcited by 62
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2022Affine Medical Image Registration with Coarse-to-Fine Vision Transformercited by 35
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusioncited by 22
- 2023Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registrationcited by 21
- 2024Deep Learning in Medical Image Registration: Magic or Mirage?cited by 20
- 2022Voxelmorph++ Going beyond the cranial vault with keypoint supervision and multi-channel instance optimisationcited by 19
- 2023Anatomy-aware and acquisition-agnostic joint registration with SynthMorphcited by 19
- 2021CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translationcited by 15
38 more
- 2023SAMConvex: Fast Discrete Optimization for CT Registration using Self-supervised Anatomical Embedding and Correlation Pyramidcited by 14
- 2021Enhancing Medical Image Registration via Appearance Adjustment Networkscited by 12
- 2021Light-weight Deformable Registration using Adversarial Learning with Distilling Knowledgecited by 12
- 2021Unsupervised Medical Image Alignment with Curriculum Learningcited by 10
- 2022Residual Aligner Networkcited by 10
- 2023SAME++: A Self-supervised Anatomical eMbeddings Enhanced medical image registration framework using stable sampling and regularized transformationcited by 9
- 2022Deep Learning for Medical Image Registration: A Comprehensive Reviewcited by 8
- 2022Deep Feature based Cross-slide Registrationcited by 7
- 2022Recursive Deformable Image Registration Network with Mutual Attentioncited by 7
- 2024RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challengecited by 7
- 2024Semi-Supervised Disease Classification based on Limited Medical Image Datacited by 7
- 2021IGCN: Image-to-graph Convolutional Network for 2D/3D Deformable Registrationcited by 6
- 2024DiffuseReg: Denoising Diffusion Model for Obtaining Deformation Fields in Unsupervised Deformable Image Registrationcited by 6
- 2022Medical image registration using unsupervised deep neural network: A scoping literature reviewcited by 5
- 2024Deep Implicit Optimization enables Robust Learnable Features for Deformable Image Registrationcited by 5
- 2021FlowReg: Fast Deformable Unsupervised Medical Image Registration using Optical Flowcited by 4
- 2021MICS : Multi-steps, Inverse Consistency and Symmetric deep learning registration networkcited by 4
- 20223D Brain and Heart Volume Generative Models: A Surveycited by 4
- 2023Fourier-Net+: Leveraging Band-Limited Representation for Efficient 3D Medical Image Registrationcited by 4
- 2024ModeTv2: GPU-accelerated Motion Decomposition Transformer for Pairwise Optimization in Medical Image Registrationcited by 4
- 2024WiNet: Wavelet-based Incremental Learning for Efficient Medical Image Registrationcited by 4
- 2024Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matchingcited by 4
- 2022Segmentation by Test-Time Optimization (TTO) for CBCT-based Adaptive Radiation Therapycited by 3
- 2022Robust One-shot Segmentation of Brain Tissues via Image-aligned Style Transformationcited by 3
- 2023Preserving Tumor Volumes for Unsupervised Medical Image Registrationcited by 3
- 2024Medical Image Registration and Its Application in Retinal Images: A Reviewcited by 3
- 2025Encoder-Only Image Registrationcited by 3
- 2022InstantGroup: Instant Template Generation for Scalable Group of Brain MRI Registrationcited by 2
- 2023Learning Homeomorphic Image Registration via Conformal-Invariant Hyperelastic Regularisationcited by 2
- 2024LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical Image Registrationcited by 2
- 2025From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Reviewcited by 2
- 2025SACB-Net: Spatial-awareness Convolutions for Medical Image Registrationcited by 2
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Surveycited by 2
- 2022ACSGRegNet: A Deep Learning-based Framework for Unsupervised Joint Affine and Diffeomorphic Registration of Lumbar Spine CT via Cross- and Self-Attention Fusioncited by 1
- 2023Regional Deep Atrophy: a Self-Supervised Learning Method to Automatically Identify Regions Associated With Alzheimer's Disease Progression From Longitudinal MRIcited by 1
- 2023Can a single image processing algorithm work equally well across all phases of DCE-MRI?cited by 1
- 2024Distillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentationcited by 1
- 2025Gaussian Primitive Optimized Deformable Retinal Image Registrationcited by 1
50 most cited of 62 All 62 (JSON)
- 2026Unsupervised Deformable Image Registration with Local-Global Attention and Image Decomposition20 Jan 2026
- 2025MorphSeek: Fine-grained Latent Representation-Level Policy Optimization for Deformable Image Registration21 Nov 2025
- 2025Efficient Large-Deformation Medical Image Registration via Recurrent Dynamic Correlation25 Oct 2025
- 2025A Scalable Distributed Framework for Multimodal GigaVoxel Image Registration29 Sep 2025
- 2025Encoder-Only Image Registration30 Aug 2025
- 2025Gaussian Primitive Optimized Deformable Retinal Image Registration23 Aug 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025Tetrahedron-Net for Medical Image Registration7 May 2025
- 2025SACB-Net: Spatial-awareness Convolutions for Medical Image Registration25 Mar 2025
- 2025From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Review26 Feb 2025
- 2024Cell as Point: One-Stage Framework for Efficient Cell Tracking22 Nov 2024
- 2024Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matching24 Oct 2024
38 more
- 2024DiffuseReg: Denoising Diffusion Model for Obtaining Deformation Fields in Unsupervised Deformable Image Registration7 Oct 2024
- 2024Automatic Registration of SHG and H&E Images with Feature-based Initial Alignment and Intensity-based Instance Optimization: Contribution to the COMULIS Challenge24 Sep 2024
- 2024Deep Learning in Medical Image Registration: Magic or Mirage?11 Aug 2024
- 2024Distillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentation7 Aug 2024
- 2024WiNet: Wavelet-based Incremental Learning for Efficient Medical Image Registration18 Jul 2024
- 2024Deep Implicit Optimization enables Robust Learnable Features for Deformable Image Registration11 Jun 2024
- 2024LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical Image Registration29 May 2024
- 2024Semi-Supervised Disease Classification based on Limited Medical Image Data7 May 2024
- 2024RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challenge19 Apr 2024
- 2024ModeTv2: GPU-accelerated Motion Decomposition Transformer for Pairwise Optimization in Medical Image Registration25 Mar 2024
- 2024Medical Image Registration and Its Application in Retinal Images: A Review25 Mar 2024
- 2023SAME++: A Self-supervised Anatomical eMbeddings Enhanced medical image registration framework using stable sampling and regularized transformation25 Nov 2023
- 2023Preserving Tumor Volumes for Unsupervised Medical Image Registration18 Sep 2023
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond28 Jul 2023
- 2023SAMConvex: Fast Discrete Optimization for CT Registration using Self-supervised Anatomical Embedding and Correlation Pyramid19 Jul 2023
- 2023Unsupervised Segmentation of Fetal Brain MRI using Deep Learning Cascaded Registration7 Jul 2023
- 2023Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration7 Jul 2023
- 2023Fourier-Net+: Leveraging Band-Limited Representation for Efficient 3D Medical Image Registration6 Jul 2023
- 2023Can a single image processing algorithm work equally well across all phases of DCE-MRI?22 Jun 2023
- 2023A Two-Step Deep Learning Method for 3DCT-2DUS Kidney Registration During Breathing23 May 2023
- 2023CDIDN: A Registration Model with High Deformation Impedance Capability for Long-Term Tracking of Pulmonary Lesion Dynamics18 May 2023
- 2023Regional Deep Atrophy: a Self-Supervised Learning Method to Automatically Identify Regions Associated With Alzheimer's Disease Progression From Longitudinal MRI10 Apr 2023
- 2023Learning Homeomorphic Image Registration via Conformal-Invariant Hyperelastic Regularisation14 Mar 2023
- 2023Anatomy-aware and acquisition-agnostic joint registration with SynthMorph26 Jan 2023
- 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review9 Jan 2023
- 2022Robust One-shot Segmentation of Brain Tissues via Image-aligned Style Transformation26 Nov 2022
- 2022InstantGroup: Instant Template Generation for Scalable Group of Brain MRI Registration10 Nov 2022
- 20223D Brain and Heart Volume Generative Models: A Survey12 Oct 2022
- 2022A Hybrid Deep Feature-Based Deformable Image Registration Method for Pathology Images16 Aug 2022
- 2022ACSGRegNet: A Deep Learning-based Framework for Unsupervised Joint Affine and Diffeomorphic Registration of Lumbar Spine CT via Cross- and Self-Attention Fusion4 Aug 2022
- 2022Medical image registration using unsupervised deep neural network: A scoping literature review3 Aug 2022
- 2022Recursive Deformable Image Registration Network with Mutual Attention4 Jun 2022
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives2 Jun 2022
- 2022Deep Learning for Medical Image Registration: A Comprehensive Review24 Apr 2022
- 2022Affine Medical Image Registration with Coarse-to-Fine Vision Transformer29 Mar 2022
- 2022Residual Aligner Network7 Mar 2022
- 2022Voxelmorph++ Going beyond the cranial vault with keypoint supervision and multi-channel instance optimisation28 Feb 2022
- 2022Deep Feature based Cross-slide Registration21 Feb 2022
50 newest of 62 All 62 (JSON)
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Reviewcited by 62
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2022Affine Medical Image Registration with Coarse-to-Fine Vision Transformercited by 35
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusioncited by 22
- 2023Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registrationcited by 21
- 2024Deep Learning in Medical Image Registration: Magic or Mirage?cited by 20
- 2022Voxelmorph++ Going beyond the cranial vault with keypoint supervision and multi-channel instance optimisationcited by 19
- 2023Anatomy-aware and acquisition-agnostic joint registration with SynthMorphcited by 19
- 2021CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translationcited by 15
12 most cited of 61 All 61 (JSON)
- 2026Unsupervised Deformable Image Registration with Local-Global Attention and Image Decomposition20 Jan 2026
- 2025MorphSeek: Fine-grained Latent Representation-Level Policy Optimization for Deformable Image Registration21 Nov 2025
- 2025Efficient Large-Deformation Medical Image Registration via Recurrent Dynamic Correlation25 Oct 2025
- 2025A Scalable Distributed Framework for Multimodal GigaVoxel Image Registration29 Sep 2025
- 2025Encoder-Only Image Registration30 Aug 2025
- 2025Gaussian Primitive Optimized Deformable Retinal Image Registration23 Aug 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025Tetrahedron-Net for Medical Image Registration7 May 2025
- 2025SACB-Net: Spatial-awareness Convolutions for Medical Image Registration25 Mar 2025
- 2025From Traditional to Deep Learning Approaches in Whole Slide Image Registration: A Methodological Review26 Feb 2025
- 2024Cell as Point: One-Stage Framework for Efficient Cell Tracking22 Nov 2024
- 2024Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matching24 Oct 2024
12 newest of 61 All 61 (JSON)