ORRN: An ODE-based Recursive Registration Network for Deformable Respiratory Motion Estimation with Lung 4DCT Images
Not on the map. Why?
Abstract (arXiv)
Deformable Image Registration (DIR) plays a significant role in quantifying deformation in medical data. Recent Deep Learning methods have shown promising accuracy and speedup for registering a pair of medical images. However, in 4D (3D + time) medical data, organ motion, such as respiratory motion and heart beating, can not be effectively modeled by pair-wise methods as they were optimized for image pairs but did not consider the organ motion patterns necessary when considering 4D data. This paper presents ORRN, an Ordinary Differential Equations (ODE)-based recursive image registration network. Our network learns to estimate time-varying voxel velocities for an ODE that models deformation in 4D image data. It adopts a recursive registration strategy to progressively estimate a deformation field through ODE integration of voxel velocities. We evaluate the proposed method on two publicly available lung 4DCT datasets, DIRLab and CREATIS, for two tasks: 1) registering all images to the extreme inhale image for 3D+t deformation tracking and 2) registering extreme exhale to inhale phase images. Our method outperforms other learning-based methods in both tasks, producing the smallest Target Registration Error of 1.24mm and 1.26mm, respectively. Additionally, it produces less than 0.001% unrealistic image folding, and the computation speed is less than 1 second for each CT volume. ORRN demonstrates promising registration accuracy, deformation plausibility, and computation efficiency on group-wise and pair-wise registration tasks. It has significant implications in enabling fast and accurate respiratory motion estimation for treatment planning in radiation therapy or robot motion planning in thoracic needle insertion.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
23 of 60 references.
References · 23
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2015Spatial Transformer Networkscited by 1,423
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 176
- 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 146
- 2020What Matters in Unsupervised Optical Flowcited by 124
- 2020Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networkscited by 107
- 2019Recursive Cascaded Networks for Unsupervised Medical Image Registrationcited by 105
- 2019Deep Learning in Medical Image Registration: A Reviewcited by 98
- 2021NODEO: A Neural Ordinary Differential Equation Based Optimization Framework for Deformable Image Registrationcited by 28
- 2020CNN-based Lung CT Registration with Multiple Anatomical Constraintscited by 26
11 more
- 2019mlVIRNET: Multilevel Variational Image Registration Networkcited by 24
- 2019One Shot Learning for Deformable Medical Image Registration and Periodic Motion Trackingcited by 21
- 2021Multi-scale Neural ODEs for 3D Medical Image Registrationcited by 18
- 20193D Convolutional Neural Networks Image Registration Based on Efficient Supervised Learning from Artificial Deformationscited by 13
- 2020GroupRegNet: A Groupwise One-shot Deep Learning-based 4D Image Registration Methodcited by 12
- 2019Recurrent Registration Neural Networks for Deformable Image Registrationcited by 11
- 2020Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomycited by 11
- 2022Recursive Deformable Image Registration Network with Mutual Attentioncited by 7
- 2021Recursive Refinement Network for Deformable Lung Registration between Exhale and Inhale CT Scanscited by 6
- 2021Model-Predictive Control of Blood Suction for Surgical Hemostasis using Differentiable Fluid Simulationscited by 5
- 2021CRANE: a 10 Degree-of-Freedom, Tele-surgical System for Dexterous Manipulation within Imaging Borescited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2024CPT-Interp: Continuous sPatial and Temporal Motion Modeling for 4D Medical Image Interpolationcited by 3
- 2024Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methodscited by 0
- 2024CPT-Interp: Continuous sPatial and Temporal Motion Modeling for 4D Medical Image Interpolation24 May 2024
- 2024Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methods1 May 2024
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond28 Jul 2023