Light-weight Deformable Registration using Adversarial Learning with Distilling Knowledge
Not on the map. Why?
Abstract (arXiv)
Deformable registration is a crucial step in many medical procedures such as image-guided surgery and radiation therapy. Most recent learning-based methods focus on improving the accuracy by optimizing the non-linear spatial correspondence between the input images. Therefore, these methods are computationally expensive and require modern graphic cards for real-time deployment. In this paper, we introduce a new Light-weight Deformable Registration network that significantly reduces the computational cost while achieving competitive accuracy. In particular, we propose a new adversarial learning with distilling knowledge algorithm that successfully leverages meaningful information from the effective but expensive teacher network to the student network. We design the student network such as it is light-weight and well suitable for deployment on a typical CPU. The extensively experimental results on different public datasets show that our proposed method achieves state-of-the-art accuracy while significantly faster than recent methods. We further show that the use of our adversarial learning algorithm is essential for a time-efficiency deformable registration method. Finally, our source code and trained models are available at: https://github.com/aioz-ai/LDR_ALDK.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 39 of its 81 references that are in the map. First posted on arXiv 4 Oct 2021.
Builds on
39 of 81 references.
References · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2019On the Efficacy of Knowledge Distillationcited by 377
- 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
- 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
27 more
- 2019Zero-Shot Knowledge Distillation in Deep Networkscited by 119
- 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
- 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
- 2019Recursive Cascaded Networks for Unsupervised Medical Image Registrationcited by 105
- 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
- 2017End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Networkcited by 75
- 2019Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Networkcited by 62
- 2021Multiple Meta-model Quantifying for Medical Visual Question Answeringcited by 54
- 2019Networks for Joint Affine and Non-parametric Image Registrationcited by 44
- 2020Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillationcited by 38
- 2017Label-driven weakly-supervised learning for multimodal deformable image registrationcited by 34
- 2019Metric Learning for Image Registrationcited by 30
- 2018BIRNet: Brain Image Registration Using Dual-Supervised Fully Convolutional Networkscited by 28
- 2019Search to Distill: Pearls are Everywhere but not the Eyescited by 26
- 2018Dense 3D Object Reconstruction from a Single Depth Viewcited by 24
- 2019Region-specific Diffeomorphic Metric Mappingcited by 24
- 2019Unsupervised Deformable Image Registration Using Cycle-Consistent CNNcited by 22
- 2021Self-Supervised Generative Adversarial Network for Depth Estimation in Laparoscopic Imagescited by 21
- 2020End-to-End Real-time Catheter Segmentation with Optical Flow-Guided Warping during Endovascular Interventioncited by 20
- 2018FAIM -- A ConvNet Method for Unsupervised 3D Medical Image Registrationcited by 19
- 2020Autonomous Navigation in Complex Environments with Deep Multimodal Fusion Networkcited by 16
- 2018Generative Adversarial Networks for MR-CT Deformable Image Registrationcited by 12
- 2018Adversarial Deformation Regularization for Training Image Registration Neural Networkscited by 10
- 2018Fast and Robust Symmetric Image Registration Based on Distances Combining Intensity and Spatial Informationcited by 7
- 2018Object Captioning and Retrieval with Natural Languagecited by 6
- 2020MED-TEX: Transferring and Explaining Knowledge with Less Data from Pretrained Medical Imaging Modelscited by 2
- 2021Fixing the Teacher-Student Knowledge Discrepancy in Distillationcited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 3; 2024: 3.
12 papers.
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2021Deep Federated Learning for Autonomous Drivingcited by 54
- 2021Coarse-to-Fine Reasoning for Visual Question Answeringcited by 25
- 2022Self-Supervised Depth Estimation in Laparoscopic Image using 3D Geometric Consistencycited by 19
- 2022Fine-Grained Visual Classification using Self Assessment Classifiercited by 8
- 2022Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentationcited by 7
- 2023Shape-Sensitive Loss for Catheter and Guidewire Segmentationcited by 4
- 2024Autonomous Catheterization with Open-source Simulator and Expert Trajectorycited by 4
- 2024Region Guided Attention Network for Retinal Vessel Segmentationcited by 4
- 2024Medical Image Registration and Its Application in Retinal Images: A Reviewcited by 3
- 2023Translating Simulation Images to X-ray Images via Multi-Scale Semantic Matchingcited by 1
- 2022Scoliosis Detection using Deep Neural Networkcited by 0
- 2024Region Guided Attention Network for Retinal Vessel Segmentation22 Jul 2024
- 2024Medical Image Registration and Its Application in Retinal Images: A Review25 Mar 2024
- 2024Autonomous Catheterization with Open-source Simulator and Expert Trajectory17 Jan 2024
- 2023Shape-Sensitive Loss for Catheter and Guidewire Segmentation19 Nov 2023
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond28 Jul 2023
- 2023Translating Simulation Images to X-ray Images via Multi-Scale Semantic Matching16 Apr 2023
- 2022Scoliosis Detection using Deep Neural Network31 Oct 2022
- 2022Self-Supervised Depth Estimation in Laparoscopic Image using 3D Geometric Consistency17 Aug 2022
- 2022Fine-Grained Visual Classification using Self Assessment Classifier21 May 2022
- 2022Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentation16 Mar 2022
- 2021Deep Federated Learning for Autonomous Driving12 Oct 2021
- 2021Coarse-to-Fine Reasoning for Visual Question Answering6 Oct 2021