mlsanityData to 7 Oct 2026

Light-weight Deformable Registration using Adversarial Learning with Distilling Knowledge

arXiv 2110.01293 ↗First posted 4 Oct 2021eess.IV cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Deformable registration is a crucial step in many medical procedures such as image-guided surgery and radiation therapy. Most recent learning-based methods focus on improving the accuracy by optimizing the non-linear spatial correspondence between the input images. Therefore, these methods are computationally expensive and require modern graphic cards for real-time deployment. In this paper, we introduce a new Light-weight Deformable Registration network that significantly reduces the computational cost while achieving competitive accuracy. In particular, we propose a new adversarial learning with distilling knowledge algorithm that successfully leverages meaningful information from the effective but expensive teacher network to the student network. We design the student network such as it is light-weight and well suitable for deployment on a typical CPU. The extensively experimental results on different public datasets show that our proposed method achieves state-of-the-art accuracy while significantly faster than recent methods. We further show that the use of our adversarial learning algorithm is essential for a time-efficiency deformable registration method. Finally, our source code and trained models are available at: https://github.com/aioz-ai/LDR_ALDK.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 39 of its 81 references that are in the map. First posted on arXiv 4 Oct 2021.

Builds on

39 of 81 references.

References · 39

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  5. 2017Improved Training of Wasserstein GANscited by 2,223
  6. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  7. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  8. 2019On the Efficacy of Knowledge Distillationcited by 377
  9. 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
  10. 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
  11. 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
  12. 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
27 more
  1. 2019Zero-Shot Knowledge Distillation in Deep Networkscited by 119
  2. 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
  3. 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
  4. 2019Recursive Cascaded Networks for Unsupervised Medical Image Registrationcited by 105
  5. 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
  6. 2017End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Networkcited by 75
  7. 2019Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Networkcited by 62
  8. 2021Multiple Meta-model Quantifying for Medical Visual Question Answeringcited by 54
  9. 2019Networks for Joint Affine and Non-parametric Image Registrationcited by 44
  10. 2020Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillationcited by 38
  11. 2017Label-driven weakly-supervised learning for multimodal deformable image registrationcited by 34
  12. 2019Metric Learning for Image Registrationcited by 30
  13. 2018BIRNet: Brain Image Registration Using Dual-Supervised Fully Convolutional Networkscited by 28
  14. 2019Search to Distill: Pearls are Everywhere but not the Eyescited by 26
  15. 2018Dense 3D Object Reconstruction from a Single Depth Viewcited by 24
  16. 2019Region-specific Diffeomorphic Metric Mappingcited by 24
  17. 2019Unsupervised Deformable Image Registration Using Cycle-Consistent CNNcited by 22
  18. 2021Self-Supervised Generative Adversarial Network for Depth Estimation in Laparoscopic Imagescited by 21
  19. 2020End-to-End Real-time Catheter Segmentation with Optical Flow-Guided Warping during Endovascular Interventioncited by 20
  20. 2018FAIM -- A ConvNet Method for Unsupervised 3D Medical Image Registrationcited by 19
  21. 2020Autonomous Navigation in Complex Environments with Deep Multimodal Fusion Networkcited by 16
  22. 2018Generative Adversarial Networks for MR-CT Deformable Image Registrationcited by 12
  23. 2018Adversarial Deformation Regularization for Training Image Registration Neural Networkscited by 10
  24. 2018Fast and Robust Symmetric Image Registration Based on Distances Combining Intensity and Spatial Informationcited by 7
  25. 2018Object Captioning and Retrieval with Natural Languagecited by 6
  26. 2020MED-TEX: Transferring and Explaining Knowledge with Less Data from Pretrained Medical Imaging Modelscited by 2
  27. 2021Fixing the Teacher-Student Knowledge Discrepancy in Distillationcited by 1

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 4; 2023: 3; 2024: 3.

12 papers.