mlsanityData to 7 Oct 2026

Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesis

arXiv 2112.10325 ↗First posted 20 Dec 2021eess.IV cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Due to the constraints of the imaging device and high cost in operation time, computer tomography (CT) scans are usually acquired with low intra-slice resolution. Improving the intra-slice resolution is beneficial to the disease diagnosis for both human experts and computer-aided systems. To this end, this paper builds a novel medical slice synthesis to increase the between-slice resolution. Considering that the ground-truth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy to accomplish this task in the self-supervised learning manner. Specifically, we model this problem from three different views: slice-wise interpolation from axial view and pixel-wise interpolation from coronal and sagittal views. Under this circumstance, the models learned from different views can distill valuable knowledge to guide the learning processes of each other. We can repeat this process to make the models synthesize intermediate slice data with increasing inter-slice resolution. To demonstrate the effectiveness of the proposed approach, we conduct comprehensive experiments on a large-scale CT dataset. Quantitative and qualitative comparison results show that our method outperforms state-of-the-art algorithms by clear margins.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 20 Dec 2021.

Builds on

29 of 36 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  4. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  5. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  6. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  7. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  8. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  9. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  10. 2017Deep Mutual Learningcited by 621
  11. 2019Improved Knowledge Distillation via Teacher Assistantcited by 567
  12. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
17 more
  1. 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
  2. 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
  3. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
  4. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
  5. 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 180
  6. 2017Video Frame Interpolation via Adaptive Convolutioncited by 158
  7. 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
  8. 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 133
  9. 2019Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernelscited by 112
  10. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  11. 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
  12. 2018CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)cited by 81
  13. 2018Efficient and Accurate MRI Super-Resolution using a Generative Adversarial Network and 3D Multi-Level Densely Connected Networkcited by 64
  14. 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
  15. 2020SAINT: Spatially Aware Interpolation NeTwork for Medical Slice Synthesiscited by 37
  16. 2021Learning Frequency-aware Dynamic Network for Efficient Super-Resolutioncited by 36
  17. 2018Brain MRI super-resolution using 3D generative adversarial networkscited by 15

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 1; 2024: 2; 2025: 3.

8 papers.