Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesis
Not on the map. Why?
Abstract (arXiv)
Due to the constraints of the imaging device and high cost in operation time, computer tomography (CT) scans are usually acquired with low intra-slice resolution. Improving the intra-slice resolution is beneficial to the disease diagnosis for both human experts and computer-aided systems. To this end, this paper builds a novel medical slice synthesis to increase the between-slice resolution. Considering that the ground-truth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy to accomplish this task in the self-supervised learning manner. Specifically, we model this problem from three different views: slice-wise interpolation from axial view and pixel-wise interpolation from coronal and sagittal views. Under this circumstance, the models learned from different views can distill valuable knowledge to guide the learning processes of each other. We can repeat this process to make the models synthesize intermediate slice data with increasing inter-slice resolution. To demonstrate the effectiveness of the proposed approach, we conduct comprehensive experiments on a large-scale CT dataset. Quantitative and qualitative comparison results show that our method outperforms state-of-the-art algorithms by clear margins.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 20 Dec 2021.
Builds on
29 of 36 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2017Deep Mutual Learningcited by 621
- 2019Improved Knowledge Distillation via Teacher Assistantcited by 567
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
17 more
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
- 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
- 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 180
- 2017Video Frame Interpolation via Adaptive Convolutioncited by 158
- 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
- 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 133
- 2019Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernelscited by 112
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
- 2018CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)cited by 81
- 2018Efficient and Accurate MRI Super-Resolution using a Generative Adversarial Network and 3D Multi-Level Densely Connected Networkcited by 64
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2020SAINT: Spatially Aware Interpolation NeTwork for Medical Slice Synthesiscited by 37
- 2021Learning Frequency-aware Dynamic Network for Efficient Super-Resolutioncited by 36
- 2018Brain MRI super-resolution using 3D generative adversarial networkscited by 15
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 2; 2025: 3.
8 papers.
- 2022Cross-Modality High-Frequency Transformer for MR Image Super-Resolutioncited by 20
- 2024CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Datacited by 15
- 2022Federated Momentum Contrastive Clusteringcited by 6
- 2024I3Net: Inter-Intra-slice Interpolation Network for Medical Slice Synthesiscited by 5
- 2023Understanding Dark Scenes by Contrasting Multi-Modal Observationscited by 4
- 2025Single Image Test-Time Adaptation via Multi-View Co-Trainingcited by 3
- 2025SAGCNet: Spatial-Aware Graph Completion Network for Missing Slice Imputation in Population CMR Imagingcited by 3
- 2025An Anisotropic Cross-View Texture Transfer with Multi-Reference Non-Local Attention for CT Slice Interpolationcited by 2
- 2025An Anisotropic Cross-View Texture Transfer with Multi-Reference Non-Local Attention for CT Slice Interpolation24 Sep 2025
- 2025SAGCNet: Spatial-Aware Graph Completion Network for Missing Slice Imputation in Population CMR Imaging9 Aug 2025
- 2025Single Image Test-Time Adaptation via Multi-View Co-Training30 Jun 2025
- 2024I3Net: Inter-Intra-slice Interpolation Network for Medical Slice Synthesis5 May 2024
- 2024CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Data7 Apr 2024
- 2023Understanding Dark Scenes by Contrasting Multi-Modal Observations23 Aug 2023
- 2022Federated Momentum Contrastive Clustering10 Jun 2022
- 2022Cross-Modality High-Frequency Transformer for MR Image Super-Resolution29 Mar 2022