mlsanityData to 7 Oct 2026

Total-Body Low-Dose CT Image Denoising using Prior Knowledge Transfer Technique with Contrastive Regularization Mechanism

arXiv 2112.00729 ↗First posted 1 Dec 2021eess.IV cs.CV physics.med-phcited by 3

Not on the map. Why?

Abstract (arXiv)

Reducing the radiation exposure for patients in Total-body CT scans has attracted extensive attention in the medical imaging community. Given the fact that low radiation dose may result in increased noise and artifacts, which greatly affected the clinical diagnosis. To obtain high-quality Total-body Low-dose CT (LDCT) images, previous deep-learning-based research work has introduced various network architectures. However, most of these methods only adopt Normal-dose CT (NDCT) images as ground truths to guide the training of the denoising network. Such simple restriction leads the model to less effectiveness and makes the reconstructed images suffer from over-smoothing effects. In this paper, we propose a novel intra-task knowledge transfer method that leverages the distilled knowledge from NDCT images to assist the training process on LDCT images. The derived architecture is referred to as the Teacher-Student Consistency Network (TSC-Net), which consists of the teacher network and the student network with identical architecture. Through the supervision between intermediate features, the student network is encouraged to imitate the teacher network and gain abundant texture details. Moreover, to further exploit the information contained in CT scans, a contrastive regularization mechanism (CRM) built upon contrastive learning is introduced.CRM performs to pull the restored CT images closer to the NDCT samples and push far away from the LDCT samples in the latent space. In addition, based on the attention and deformable convolution mechanism, we design a Dynamic Enhancement Module (DEM) to improve the network transformation capability.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 27 of its 55 references that are in the map. First posted on arXiv 1 Dec 2021.

Builds on

27 of 55 references.

References · 27

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2015Fast R-CNNcited by 2,930
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  8. 2014Conditional Generative Adversarial Netscited by 2,152
  9. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  10. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  11. 2017Deformable Convolutional Networkscited by 1,481
  12. 2019Contrastive Multiview Codingcited by 1,297
15 more
  1. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  2. 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
  3. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 666
  4. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  5. 2019Improved Knowledge Distillation via Teacher Assistantcited by 567
  6. 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
  7. 2017Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)cited by 224
  8. 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
  9. 2016A guide to convolution arithmetic for deep learningcited by 182
  10. 2015Cross Modal Distillation for Supervision Transfercited by 173
  11. 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 161
  12. 2020MAGIC: Manifold and Graph Integrative Convolutional Network for Low-Dose CT Reconstructioncited by 19
  13. 2016Low-dose CT denoising with convolutional neural networkcited by 18
  14. 2019Learning Deformable Kernels for Image and Video Denoisingcited by 18
  15. 2016Adapting Models to Signal Degradation using Distillationcited by 11

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.