mlsanityData to 7 Oct 2026

WiTUnet: A U-Shaped Architecture Integrating CNN and Transformer for Improved Feature Alignment and Local Information Fusion

arXiv 2404.09533 ↗First posted 15 Apr 2024cs.CV cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Low-dose computed tomography (LDCT) has become the technology of choice for diagnostic medical imaging, given its lower radiation dose compared to standard CT, despite increasing image noise and potentially affecting diagnostic accuracy. To address this, advanced deep learning-based LDCT denoising algorithms have been developed, primarily using Convolutional Neural Networks (CNNs) or Transformer Networks with the Unet architecture. This architecture enhances image detail by integrating feature maps from the encoder and decoder via skip connections. However, current methods often overlook enhancements to the Unet architecture itself, focusing instead on optimizing encoder and decoder structures. This approach can be problematic due to the significant differences in feature map characteristics between the encoder and decoder, where simple fusion strategies may not effectively reconstruct images.In this paper, we introduce WiTUnet, a novel LDCT image denoising method that utilizes nested, dense skip pathways instead of traditional skip connections to improve feature integration. WiTUnet also incorporates a windowed Transformer structure to process images in smaller, non-overlapping segments, reducing computational load. Additionally, the integration of a Local Image Perception Enhancement (LiPe) module in both the encoder and decoder replaces the standard multi-layer perceptron (MLP) in Transformers, enhancing local feature capture and representation. Through extensive experimental comparisons, WiTUnet has demonstrated superior performance over existing methods in key metrics such as Peak Signal-to-Noise Ratio (PSNR), Structural Similarity (SSIM), and Root Mean Square Error (RMSE), significantly improving noise removal and image quality.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 15 Apr 2024.

Builds on

23 of 31 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2016Layer Normalizationcited by 5,579
  8. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  9. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  10. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  11. 2018Self-Attention with Relative Position Representationscited by 1,112
  12. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
11 more
  1. 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
  2. 2021Incorporating Convolution Designs into Visual Transformerscited by 248
  3. 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
  4. 2017Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)cited by 224
  5. 2017Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Losscited by 161
  6. 2020Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generationcited by 101
  7. 2020NBNet: Noise Basis Learning for Image Denoising with Subspace Projectioncited by 77
  8. 2021DU-GAN: Generative Adversarial Networks with Dual-Domain U-Net Based Discriminators for Low-Dose CT Denoisingcited by 46
  9. 2022CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoisingcited by 46
  10. 2021TransCT: Dual-path Transformer for Low Dose Computed Tomographycited by 35
  11. 2022Low-Dose CT Denoising via Sinogram Inner-Structure Transformercited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.