mlsanityData to 7 Oct 2026

Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

arXiv 2209.01763 ↗First posted 5 Sep 2022eess.IV cs.CR cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this paper, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 61 references that are in the map. First posted on arXiv 5 Sep 2022.

Builds on

19 of 61 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  8. 2016Layer Normalizationcited by 5,579
  9. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  10. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  11. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  12. 2020AMP-Net: Denoising based Deep Unfolding for Compressive Image Sensingcited by 68
7 more
  1. 2014From Denoising to Compressed Sensingcited by 67
  2. 2015A Deep Learning Approach to Structured Signal Recoverycited by 43
  3. 2021ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensingcited by 39
  4. 2017Deep Networks for Compressed Image Sensingcited by 23
  5. 2019Multi-Channel Deep Networks for Block-Based Image Compressive Sensingcited by 22
  6. 2022Content-aware Scalable Deep Compressed Sensingcited by 21
  7. 2021CSformer: Bridging Convolution and Transformer for Compressive Sensingcited by 14

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.