mlsanityData to 14 Oct 2026

Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging

arXiv 2205.10102 ↗First posted 20 May 2022eess.IV cs.CVcited by 66

Not on the map. Why?

Abstract (arXiv)

In coded aperture snapshot spectral compressive imaging (CASSI) systems, hyperspectral image (HSI) reconstruction methods are employed to recover the spatial-spectral signal from a compressed measurement. Among these algorithms, deep unfolding methods demonstrate promising performance but suffer from two issues. Firstly, they do not estimate the degradation patterns and ill-posedness degree from the highly related CASSI to guide the iterative learning. Secondly, they are mainly CNN-based, showing limitations in capturing long-range dependencies. In this paper, we propose a principled Degradation-Aware Unfolding Framework (DAUF) that estimates parameters from the compressed image and physical mask, and then uses these parameters to control each iteration. Moreover, we customize a novel Half-Shuffle Transformer (HST) that simultaneously captures local contents and non-local dependencies. By plugging HST into DAUF, we establish the first Transformer-based deep unfolding method, Degradation-Aware Unfolding Half-Shuffle Transformer (DAUHST), for HSI reconstruction. Experiments show that DAUHST significantly surpasses state-of-the-art methods while requiring cheaper computational and memory costs. Code and models will be released at https://github.com/caiyuanhao1998/MST

Key facts. Cited by 66 papers in the map (data through 14 Oct 2026). Builds on 52 of its 98 references that are in the map. First posted on arXiv 20 May 2022.

Builds on

52 of 98 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  7. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  8. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  9. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  10. 2021ViViT: A Video Vision Transformercited by 1,620
  11. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  12. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
38 more
  1. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
  2. 2020Pre-Trained Image Processing Transformercited by 893
  3. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  4. 2021Segmenter: Transformer for Semantic Segmentationcited by 855
  5. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  6. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
  7. 2021XCiT: Cross-Covariance Image Transformerscited by 338
  8. 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
  9. 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
  10. 2021Understanding Robustness of Transformers for Image Classificationcited by 249
  11. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 246
  12. 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
  13. 2021You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detectioncited by 170
  14. 2020TransPose: Keypoint Localization via Transformercited by 126
  15. 2021Video Super-Resolution Transformercited by 121
  16. 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
  17. 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
  18. 2021TokenPose: Learning Keypoint Tokens for Human Pose Estimationcited by 107
  19. 2018Rank Minimization for Snapshot Compressive Imagingcited by 99
  20. 2021Pose Recognition with Cascade Transformerscited by 99
  21. 2021U-Net Transformer: Self and Cross Attention for Medical Image Segmentationcited by 81
  22. 2020Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imagingcited by 78
  23. 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
  24. 2022Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstructioncited by 67
  25. 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imagingcited by 66
  26. 2020Learning Delicate Local Representations for Multi-Person Pose Estimationcited by 65
  27. 2021Deep Gaussian Scale Mixture Prior for Spectral Compressive Imagingcited by 58
  28. 2013Coded aperture compressive temporal imagingcited by 57
  29. 2020GAP-net for Snapshot Compressive Imagingcited by 54
  30. 2022Flow-Guided Sparse Transformer for Video Deblurringcited by 43
  31. 2021Plug-and-Play Algorithms for Video Snapshot Compressive Imagingcited by 42
  32. 2021TFPose: Direct Human Pose Estimation with Transformerscited by 42
  33. 2021Self-supervised Neural Networks for Spectral Snapshot Compressive Imagingcited by 35
  34. 2021Test-Time Personalization with a Transformer for Human Pose Estimationcited by 33
  35. 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
  36. 2021HerosNet: Hyperspectral Explicable Reconstruction and Optimal Sampling Deep Network for Snapshot Compressive Imagingcited by 26
  37. 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
  38. 2015Compressive Hyperspectral Imaging with Side Informationcited by 19

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 24; 2024: 13; 2025: 17; 2026: 10.

66 papers.

Sort:

By area:

  1. 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 231
  2. 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 111
  3. 2023Structure-Aware Sparse-View X-ray 3D Reconstructioncited by 72
  4. 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
  5. 2023Binarized Spectral Compressive Imagingcited by 23
  6. 2022Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imagingcited by 22
  7. 2023Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstructioncited by 20
  8. 2023Optimization-Inspired Cross-Attention Transformer for Compressive Sensingcited by 12
  9. 2024Invertible Diffusion Models for Compressed Sensingcited by 12
  10. 2024MIPI 2024 Challenge on Few-shot RAW Image Denoising: Methods and Resultscited by 11
  11. 2023In2SET: Intra-Inter Similarity Exploiting Transformer for Dual-Camera Compressive Hyperspectral Imagingcited by 8
  12. 2023Aperture Diffraction for Compact Snapshot Spectral Imagingcited by 7
38 more
  1. 2024MambaSCI: Efficient Mamba-UNet for Quad-Bayer Patterned Video Snapshot Compressive Imagingcited by 7
  2. 2023Progressive Content-aware Coded Hyperspectral Compressive Imagingcited by 6
  3. 2023Local-Global Transformer Enhanced Unfolding Network for Pan-sharpeningcited by 6
  4. 2023DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Modelcited by 6
  5. 2023MIPI 2023 Challenge on RGBW Remosaic: Methods and Resultscited by 5
  6. 2023Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoisingcited by 5
  7. 2024OTLRM: Orthogonal Learning-based Low-Rank Metric for Multi-Dimensional Inverse Problemscited by 5
  8. 2025Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Designcited by 5
  9. 2023GA-HQS: MRI reconstruction via a generically accelerated unfolding approachcited by 3
  10. 2023Cooperative Hardware-Prompt Learning for Snapshot Compressive Imagingcited by 3
  11. 2023A Simple Adaptive Unfolding Network for Hyperspectral Image Reconstructioncited by 2
  12. 2023SST-ReversibleNet: Reversible-prior-based Spectral-Spatial Transformer for Efficient Hyperspectral Image Reconstructioncited by 2
  13. 2024Dual Hyperspectral Mamba for Efficient Spectral Compressive Imagingcited by 2
  14. 2024Exploiting Frequency Correlation for Hyperspectral Image Reconstructioncited by 2
  15. 2025DLEN: Dual Branch of Transformer for Low-Light Image Enhancement in Dual Domainscited by 2
  16. 2025Mixed-granularity Implicit Representation for Continuous Hyperspectral Compressive Reconstructioncited by 2
  17. 2025Iterative Low-rank Network for Hyperspectral Image Denoisingcited by 2
  18. 2023MSFA-Frequency-Aware Transformer for Hyperspectral Images Demosaicingcited by 1
  19. 2023A Range-Null Space Decomposition Approach for Fast and Flexible Spectral Compressive Imagingcited by 1
  20. 2023MLP-AMDC: An MLP Architecture for Adaptive-Mask-based Dual-Camera snapshot hyperspectral imagingcited by 1
  21. 2024Deep Linear Array Pushbroom Image Restoration: A Degradation Pipeline and Jitter-Aware Restoration Networkcited by 1
  22. 2024Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurfacecited by 1
  23. 2024Filterless Snapshot Hyperspectral Imaging using Guided Patch Diffusioncited by 1
  24. 2025FRN: Fractal-Based Recursive Spectral Reconstruction Networkcited by 1
  25. 2025PCMamba: Physics-Informed Cross-Modal State Space Model for Dual-Camera Compressive Hyperspectral Imagingcited by 1
  26. 2025Spectral Compressive Imaging via Chromaticity-Intensity Decompositioncited by 1
  27. 2025LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imagingcited by 1
  28. 2026Deep LoRA-Unfolding Networks for Image Restorationcited by 1
  29. 2026Light 'em Up: Enabling Few-Shot Low-Light 3D Gaussian Splatting with Multi-Scale Explicit Retinex Illumination Decouplingcited by 1
  30. 2023DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imagingcited by 0
  31. 2023Dual Degradation-Inspired Deep Unfolding Network for Low-Light Image Enhancementcited by 0
  32. 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependencecited by 0
  33. 2023Computational Spectral Imaging with Unified Encoding Model: A Comparative Study and Beyondcited by 0
  34. 2023BSS-Bench: Towards Reproducible and Effective Band Selection Searchcited by 0
  35. 2024Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstructioncited by 0
  36. 2024Adaptive Step-size Perception Unfolding Network with Non-local Hybrid Attention for Hyperspectral Image Reconstructioncited by 0
  37. 2024Self-Supervised One-Step Diffusion Refinement for Snapshot Compressive Imagingcited by 0
  38. 2025Physical Degradation Model-Guided Interferometric Hyperspectral Reconstruction with Unfolding Transformercited by 0

50 most cited of 66 All 66 (JSON)