mlsanityData to 14 Oct 2026

Burst Image Super-Resolution via Multi-Cross Attention Encoding and Multi-Scan State-Space Decoding

arXiv 2505.19668 ↗First posted 26 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-image super-resolution (MISR) can achieve higher image quality than single-image super-resolution (SISR) by aggregating sub-pixel information from multiple spatially shifted frames. Among MISR tasks, burst super-resolution (BurstSR) has gained significant attention due to its wide range of applications. Recent methods have increasingly adopted Transformers over convolutional neural networks (CNNs) in super-resolution tasks, due to their superior ability to capture both local and global context. However, most existing approaches still rely on fixed and narrow attention windows that restrict the perception of features beyond the local field. This limitation hampers alignment and feature aggregation, both of which are crucial for high-quality super-resolution. To address these limitations, we propose a novel feature extractor that incorporates two newly designed attention mechanisms: overlapping cross-window attention and cross-frame attention, enabling more precise and efficient extraction of sub-pixel information across multiple frames. Furthermore, we introduce a Multi-scan State-Space Module with the cross-frame attention mechanism to enhance feature aggregation. Extensive experiments on both synthetic and real-world benchmarks demonstrate the superiority of our approach. Additional evaluations on ISO 12233 resolution test charts further confirm its enhanced super-resolution performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

43 of 56 references.

References · 43

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  7. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  8. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  9. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  10. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  11. 2020GLU Variants Improve Transformercited by 1,804
  12. 2017Deformable Convolutional Networkscited by 1,488
31 more
  1. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  2. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  3. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  4. 2024VMamba: Visual State Space Modelcited by 969
  5. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  6. 2020Pre-Trained Image Processing Transformercited by 893
  7. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  8. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  9. 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
  10. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
  11. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
  12. 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
  13. 2021Early Convolutions Help Transformers See Bettercited by 396
  14. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  15. 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
  16. 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 148
  17. 2020Video Super-Resolution with Recurrent Structure-Detail Networkcited by 116
  18. 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 95
  19. 2019Handheld Multi-Frame Super-Resolutioncited by 85
  20. 2021Deep Burst Super-Resolutioncited by 83
  21. 2024SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time seriescited by 82
  22. 2021Burst Image Restoration and Enhancementcited by 64
  23. 2022Glance and Focus Networks for Dynamic Visual Recognitioncited by 41
  24. 2021Deep Reparametrization of Multi-Frame Super-Resolution and Denoisingcited by 39
  25. 2022BSRT: Improving Burst Super-Resolution with Swin Transformer and Flow-Guided Deformable Alignmentcited by 32
  26. 2023Burstormer: Burst Image Restoration and Enhancement Transformercited by 32
  27. 2019DeepSUM: Deep neural network for Super-resolution of Unregistered Multitemporal imagescited by 30
  28. 2021A Systematic Survey of Deep Learning-based Single-Image Super-Resolutioncited by 19
  29. 2019Deep Learning for Multiple-Image Super-Resolutioncited by 15
  30. 2024BurstM: Deep Burst Multi-scale SR using Fourier Space with Optical Flowcited by 7
  31. 2023Exploiting Optical Flow Guidance for Transformer-Based Video Inpaintingcited by 6

Built on by

Not cited yet.