mlsanityData to 7 Oct 2026

Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration

arXiv 2503.21970 ↗First posted 27 Mar 2025cs.CVcited by 4

On the map: State-space sequence models (S4, Mamba) → Mamba for image restoration

Abstract (arXiv)

State-Space Models (SSMs) have attracted considerable attention in Image Restoration (IR) due to their ability to scale linearly sequence length while effectively capturing long-distance dependencies. However, deploying SSMs to edge devices is challenging due to the constraints in memory, computing capacity, and power consumption, underscoring the need for efficient compression strategies. While low-bit quantization is an efficient model compression strategy for reducing size and accelerating IR tasks, SSM suffers substantial performance drops at ultra-low bit-widths (2-4 bits), primarily due to outliers that exacerbate quantization error. To address this challenge, we propose Q-MambaIR, an accurate, efficient, and flexible Quantized Mamba for IR tasks. Specifically, we introduce a Statistical Dynamic-balancing Learnable Scalar (DLS) to dynamically adjust the quantization mapping range, thereby mitigating the peak truncation loss caused by extreme values. Furthermore, we design a Range-floating Flexible Allocator (RFA) with an adaptive threshold to flexibly round values. This approach preserves high-frequency details and maintains the SSM's feature extraction capability. Notably, RFA also enables pre-deployment weight quantization, striking a balance between computational efficiency and model accuracy. Extensive experiments on IR tasks demonstrate that Q-MambaIR consistently outperforms existing quantized SSMs, achieving much higher state-of-the-art (SOTA) accuracy results with only a negligible increase in training computation and storage saving.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Mamba for image restoration, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 31 of its 47 references that are in the map. First posted on arXiv 27 Mar 2025.

Builds on

31 of 47 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024MaIR: A Locality- and Continuity-Preserving Mamba for Image Restoration28 Dec
  2. 2024MambaIRv2: Attentive State Space Restoration22 Nov
  3. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Model23 Feb

Other references · 28

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  4. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  5. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  6. 2021Multi-Stage Progressive Image Restorationcited by 813
  7. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  8. 2019Learned Step Size Quantizationcited by 604
  9. 2021BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstructioncited by 464
  10. 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 456
  11. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  12. 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
16 more
  1. 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
  2. 2020LSQ+: Improving low-bit quantization through learnable offsets and better initializationcited by 180
  3. 2018Densely Connected Pyramid Dehazing Networkcited by 145
  4. 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
  5. 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
  6. 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
  7. 2021Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimationcited by 78
  8. 2023Towards Accurate Post-Training Quantization for Vision Transformercited by 70
  9. 2024Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionarycited by 63
  10. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  11. 2020PAMS: Quantized Super-Resolution via Parameterized Max Scalecited by 46
  12. 2022Shift-tolerant Perceptual Similarity Metriccited by 44
  13. 2020DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networkscited by 29
  14. 2025MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methodscited by 26
  15. 2024Quamba: A Post-Training Quantization Recipe for Selective State Space Modelscited by 25
  16. 2024PTQ4VM: Post-Training Quantization for Visual Mambacited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Post-Training Quantization for Vision Mamba with k-Scaled Quantization and Reparameterization
  2. 2025QMamba: Post-Training Quantization for Vision State Space Models
  3. 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration
  4. 2024CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration
  5. 2026Ternary Mamba: Grouped Quantization-Aware Training of W1.58A16 State Space Models
  6. 2026Progressive Split Mamba: Effective State Space Modelling for Image Restoration
  7. 2025MatIR: A Hybrid Mamba-Transformer Image Restoration Model
  8. 2024Multi-Scale Representation Learning for Image Restoration with State-Space Model