Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration
On the map: State-space sequence models (S4, Mamba) → Mamba for image restoration
Abstract (arXiv)
State-Space Models (SSMs) have attracted considerable attention in Image Restoration (IR) due to their ability to scale linearly sequence length while effectively capturing long-distance dependencies. However, deploying SSMs to edge devices is challenging due to the constraints in memory, computing capacity, and power consumption, underscoring the need for efficient compression strategies. While low-bit quantization is an efficient model compression strategy for reducing size and accelerating IR tasks, SSM suffers substantial performance drops at ultra-low bit-widths (2-4 bits), primarily due to outliers that exacerbate quantization error. To address this challenge, we propose Q-MambaIR, an accurate, efficient, and flexible Quantized Mamba for IR tasks. Specifically, we introduce a Statistical Dynamic-balancing Learnable Scalar (DLS) to dynamically adjust the quantization mapping range, thereby mitigating the peak truncation loss caused by extreme values. Furthermore, we design a Range-floating Flexible Allocator (RFA) with an adaptive threshold to flexibly round values. This approach preserves high-frequency details and maintains the SSM's feature extraction capability. Notably, RFA also enables pre-deployment weight quantization, striking a balance between computational efficiency and model accuracy. Extensive experiments on IR tasks demonstrate that Q-MambaIR consistently outperforms existing quantized SSMs, achieving much higher state-of-the-art (SOTA) accuracy results with only a negligible increase in training computation and storage saving.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Mamba for image restoration, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 31 of its 47 references that are in the map. First posted on arXiv 27 Mar 2025.
Builds on
31 of 47 references.
Closest ancestors · 3
Same direction, newest first
- 2024MaIR: A Locality- and Continuity-Preserving Mamba for Image Restoration28 Dec
- 2024MambaIRv2: Attentive State Space Restoration22 Nov
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Model23 Feb
Other references · 28
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2019Learned Step Size Quantizationcited by 604
- 2021BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstructioncited by 464
- 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 456
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
16 more
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2020LSQ+: Improving low-bit quantization through learnable offsets and better initializationcited by 180
- 2018Densely Connected Pyramid Dehazing Networkcited by 145
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
- 2021Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimationcited by 78
- 2023Towards Accurate Post-Training Quantization for Vision Transformercited by 70
- 2024Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionarycited by 63
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
- 2020PAMS: Quantized Super-Resolution via Parameterized Max Scalecited by 46
- 2022Shift-tolerant Perceptual Similarity Metriccited by 44
- 2020DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networkscited by 29
- 2025MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methodscited by 26
- 2024Quamba: A Post-Training Quantization Recipe for Selective State Space Modelscited by 25
- 2024PTQ4VM: Post-Training Quantization for Visual Mambacited by 9
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancementcited by 17
- 2025PillarMamba: Learning Local-Global Context for Roadside Point Cloud via Hybrid State Space Modelcited by 2
- 2025RoadMamba: A Dual Branch Visual State Space Model for Road Surface Classificationcited by 1
- 2026MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstructioncited by 0
- 2026MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction23 Jun 2026
- 2025RoadMamba: A Dual Branch Visual State Space Model for Road Surface Classification2 Aug 2025
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement18 May 2025
- 2025PillarMamba: Learning Local-Global Context for Roadside Point Cloud via Hybrid State Space Model8 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025Post-Training Quantization for Vision Mamba with k-Scaled Quantization and Reparameterization
- 2025QMamba: Post-Training Quantization for Vision State Space Models
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration
- 2024CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration
- 2026Ternary Mamba: Grouped Quantization-Aware Training of W1.58A16 State Space Models
- 2026Progressive Split Mamba: Effective State Space Modelling for Image Restoration
- 2025MatIR: A Hybrid Mamba-Transformer Image Restoration Model
- 2024Multi-Scale Representation Learning for Image Restoration with State-Space Model