MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction
On the map: State-space sequence models (S4, Mamba) → Mamba for image restoration
Abstract (arXiv)
In-camera JPEG previews are ubiquitous in raw image formats and provide an sRGB reference at negligible storage cost. Although existing metadata-based reconstruction frameworks can exploit this side information when recovering raw images, their context models often become computationally expensive especially at high resolution, eg, 4K raw image, given that attention mechanisms scale quadratically with feature maps, hindering its practical application. To address these limitations, we propose MambaRaw, a JPEG-conditioned metadata-based raw image reconstruction framework that uses State Space Models (SSMs) to estimate entropy parameters efficiently. Our key contribution comprises a Spatial-Energy Coupled Context Modeling mechanism with two lightweight modules: (1) TileMambaBlock, which performs Mamba-style selective scanning only on information-dense tiles to improve the efficiency; and (2) Energy-Aware Refinement (EAR), an identity-initialized residual module that enhance feature representation to match the long-tail energy distribution of raw signals. Extensive experiments on three camera datasets (Sony, Olympus, Samsung) show consistent improvements over strong metadata-based baselines and set a new state of the art for JPEG-guided raw reconstruction with great efficiency. Notably, at low metadata bitrates, MambaRaw increases PSNR by 1.2--1.4 dB and reduces end-to-end coding latency by about 9%. Code is released at https://github.com/Peizeli1/MambaRaw.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mamba for image restoration, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 38 of its 51 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
38 of 51 references.
Closest ancestors · 3
Same direction, newest first
- 2025Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration27 Mar
- 2024MambaIRv2: Attentive State Space Restoration22 Nov
- 2024RAWMamba: Unified sRGB-to-RAW De-rendering With State Space Model18 Nov
Other references · 35
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2024VMamba: Visual State Space Modelcited by 969
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2016End-to-end Optimized Image Compressioncited by 696
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
23 more
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
- 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 264
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 211
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 202
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 147
- 2021Invertible Image Signal Processingcited by 94
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2020Causal Contextual Prediction for Learned Image Compressioncited by 73
- 20242DMamba: Efficient State Space Model for Image Representation with Applications on Giga-Pixel Whole Slide Image Classificationcited by 35
- 2019Efficient and Effective Context-Based Convolutional Entropy Modeling for Image Compressioncited by 33
- 2022Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadatacited by 22
- 2025MambaIC: State Space Models for High-Performance Learned Image Compressioncited by 20
- 2021Self-Conditioned Probabilistic Learning of Video Rescalingcited by 19
- 2023Raw Image Reconstruction with Learned Compact Metadatacited by 18
- 2022A Coding Framework and Benchmark towards Low-Bitrate Video Understandingcited by 17
- 2024SMC++: Masked Learning of Unsupervised Video Semantic Compressioncited by 12
- 2021A Cross Channel Context Model for Latents in Deep Image Compressioncited by 11
- 2024Free-VSC: Free Semantics from Visual Foundation Models for Unsupervised Video Semantic Compressioncited by 10
- 2023Beyond Learned Metadata-based Raw Image Reconstructioncited by 9
- 2026Scan Clusters, Not Pixels: A Cluster-Centric Paradigm for Efficient Ultra-high-definition Image Restorationcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Progressive Split Mamba: Effective State Space Modelling for Image Restoration
- 2024MambaVC: Learned Visual Compression with Selective State Spaces
- 2025Directing Mamba to Complex Textures: An Efficient Texture-Aware State Space Model for Image Restoration
- 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion
- 2024MambaCSR: Dual-Interleaved Scanning for Compressed Image Super-Resolution With SSMs
- 2024Multi-Scale Representation Learning for Image Restoration with State-Space Model
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration
- 2024MaIR: A Locality- and Continuity-Preserving Mamba for Image Restoration