RAWMamba: Unified sRGB-to-RAW De-rendering With State Space Model
On the map: State-space sequence models (S4, Mamba) → Mamba for image restoration
Abstract (arXiv)
Recent advancements in sRGB-to-RAW de-rendering have increasingly emphasized metadata-driven approaches to reconstruct RAW data from sRGB images, supplemented by partial RAW information. In image-based de-rendering, metadata is commonly obtained through sampling, whereas in video tasks, it is typically derived from the initial frame. The distinct metadata requirements necessitate specialized network architectures, leading to architectural incompatibilities that increase deployment complexity. In this paper, we propose RAWMamba, a Mamba-based unified framework developed for sRGB-to-RAW de-rendering across both image and video domains. The core of RAWMamba is the Unified Metadata Embedding (UME) module, which harmonizes diverse metadata types into a unified representation. In detail, a multi-perspective affinity modeling method is proposed to promote the extraction of reference information. In addition, we introduce the Local Tone-Aware Mamba (LTA-Mamba) module, which captures long-range dependencies to enable effective global propagation of metadata. Experimental results demonstrate that the proposed RAWMamba achieves state-of-the-art performance, yielding high-quality RAW data reconstruction.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Mamba for image restoration, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 34 of its 56 references that are in the map. First posted on arXiv 18 Nov 2024.
Builds on
34 of 56 references.
Closest ancestors · 1
Same direction, newest first
Other references · 33
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2022A ConvNet for the 2020scited by 3,579
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2024VMamba: Visual State Space Modelcited by 969
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
21 more
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
- 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
- 2020Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipelinecited by 132
- 2021Invertible Image Signal Processingcited by 94
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2024RainMamba: Enhanced Locality Learning with State Space Models for Video Derainingcited by 56
- 2023Instance Segmentation in the Darkcited by 46
- 2022Model-Based Image Signal Processors via Learnable Dictionariescited by 43
- 2023RawHDR: High Dynamic Range Image Reconstruction from a Single Raw Imagecited by 32
- 2021ReconfigISP: Reconfigurable Camera Image Processing Pipelinecited by 30
- 2023ParamISP: Learned Forward and Inverse ISPs using Camera Parameterscited by 23
- 2022Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadatacited by 22
- 2024MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoderscited by 22
- 2022Real-RawVSR: Real-World Raw Video Super-Resolution with a Benchmark Datasetcited by 19
- 2024RAW-Adapter: Adapting Pre-trained Visual Model to Camera RAW Imagescited by 19
- 2021Exploiting Raw Images for Real-Scene Super-Resolutioncited by 12
- 2023Expanding Synthetic Real-World Degradations for Blind Video Super Resolutioncited by 12
- 2023Beyond Learned Metadata-based Raw Image Reconstructioncited by 9
- 2024HilbertMamba: Local-Global Reciprocal Network for Uterine Fibroid Segmentation in Ultrasound Videoscited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Raw Image Reconstruction with Learned Compact Metadata
- 2024ColorMamba: Towards High-quality NIR-to-RGB Spectral Translation with Mamba
- 2026RawGen: Learning Camera Raw Image Generation
- 2026RAW-Flow: Advancing RGB-to-RAW Image Reconstruction with Deterministic Latent Flow Matching
- 2024OPa-Ma: Text Guided Mamba for 360-degree Image Out-painting
- 2026Progressive Split Mamba: Effective State Space Modelling for Image Restoration
- 2025SaMam: Style-aware State Space Model for Arbitrary Image Style Transfer
- 2025Directing Mamba to Complex Textures: An Efficient Texture-Aware State Space Model for Image Restoration