RawGen: Learning Camera Raw Image Generation
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Cameras capture scene-referred linear raw images, which are processed by onboard image signal processors (ISPs) into display-referred 8-bit sRGB outputs. Although raw data is more faithful for low-level vision tasks, collecting large-scale raw datasets remains a major bottleneck, as existing datasets are limited and tied to specific camera hardware. Generative models offer a promising way to address this scarcity -- however, existing diffusion frameworks are designed to synthesize photo-finished sRGB images rather than physically consistent linear representations. This paper presents RawGen, to our knowledge the first diffusion-based framework enabling text-to-raw generation for arbitrary target cameras, alongside sRGB-to-raw inversion. RawGen leverages the generative priors of large-scale sRGB diffusion models to synthesize physically meaningful linear outputs, such as CIE XYZ or camera-specific raw representations, via specialized processing in latent and pixel spaces. To handle unknown and diverse ISP pipelines and photo-finishing effects in diffusion-model training data, we build a many-to-one inverse-ISP dataset where multiple sRGB renditions of the same scene generated using diverse ISP parameters are anchored to a common scene-referred target. Fine-tuning a conditional denoiser and specialized decoder on this dataset allows RawGen to obtain camera-centric linear reconstructions that effectively invert the rendering pipeline. We demonstrate RawGen's superior performance over traditional inverse-ISP methods that assume a fixed ISP. Furthermore, we show that augmenting training pipelines with RawGen's scalable, text-driven synthetic data can benefit downstream low-level vision tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 58 of its 77 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
58 of 77 references.
Closest ancestors · 6
Same direction, newest first
- 2025RDDM: Practicing RAW Domain Diffusion Model for Real-world Image Restoration26 Aug
- 2024RAW-Diffusion: RGB-Guided Diffusion Models for High-Fidelity RAW Image Generation20 Nov
- 2024Bracket Diffusion: HDR Image Generation by Consistent LDR Denoising23 May
- 2023Low-Light Image Enhancement with Wavelet-based Diffusion Models1 Jun
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
- 2022Denoising Diffusion Restoration Models27 Jan
Other references · 52
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2023Consistency Modelscited by 1,778
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
- 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 212
- 2019Noise Flow: Noise Modeling with Conditional Normalizing Flowscited by 108
- 2020Replacing Mobile Camera ISP with a Single Deep Learning Modelcited by 108
- 2021Invertible Image Signal Processingcited by 94
- 2021Mobile Computational Photography: A Tourcited by 62
- 2021Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervisioncited by 43
- 2022Model-Based Image Signal Processors via Learnable Dictionariescited by 43
- 2020CIE XYZ Net: Unprocessing Images for Low-Level Computer Vision Taskscited by 29
- 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesiscited by 26
- 2022Day-to-Night Image Synthesis for Training Nighttime Neural ISPscited by 23
- 2023ParamISP: Learned Forward and Inverse ISPs using Camera Parameterscited by 23
- 2024LEDiff: Latent Exposure Diffusion for HDR Generationcited by 22
- 2021Semi-Supervised Raw-to-Raw Mappingcited by 16
- 2024Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier Domaincited by 14
- 2022MicroISP: Processing 32MP Photos on Mobile Devices with Deep Learningcited by 13
- 2024Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPscited by 11
- 2013Modeling Radiometric Uncertainty for Vision with Tone-mapped Color Imagescited by 10
- 2025Time-Aware Auto White Balance in Mobile Photographycited by 10
- 2017Modelling the Scene Dependent Imaging in Cameras with a Deep Neural Networkcited by 8
- 2025ReRAW: RGB-to-RAW Image Reconstruction via Stratified Sampling for Efficient Object Detection on the Edgecited by 8
- 2025ISPDiffuser: Learning RAW-to-sRGB Mappings with Texture-Aware Diffusion Models and Histogram-Guided Color Consistencycited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RAW-Flow: Advancing RGB-to-RAW Image Reconstruction with Deterministic Latent Flow Matching
- 2025DarkDiff: Advancing Low-Light Raw Enhancement by Retasking Diffusion Models for Camera ISP
- 2023DiffuseRAW: End-to-End Generative RAW Image Processing for Low-Light Images
- 2024Diffusion Models in Low-Level Vision: A Survey
- 2026CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control
- 2026PixelGen: Improving Pixel Diffusion with Perceptual Supervision
- 2025More Than Generation: Unifying Generation and Depth Estimation via Text-to-Image Diffusion Models
- 2024From Noise to Nuance: Advances in Deep Generative Image Models