mlsanityData to 7 Oct 2026

RawGen: Learning Camera Raw Image Generation

arXiv 2604.00093 ↗First posted 31 Mar 2026cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Cameras capture scene-referred linear raw images, which are processed by onboard image signal processors (ISPs) into display-referred 8-bit sRGB outputs. Although raw data is more faithful for low-level vision tasks, collecting large-scale raw datasets remains a major bottleneck, as existing datasets are limited and tied to specific camera hardware. Generative models offer a promising way to address this scarcity -- however, existing diffusion frameworks are designed to synthesize photo-finished sRGB images rather than physically consistent linear representations. This paper presents RawGen, to our knowledge the first diffusion-based framework enabling text-to-raw generation for arbitrary target cameras, alongside sRGB-to-raw inversion. RawGen leverages the generative priors of large-scale sRGB diffusion models to synthesize physically meaningful linear outputs, such as CIE XYZ or camera-specific raw representations, via specialized processing in latent and pixel spaces. To handle unknown and diverse ISP pipelines and photo-finishing effects in diffusion-model training data, we build a many-to-one inverse-ISP dataset where multiple sRGB renditions of the same scene generated using diverse ISP parameters are anchored to a common scene-referred target. Fine-tuning a conditional denoiser and specialized decoder on this dataset allows RawGen to obtain camera-centric linear reconstructions that effectively invert the rendering pipeline. We demonstrate RawGen's superior performance over traditional inverse-ISP methods that assume a fixed ISP. Furthermore, we show that augmenting training pipelines with RawGen's scalable, text-driven synthetic data can benefit downstream low-level vision tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 58 of its 77 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

58 of 77 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025RDDM: Practicing RAW Domain Diffusion Model for Real-world Image Restoration26 Aug
  2. 2024RAW-Diffusion: RGB-Guided Diffusion Models for High-Fidelity RAW Image Generation20 Nov
  3. 2024Bracket Diffusion: HDR Image Generation by Consistent LDR Denoising23 May
  4. 2023Low-Light Image Enhancement with Wavelet-based Diffusion Models1 Jun
  5. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
  6. 2022Denoising Diffusion Restoration Models27 Jan

Other references · 52

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2022Scalable Diffusion Models with Transformerscited by 5,931
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  8. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  9. 2023Consistency Modelscited by 1,778
  10. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  11. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  12. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  13. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  14. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  15. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  16. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
  17. 2018Unprocessing Images for Learned Raw Denoisingcited by 250
  18. 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 212
  19. 2019Noise Flow: Noise Modeling with Conditional Normalizing Flowscited by 108
  20. 2020Replacing Mobile Camera ISP with a Single Deep Learning Modelcited by 108
  21. 2021Invertible Image Signal Processingcited by 94
  22. 2021Mobile Computational Photography: A Tourcited by 62
  23. 2021Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervisioncited by 43
  24. 2022Model-Based Image Signal Processors via Learnable Dictionariescited by 43
  25. 2020CIE XYZ Net: Unprocessing Images for Low-Level Computer Vision Taskscited by 29
  26. 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesiscited by 26
  27. 2022Day-to-Night Image Synthesis for Training Nighttime Neural ISPscited by 23
  28. 2023ParamISP: Learned Forward and Inverse ISPs using Camera Parameterscited by 23
  29. 2024LEDiff: Latent Exposure Diffusion for HDR Generationcited by 22
  30. 2021Semi-Supervised Raw-to-Raw Mappingcited by 16
  31. 2024Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier Domaincited by 14
  32. 2022MicroISP: Processing 32MP Photos on Mobile Devices with Deep Learningcited by 13
  33. 2024Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPscited by 11
  34. 2013Modeling Radiometric Uncertainty for Vision with Tone-mapped Color Imagescited by 10
  35. 2025Time-Aware Auto White Balance in Mobile Photographycited by 10
  36. 2017Modelling the Scene Dependent Imaging in Cameras with a Deep Neural Networkcited by 8
  37. 2025ReRAW: RGB-to-RAW Image Reconstruction via Stratified Sampling for Efficient Object Detection on the Edgecited by 8
  38. 2025ISPDiffuser: Learning RAW-to-sRGB Mappings with Texture-Aware Diffusion Models and Histogram-Guided Color Consistencycited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RAW-Flow: Advancing RGB-to-RAW Image Reconstruction with Deterministic Latent Flow Matching
  2. 2025DarkDiff: Advancing Low-Light Raw Enhancement by Retasking Diffusion Models for Camera ISP
  3. 2023DiffuseRAW: End-to-End Generative RAW Image Processing for Low-Light Images
  4. 2024Diffusion Models in Low-Level Vision: A Survey
  5. 2026CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control
  6. 2026PixelGen: Improving Pixel Diffusion with Perceptual Supervision
  7. 2025More Than Generation: Unifying Generation and Depth Estimation via Text-to-Image Diffusion Models
  8. 2024From Noise to Nuance: Advances in Deep Generative Image Models