Diffusion-Based sRGB Real Noise Generation via Prompt-Driven Noise Representation Learning
Not on the map. Why?
Abstract (arXiv)
Denoising in the sRGB image space is challenging due to large noise variability. Although end-to-end methods perform well, their effectiveness in real-world scenarios is limited by the scarcity of real noisy-clean image pairs, which are expensive and difficult to collect. To address this limitation, several generative methods have been developed to synthesize realistic noisy images from limited data. These approaches often rely on camera metadata during both training and testing to synthesize real-world noise. However, the lack of metadata or inconsistencies between devices restricts their usability. Therefore, we propose a novel framework called Prompt-Driven Noise Generation (PNG). This model is capable of acquiring high-dimensional prompt features that capture the characteristics of real-world input noise and creating a variety of realistic noisy images consistent with the distribution of the input noise. By eliminating the dependency on explicit camera metadata, our approach significantly enhances the generalizability and applicability of noise synthesis. Comprehensive experiments reveal that our model effectively produces realistic noisy images and show the successful application of these generated images in removing real-world noise across various benchmark datasets.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 64 of its 78 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
64 of 78 references.
References · 64
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
38 more
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2023Consistency Modelscited by 1,778
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2021Variational Diffusion Modelscited by 1,145
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
- 2022Simple Baselines for Image Restorationcited by 701
- 2023Improved Techniques for Training Consistency Modelscited by 430
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 396
- 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 359
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 212
- 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
- 2019Noise Flow: Noise Modeling with Conditional Normalizing Flowscited by 108
- 2020Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generationcited by 101
- 2022AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Networkcited by 92
- 2018Real-world Noisy Image Denoising: A New Benchmarkcited by 74
- 2017Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networkscited by 58
- 2022C2N: Practical Generative Noise Modeling for Real-World Denoisingcited by 56
- 2020NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Resultscited by 51
- 2023Prompt-In-Prompt Learning for Universal Image Restorationcited by 43
- 2023LG-BPN: Local and Global Blind-Patch Network for Self-Supervised Real-World Denoisingcited by 37
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.