# Spatially Adaptive Self-Supervised Learning for Real-World Image Denoising

arXiv: https://arxiv.org/abs/2303.14934 · HTML: https://mlsanity.com/paper/2303.14934/

## Key facts

- Cited by 33 papers in the map (data through 14 Oct 2026).
- Builds on 44 of its 60 references that are in the map.
- First posted on arXiv 27 Mar 2023.

## Builds on (most cited first, 30 of 44)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [SGDR: Stochastic Gradient Descent with Warm Restarts](https://mlsanity.com/paper/1608.03983/) (2016)
- [Exploring Simple Siamese Representation Learning](https://mlsanity.com/paper/2011.10566/) (2020)
- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [Restormer: Efficient Transformer for High-Resolution Image Restoration](https://mlsanity.com/paper/2111.09881/) (2021)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [Image Super-Resolution Using Very Deep Residual Channel Attention Networks](https://mlsanity.com/paper/1807.02758/) (2018)
- [Uformer: A General U-Shaped Transformer for Image Restoration](https://mlsanity.com/paper/2106.03106/) (2021)
- [Noise2Noise: Learning Image Restoration without Clean Data](https://mlsanity.com/paper/1803.04189/) (2018)
- [FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising](https://mlsanity.com/paper/1710.04026/) (2017)
- [Noise2Void - Learning Denoising from Single Noisy Images](https://mlsanity.com/paper/1811.10980/) (2018)
- [Noise2Self: Blind Denoising by Self-Supervision](https://mlsanity.com/paper/1901.11365/) (2019)
- [Toward Convolutional Blind Denoising of Real Photographs](https://mlsanity.com/paper/1807.04686/) (2018)
- [MemNet: A Persistent Memory Network for Image Restoration](https://mlsanity.com/paper/1708.02209/) (2017)
- [CycleISP: Real Image Restoration via Improved Data Synthesis](https://mlsanity.com/paper/2003.07761/) (2020)
- [Benchmarking Denoising Algorithms with Real Photographs](https://mlsanity.com/paper/1707.01313/) (2017)
- [Multi-level Wavelet-CNN for Image Restoration](https://mlsanity.com/paper/1805.07071/) (2018)
- [Real Image Denoising with Feature Attention](https://mlsanity.com/paper/1904.07396/) (2019)
- [Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images](https://mlsanity.com/paper/2101.02824/) (2021)
- [High-Quality Self-Supervised Deep Image Denoising](https://mlsanity.com/paper/1901.10277/) (2019)
- [Non-Local Recurrent Network for Image Restoration](https://mlsanity.com/paper/1806.02919/) (2018)
- [A Physics-based Noise Formation Model for Extreme Low-light Raw Denoising](https://mlsanity.com/paper/2003.12751/) (2020)
- [Noisier2Noise: Learning to Denoise from Unpaired Noisy Data](https://mlsanity.com/paper/1910.11908/) (2019)
- [Variational Denoising Network: Toward Blind Noise Modeling and Removal](https://mlsanity.com/paper/1908.11314/) (2019)
- [Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean Images](https://mlsanity.com/paper/2106.07009/) (2021)
- [Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation](https://mlsanity.com/paper/2007.05946/) (2020)
- [AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Network](https://mlsanity.com/paper/2203.11799/) (2022)
- [Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalization](https://mlsanity.com/paper/2002.11244/) (2020)

## Built on by (most cited first, 30 of 33)

- [Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios](https://mlsanity.com/paper/2303.16783/) (2023)
- [Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review](https://mlsanity.com/paper/2308.00247/) (2023)
- [UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity](https://mlsanity.com/paper/2412.20157/) (2024)
- [Masked and Shuffled Blind Spot Denoising for Real-World Images](https://mlsanity.com/paper/2404.09389/) (2024)
- [Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising](https://mlsanity.com/paper/2404.07846/) (2024)
- [A Comparison of Image Denoising Methods](https://mlsanity.com/paper/2304.08990/) (2023)
- [Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration](https://mlsanity.com/paper/2408.09241/) (2024)
- [Asymmetric Mask Scheme for Self-Supervised Real Image Denoising](https://mlsanity.com/paper/2407.06514/) (2024)
- [SpikeGS: 3D Gaussian Splatting from Spike Streams with High-Speed Camera Motion](https://mlsanity.com/paper/2407.10062/) (2024)
- [Positive2Negative: Breaking the Information-Lossy Barrier in Self-Supervised Single Image Denoising](https://mlsanity.com/paper/2412.16460/) (2024)
- [RBSR: Efficient and Flexible Recurrent Network for Burst Super-Resolution](https://mlsanity.com/paper/2306.17595/) (2023)
- [RaFE: Generative Radiance Fields Restoration](https://mlsanity.com/paper/2404.03654/) (2024)
- [NIR-Assisted Image Denoising: A Selective Fusion Approach and A Real-World Benchmark Dataset](https://mlsanity.com/paper/2404.08514/) (2024)
- [Image Denoising Using Green Channel Prior](https://mlsanity.com/paper/2408.05923/) (2024)
- [Learning to Translate Noise for Robust Image Denoising](https://mlsanity.com/paper/2412.04727/) (2024)
- [Masked Pre-training Enables Universal Zero-shot Denoiser](https://mlsanity.com/paper/2401.14966/) (2024)
- [DiffDenoise: Self-Supervised Medical Image Denoising with Conditional Diffusion Models](https://mlsanity.com/paper/2504.00264/) (2025)
- [PQDynamicISP: Dynamically Controlled Image Signal Processor for Any Image Sensors Pursuing Perceptual Quality](https://mlsanity.com/paper/2403.10091/) (2024)
- [Blind-Spot Guided Diffusion for Self-supervised Real-World Denoising](https://mlsanity.com/paper/2509.16091/) (2025)
- [Color Image Denoising Using The Green Channel Prior](https://mlsanity.com/paper/2402.08235/) (2024)
- [Unsupervised Real-World Denoising: Sparsity is All You Need](https://mlsanity.com/paper/2503.21377/) (2025)
- [Next-Scale Prediction: A Self-Supervised Approach for Real-World Image Denoising](https://mlsanity.com/paper/2512.21038/) (2025)
- [Non-Uniform Exposure Imaging via Neuromorphic Shutter Control](https://mlsanity.com/paper/2404.13972/) (2024)
- [Fast Unsupervised Tensor Restoration via Low-rank Deconvolution](https://mlsanity.com/paper/2406.10679/) (2024)
- [CDI: Blind Image Restoration Fidelity Evaluation based on Consistency with Degraded Image](https://mlsanity.com/paper/2501.14264/) (2025)
- [Efficient Image Denoising Using Global and Local Circulant Representation](https://mlsanity.com/paper/2508.10307/) (2025)
- [CARD: Correlation Aware Restoration with Diffusion](https://mlsanity.com/paper/2512.05268/) (2025)
- [Image Denoising Using Global and Local Circulant Representation](https://mlsanity.com/paper/2512.23569/) (2025)
- [Face Normal Estimation from Rags to Riches](https://mlsanity.com/paper/2601.01950/) (2026)
- [TM-BSN: Triangular-Masked Blind-Spot Network for Real-World Self-Supervised Image Denoising](https://mlsanity.com/paper/2604.04484/) (2026)

## Abstract (arXiv)

Significant progress has been made in self-supervised image denoising (SSID) in the recent few years. However, most methods focus on dealing with spatially independent noise, and they have little practicality on real-world sRGB images with spatially correlated noise. Although pixel-shuffle downsampling has been suggested for breaking the noise correlation, it breaks the original information of images, which limits the denoising performance. In this paper, we propose a novel perspective to solve this problem, i.e., seeking for spatially adaptive supervision for real-world sRGB image denoising. Specifically, we take into account the respective characteristics of flat and textured regions in noisy images, and construct supervisions for them separately. For flat areas, the supervision can be safely derived from non-adjacent pixels, which are much far from the current pixel for excluding the influence of the noise-correlated ones. And we extend the blind-spot network to a blind-neighborhood network (BNN) for providing supervision on flat areas. For textured regions, the supervision has to be closely related to the content of adjacent pixels. And we present a locally aware network (LAN) to meet the requirement, while LAN itself is selectively supervised with the output of BNN. Combining these two supervisions, a denoising network (e.g., U-Net) can be well-trained. Extensive experiments show that our method performs favorably against state-of-the-art SSID methods on real-world sRGB photographs. The code is available at https://github.com/nagejacob/SpatiallyAdaptiveSSID.