# AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Network

arXiv: https://arxiv.org/abs/2203.11799 · HTML: https://mlsanity.com/paper/2203.11799/

## Key facts

- Cited by 93 papers in the map (data through 14 Oct 2026).
- Builds on 27 of its 47 references that are in the map.
- First posted on arXiv 22 Mar 2022.

## Builds on (most cited first, 27 of 27)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Enhanced Deep Residual Networks for Single Image Super-Resolution](https://mlsanity.com/paper/1707.02921/) (2017)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network](https://mlsanity.com/paper/1609.05158/) (2016)
- [Noise2Noise: Learning Image Restoration without Clean Data](https://mlsanity.com/paper/1803.04189/) (2018)
- [FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising](https://mlsanity.com/paper/1710.04026/) (2017)
- [Noise2Void - Learning Denoising from Single Noisy Images](https://mlsanity.com/paper/1811.10980/) (2018)
- [Noise2Self: Blind Denoising by Self-Supervision](https://mlsanity.com/paper/1901.11365/) (2019)
- [Toward Convolutional Blind Denoising of Real Photographs](https://mlsanity.com/paper/1807.04686/) (2018)
- [MemNet: A Persistent Memory Network for Image Restoration](https://mlsanity.com/paper/1708.02209/) (2017)
- [Benchmarking Denoising Algorithms with Real Photographs](https://mlsanity.com/paper/1707.01313/) (2017)
- [Multi-level Wavelet-CNN for Image Restoration](https://mlsanity.com/paper/1805.07071/) (2018)
- [Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images](https://mlsanity.com/paper/2101.02824/) (2021)
- [High-Quality Self-Supervised Deep Image Denoising](https://mlsanity.com/paper/1901.10277/) (2019)
- [Noisier2Noise: Learning to Denoise from Unpaired Noisy Data](https://mlsanity.com/paper/1910.11908/) (2019)
- [Variational Denoising Network: Toward Blind Noise Modeling and Removal](https://mlsanity.com/paper/1908.11314/) (2019)
- [Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation](https://mlsanity.com/paper/2007.05946/) (2020)
- [Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalization](https://mlsanity.com/paper/2002.11244/) (2020)
- [NBNet: Noise Basis Learning for Image Denoising with Subspace Projection](https://mlsanity.com/paper/2012.15028/) (2020)
- [Unpaired Learning of Deep Image Denoising](https://mlsanity.com/paper/2008.13711/) (2020)
- [Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising](https://mlsanity.com/paper/2010.11971/) (2020)
- [C2N: Practical Generative Noise Modeling for Real-World Denoising](https://mlsanity.com/paper/2202.09533/) (2022)
- [When AWGN-based Denoiser Meets Real Noises](https://mlsanity.com/paper/1904.03485/) (2019)
- [Probabilistic Noise2Void: Unsupervised Content-Aware Denoising](https://mlsanity.com/paper/1906.00651/) (2019)
- [Natural Image Noise Dataset](https://mlsanity.com/paper/1906.00270/) (2019)
- [A Review of an Old Dilemma: Demosaicking First, or Denoising First?](https://mlsanity.com/paper/2004.11577/) (2020)
- [Efficient Blind-Spot Neural Network Architecture for Image Denoising](https://mlsanity.com/paper/2008.11010/) (2020)

## Built on by (most cited first, 30 of 93)

- [STEPS: Joint Self-supervised Nighttime Image Enhancement and Depth Estimation](https://mlsanity.com/paper/2302.01334/) (2023)
- [LG-BPN: Local and Global Blind-Patch Network for Self-Supervised Real-World Denoising](https://mlsanity.com/paper/2304.00534/) (2023)
- [Spatially Adaptive Self-Supervised Learning for Real-World Image Denoising](https://mlsanity.com/paper/2303.14934/) (2023)
- [Random Sub-Samples Generation for Self-Supervised Real Image Denoising](https://mlsanity.com/paper/2307.16825/) (2023)
- [MM-BSN: Self-Supervised Image Denoising for Real-World with Multi-Mask based on Blind-Spot Network](https://mlsanity.com/paper/2304.01598/) (2023)
- [Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branches](https://mlsanity.com/paper/2308.06776/) (2023)
- [Transfer CLIP for Generalizable Image Denoising](https://mlsanity.com/paper/2403.15132/) (2024)
- [Prompt-based Ingredient-Oriented All-in-One Image Restoration](https://mlsanity.com/paper/2309.03063/) (2023)
- [Self-Supervised Image Restoration with Blurry and Noisy Pairs](https://mlsanity.com/paper/2211.07317/) (2022)
- [Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios](https://mlsanity.com/paper/2303.16783/) (2023)
- [Stimulating Diffusion Model for Image Denoising via Adaptive Embedding and Ensembling](https://mlsanity.com/paper/2307.03992/) (2023)
- [Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review](https://mlsanity.com/paper/2308.00247/) (2023)
- [PUCA: Patch-Unshuffle and Channel Attention for Enhanced Self-Supervised Image Denoising](https://mlsanity.com/paper/2310.10088/) (2023)
- [Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising](https://mlsanity.com/paper/2308.04682/) (2023)
- [Self-Supervised Image Denoising for Real-World Images with Context-aware Transformer](https://mlsanity.com/paper/2304.01627/) (2023)
- [Self-supervised Image Denoising with Downsampled Invariance Loss and Conditional Blind-Spot Network](https://mlsanity.com/paper/2304.09507/) (2023)
- [Masked and Shuffled Blind Spot Denoising for Real-World Images](https://mlsanity.com/paper/2404.09389/) (2024)
- [IDF: Iterative Dynamic Filtering Networks for Generalizable Image Denoising](https://mlsanity.com/paper/2508.19649/) (2025)
- [LAN: Learning to Adapt Noise for Image Denoising](https://mlsanity.com/paper/2412.10651/) (2024)
- [Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising](https://mlsanity.com/paper/2404.07846/) (2024)
- [Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration](https://mlsanity.com/paper/2406.18516/) (2024)
- [Speckle2Self: Self-Supervised Ultrasound Speckle Reduction Without Clean Data](https://mlsanity.com/paper/2507.06828/) (2025)
- [Recurrent Self-Supervised Video Denoising with Denser Receptive Field](https://mlsanity.com/paper/2308.03608/) (2023)
- [A Comparison of Image Denoising Methods](https://mlsanity.com/paper/2304.08990/) (2023)
- [Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration](https://mlsanity.com/paper/2408.09241/) (2024)
- [SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams](https://mlsanity.com/paper/2403.09486/) (2024)
- [Asymmetric Mask Scheme for Self-Supervised Real Image Denoising](https://mlsanity.com/paper/2407.06514/) (2024)
- [SpikeGS: 3D Gaussian Splatting from Spike Streams with High-Speed Camera Motion](https://mlsanity.com/paper/2407.10062/) (2024)
- [Positive2Negative: Breaking the Information-Lossy Barrier in Self-Supervised Single Image Denoising](https://mlsanity.com/paper/2412.16460/) (2024)
- [Patch-Craft Self-Supervised Training for Correlated Image Denoising](https://mlsanity.com/paper/2211.09919/) (2022)

## Abstract (arXiv)

Blind-spot network (BSN) and its variants have made significant advances in self-supervised denoising. Nevertheless, they are still bound to synthetic noisy inputs due to less practical assumptions like pixel-wise independent noise. Hence, it is challenging to deal with spatially correlated real-world noise using self-supervised BSN. Recently, pixel-shuffle downsampling (PD) has been proposed to remove the spatial correlation of real-world noise. However, it is not trivial to integrate PD and BSN directly, which prevents the fully self-supervised denoising model on real-world images. We propose an Asymmetric PD (AP) to address this issue, which introduces different PD stride factors for training and inference. We systematically demonstrate that the proposed AP can resolve inherent trade-offs caused by specific PD stride factors and make BSN applicable to practical scenarios. To this end, we develop AP-BSN, a state-of-the-art self-supervised denoising method for real-world sRGB images. We further propose random-replacing refinement, which significantly improves the performance of our AP-BSN without any additional parameters. Extensive studies demonstrate that our method outperforms the other self-supervised and even unpaired denoising methods by a large margin, without using any additional knowledge, e.g., noise level, regarding the underlying unknown noise.