# Learning Raw Image Denoising with Bayer Pattern Unification and Bayer Preserving Augmentation

arXiv: https://arxiv.org/abs/1904.12945 · HTML: https://mlsanity.com/paper/1904.12945/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 29 Apr 2019.

## Built on by (most cited first, 30 of 30)

- [A survey of synthetic data augmentation methods in computer vision](https://mlsanity.com/paper/2403.10075/) (2024)
- [Unidirectional Video Denoising by Mimicking Backward Recurrent Modules with Look-ahead Forward Ones](https://mlsanity.com/paper/2204.05532/) (2022)
- [Learnability Enhancement for Low-light Raw Denoising: Where Paired Real Data Meets Noise Modeling](https://mlsanity.com/paper/2207.06103/) (2022)
- [NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Results](https://mlsanity.com/paper/2106.03839/) (2021)
- [Real-RawVSR: Real-World Raw Video Super-Resolution with a Benchmark Dataset](https://mlsanity.com/paper/2209.12475/) (2022)
- [Efficient Visual Computing with Camera RAW Snapshots](https://mlsanity.com/paper/2212.07778/) (2022)
- [NTIRE 2025 Challenge on Efficient Burst HDR and Restoration: Datasets, Methods, and Results](https://mlsanity.com/paper/2505.12089/) (2025)
- [Recaptured Raw Screen Image and Video Demoir'eing via Channel and Spatial Modulations](https://mlsanity.com/paper/2310.20332/) (2023)
- [BSRAW: Improving Blind RAW Image Super-Resolution](https://mlsanity.com/paper/2312.15487/) (2023)
- [NTIRE 2025 Challenge on RAW Image Restoration and Super-Resolution](https://mlsanity.com/paper/2506.02197/) (2025)
- [RViDeformer: Efficient Raw Video Denoising Transformer with a Larger Benchmark Dataset](https://mlsanity.com/paper/2305.00767/) (2023)
- [Toward Efficient Deep Blind RAW Image Restoration](https://mlsanity.com/paper/2409.18204/) (2024)
- [Deep RAW Image Super-Resolution. A NTIRE 2024 Challenge Survey](https://mlsanity.com/paper/2404.16223/) (2024)
- [Joint Demosaicking and Denoising in the Wild: The Case of Training Under Ground Truth Uncertainty](https://mlsanity.com/paper/2101.04442/) (2021)
- [ELMformer: Efficient Raw Image Restoration with a Locally Multiplicative Transformer](https://mlsanity.com/paper/2208.14704/) (2022)
- [Inheriting Bayer's Legacy-Joint Remosaicing and Denoising for Quad Bayer Image Sensor](https://mlsanity.com/paper/2303.13571/) (2023)
- [YOND: Practical Blind Raw Image Denoising Free from Camera-Specific Data Dependency](https://mlsanity.com/paper/2506.03645/) (2025)
- [MIPI 2022 Challenge on RGBW Sensor Fusion: Dataset and Report](https://mlsanity.com/paper/2209.07530/) (2022)
- [MIPI 2023 Challenge on RGBW Fusion: Methods and Results](https://mlsanity.com/paper/2304.10089/) (2023)
- [DSDNet: Raw Domain Demoir'eing via Dual Color-Space Synergy](https://mlsanity.com/paper/2504.15756/) (2025)
- [Feature-Align Network with Knowledge Distillation for Efficient Denoising](https://mlsanity.com/paper/2103.01524/) (2021)
- [Improving Bracket Image Restoration and Enhancement with Flow-guided Alignment and Enhanced Feature Aggregation](https://mlsanity.com/paper/2404.10358/) (2024)
- [ISP meets Deep Learning: A Survey on Deep Learning Methods for Image Signal Processing](https://mlsanity.com/paper/2305.11994/) (2023)
- [A Sub-band Approach to Deep Denoising Wavelet Networks and a Frequency-adaptive Loss for Perceptual Quality](https://mlsanity.com/paper/2102.07973/) (2021)
- [Towards Real-World Video Denosing: A Practical Video Denosing Dataset and Network](https://mlsanity.com/paper/2207.01356/) (2022)
- [Learning deep illumination-robust features from multispectral filter array images](https://mlsanity.com/paper/2407.15472/) (2024)
- [Combining Pre- and Post-Demosaicking Noise Removal for RAW Video](https://mlsanity.com/paper/2410.02572/) (2024)
- [R3: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domain](https://mlsanity.com/paper/2509.24022/) (2025)
- [Making the Discrete Continuous: Synthetic RAW Augmentations for Fine-Grained Evaluation of Person Detection Performance in Low Light](https://mlsanity.com/paper/2605.22455/) (2026)
- [Bricker to BRACE: A Bracket Exposure RAW Dataset and Restoration Model for Flicker-Banding](https://mlsanity.com/paper/2606.29845/) (2026)

## Abstract (arXiv)

In this paper, we present new data pre-processing and augmentation techniques for DNN-based raw image denoising. Compared with traditional RGB image denoising, performing this task on direct camera sensor readings presents new challenges such as how to effectively handle various Bayer patterns from different data sources, and subsequently how to perform valid data augmentation with raw images. To address the first problem, we propose a Bayer pattern unification (BayerUnify) method to unify different Bayer patterns. This allows us to fully utilize a heterogeneous dataset to train a single denoising model instead of training one model for each pattern. Furthermore, while it is essential to augment the dataset to improve model generalization and performance, we discovered that it is error-prone to modify raw images by adapting augmentation methods designed for RGB images. Towards this end, we present a Bayer preserving augmentation (BayerAug) method as an effective approach for raw image augmentation. Combining these data processing technqiues with a modified U-Net, our method achieves a PSNR of 52.11 and a SSIM of 0.9969 in NTIRE 2019 Real Image Denoising Challenge, demonstrating the state-of-the-art performance. Our code is available at https://github.com/Jiaming-Liu/BayerUnifyAug.
