# Abandoning the Bayer-Filter to See in the Dark

arXiv: https://arxiv.org/abs/2203.04042 · HTML: https://mlsanity.com/paper/2203.04042/

## Key facts

- Cited by 40 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 34 references that are in the map.
- First posted on arXiv 8 Mar 2022.

## Builds on (most cited first, 12 of 12)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Squeeze-and-Excitation Networks](https://mlsanity.com/paper/1709.01507/) (2017)
- [Perceptual Losses for Real-Time Style Transfer and Super-Resolution](https://mlsanity.com/paper/1603.08155/) (2016)
- [Deep Retinex Decomposition for Low-Light Enhancement](https://mlsanity.com/paper/1808.04560/) (2018)
- [Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement](https://mlsanity.com/paper/2001.06826/) (2020)
- [Learning to See in the Dark](https://mlsanity.com/paper/1805.01934/) (2018)
- [Kindling the Darkness: A Practical Low-light Image Enhancer](https://mlsanity.com/paper/1905.04161/) (2019)
- [DeepISP: Towards Learning an End-to-End Image Processing Pipeline](https://mlsanity.com/paper/1801.06724/) (2018)
- [Super-Resolution using Convolutional Neural Networks without Any Checkerboard Artifacts](https://mlsanity.com/paper/1806.02658/) (2018)
- [Neural Camera Simulators](https://mlsanity.com/paper/2104.05237/) (2021)
- [Fixed smooth convolutional layer for avoiding checkerboard artifacts in CNNs](https://mlsanity.com/paper/2002.02117/) (2020)

## Built on by (most cited first, 30 of 40)

- [Low-Light Image Enhancement via Structure Modeling and Guidance](https://mlsanity.com/paper/2305.05839/) (2023)
- [Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancement](https://mlsanity.com/paper/2304.07039/) (2023)
- [Low-Light Image Enhancement with Illumination-Aware Gamma Correction and Complete Image Modelling Network](https://mlsanity.com/paper/2308.08220/) (2023)
- [ExposureDiffusion: Learning to Expose for Low-light Image Enhancement](https://mlsanity.com/paper/2307.07710/) (2023)
- [Fast Context-Based Low-Light Image Enhancement via Neural Implicit Representations](https://mlsanity.com/paper/2407.12511/) (2024)
- [Low-Light Image and Video Enhancement: A Comprehensive Survey and Beyond](https://mlsanity.com/paper/2212.10772/) (2022)
- [LuSh-NeRF: Lighting up and Sharpening NeRFs for Low-light Scenes](https://mlsanity.com/paper/2411.06757/) (2024)
- [Image Demoireing in RAW and sRGB Domains](https://mlsanity.com/paper/2312.09063/) (2023)
- [Color Shift Estimation-and-Correction for Image Enhancement](https://mlsanity.com/paper/2405.17725/) (2024)
- [Brightness Perceiving for Recursive Low-Light Image Enhancement](https://mlsanity.com/paper/2504.02362/) (2025)
- [Super-resolution image display using diffractive decoders](https://mlsanity.com/paper/2206.07281/) (2022)
- [Learning to See in the Extremely Dark](https://mlsanity.com/paper/2506.21132/) (2025)
- [Learning to See Low-Light Images via Feature Domain Adaptation](https://mlsanity.com/paper/2312.06723/) (2023)
- [Unsupervised Image Prior via Prompt Learning and CLIP Semantic Guidance for Low-Light Image Enhancement](https://mlsanity.com/paper/2405.11478/) (2024)
- [Retinex-RAWMamba: Bridging Demosaicing and Denoising for Low-Light RAW Image Enhancement](https://mlsanity.com/paper/2409.07040/) (2024)
- [Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection](https://mlsanity.com/paper/2509.09183/) (2025)
- [Inheriting Bayer's Legacy-Joint Remosaicing and Denoising for Quad Bayer Image Sensor](https://mlsanity.com/paper/2303.13571/) (2023)
- [LDM-ISP: Enhancing Neural ISP for Low Light with Latent Diffusion Models](https://mlsanity.com/paper/2312.01027/) (2023)
- [Alignment-free Raw Video Demoireing](https://mlsanity.com/paper/2408.10679/) (2024)
- [Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification](https://mlsanity.com/paper/2312.07338/) (2023)
- [Leveraging Content and Context Cues for Low-Light Image Enhancement](https://mlsanity.com/paper/2412.07693/) (2024)
- [TS-Diff: Two-Stage Diffusion Model for Low-Light RAW Image Enhancement](https://mlsanity.com/paper/2505.04281/) (2025)
- [Bilevel Generative Learning for Low-Light Vision](https://mlsanity.com/paper/2308.03381/) (2023)
- [DIME-Net: A Dual-Illumination Adaptive Enhancement Network Based on Retinex and Mixture-of-Experts](https://mlsanity.com/paper/2508.13921/) (2025)
- [Learn to See Faster: Pushing the Limits of High-Speed Camera with Deep Underexposed Image Denoising](https://mlsanity.com/paper/2211.16034/) (2022)
- [Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adapter](https://mlsanity.com/paper/2309.09443/) (2023)
- [GMTR: Graph Matching Transformers](https://mlsanity.com/paper/2311.08141/) (2023)
- [Guided Image Restoration via Simultaneous Feature and Image Guided Fusion](https://mlsanity.com/paper/2312.08853/) (2023)
- [DarkShot: Lighting Dark Images with Low-Compute and High-Quality](https://mlsanity.com/paper/2312.16805/) (2023)
- [TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing](https://mlsanity.com/paper/2401.05431/) (2024)

## Abstract (arXiv)

Low-light image enhancement - a pervasive but challenging problem, plays a central role in enhancing the visibility of an image captured in a poor illumination environment. Due to the fact that not all photons can pass the Bayer-Filter on the sensor of the color camera, in this work, we first present a De-Bayer-Filter simulator based on deep neural networks to generate a monochrome raw image from the colored raw image. Next, a fully convolutional network is proposed to achieve the low-light image enhancement by fusing colored raw data with synthesized monochrome raw data. Channel-wise attention is also introduced to the fusion process to establish a complementary interaction between features from colored and monochrome raw images. To train the convolutional networks, we propose a dataset with monochrome and color raw pairs named Mono-Colored Raw paired dataset (MCR) collected by using a monochrome camera without Bayer-Filter and a color camera with Bayer-Filter. The proposed pipeline take advantages of the fusion of the virtual monochrome and the color raw images and our extensive experiments indicate that significant improvement can be achieved by leveraging raw sensor data and data-driven learning.
