NEC-Diff: Noise-Robust Event-RAW Complementary Diffusion for Seeing Motion in Extreme Darkness
Not on the map. Why?
Abstract (arXiv)
High-quality imaging of dynamic scenes in extremely low-light conditions is highly challenging. Photon scarcity induces severe noise and texture loss, causing significant image degradation. Event cameras, featuring a high dynamic range (120 dB) and high sensitivity to motion, serve as powerful complements to conventional cameras by offering crucial cues for preserving subtle textures. However, most existing approaches emphasize texture recovery from events, while paying little attention to image noise or the intrinsic noise of events themselves, which ultimately hinders accurate pixel reconstruction under photon-starved conditions. In this work, we propose NEC-Diff, a novel diffusion-based event-RAW hybrid imaging framework that extracts reliable information from heavily noisy signals to reconstruct fine scene structures. The framework is driven by two key insights: (1) combining the linear light-response property of RAW images with the brightness-change nature of events to establish a physics-driven constraint for robust dual-modal denoising; and (2) dynamically estimating the SNR of both modalities based on denoising results to guide adaptive feature fusion, thereby injecting reliable cues into the diffusion process for high-fidelity visual reconstruction. Furthermore, we construct the REAL (Raw and Event Acquired in Low-light) dataset which provides 47,800 pixel-aligned low-light RAW images, events, and high-quality references under 0.001-0.8 lux illumination. Extensive experiments demonstrate the superiority of NEC-Diff under extreme darkness. The project are available at: https://github.com/jinghan-xu/NEC-Diff.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
29 of 60 references.
References · 29
- 2019Event-based Vision: A Surveycited by 1,010
- 2018Learning to See in the Darkcited by 459
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
- 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 228
- 2019Events-to-Video: Bringing Modern Computer Vision to Event Camerascited by 191
- 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
- 2020Back to Event Basics: Self-Supervised Learning of Image Reconstruction for Event Cameras via Photometric Constancycited by 125
- 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
- 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
- 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 81
- 2024LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Modelscited by 70
- 2021Rethinking Noise Synthesis and Modeling in Raw Denoisingcited by 62
17 more
- 2024Zero-Reference Low-Light Enhancement via Physical Quadruple Priorscited by 58
- 2024Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approachcited by 48
- 2022Abandoning the Bayer-Filter to See in the Darkcited by 40
- 2022Low-Light Video Enhancement with Synthetic Event Guidancecited by 33
- 2024Seeing Motion at Nighttime with an Event Cameracited by 33
- 2021Towards Low Light Enhancement with RAW Imagescited by 26
- 2024Towards Real-world Event-guided Low-light Video Enhancement and Deblurringcited by 22
- 2023EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Datasetcited by 19
- 2024Binarized Low-light Raw Video Enhancementcited by 17
- 2021Unraveling the paradox of intensity-dependent DVS pixel noisecited by 15
- 2024EvLight++: Low-Light Video Enhancement with an Event Camera: A Large-Scale Real-World Dataset, Novel Method, and Morecited by 13
- 2025Low-Light Image Enhancement using Event-Based Illumination Estimationcited by 12
- 2025Learning to See in the Extremely Darkcited by 11
- 2025Noise Modeling in One Hour: Minimizing Preparation Efforts for Self-supervised Low-Light RAW Image Denoisingcited by 9
- 2024Noise2Image: Noise-Enabled Static Scene Recovery for Event Camerascited by 7
- 2025ERetinex: Event Camera Meets Retinex Theory for Low-Light Image Enhancementcited by 4
- 2025Exploring Fourier Prior and Event Collaboration for Low-Light Image Enhancementcited by 3
Built on by
Not cited yet.