DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data
Not on the map. Why?
Abstract (arXiv)
Conventional RGB cameras suffer from lighting artifacts such as flare, glare, flicker, and overexposure, leading to irrecoverable information loss that necessitates computational restoration. However, existing approaches treat these problems in isolation, failing to recover structural details completely obscured by complex spatially discrete image degradations. In this paper, we propose a novel cross-modal restoration paradigm and present DeLux, a modular proof-of-concept pipeline that leverages neuromorphic event streams as a structural prior to guide the targeted detection and inpainting of lighting artifacts in RGB video. Validation on synthetic benchmarks and real-world automotive footage demonstrates that DeLux effectively suppresses local artifacts and restores affected regions. The proposed approach outperforms existing RGB-only baselines and event-guided HDR models, achieving an average MS-SSIM of over 0.99 across all artifact types and demonstrating up to an 88% reduction in artifact severity in real-world automotive footage. The synthetic artifact generation tools and curated real-world evaluation datasets are made publicly available to foster future research on cross-modal restoration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 60 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
28 of 60 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
- 2019High Speed and High Dynamic Range Video with an Event Cameracited by 345
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
- 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
- 2019Events-to-Video: Bringing Modern Computer Vision to Event Camerascited by 193
- 2017HDR image reconstruction from a single exposure using deep CNNscited by 167
- 2020Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipelinecited by 132
16 more
- 2017Deep High Dynamic Range Imaging with Large Foreground Motionscited by 99
- 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2018ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Contentcited by 89
- 2020Learning Event-Based Motion Deblurringcited by 81
- 2020How to Train Neural Networks for Flare Removalcited by 50
- 2022Multi-Bracket High Dynamic Range Imaging with Event Camerascited by 37
- 2017Learning High Dynamic Range from Outdoor Panoramascited by 34
- 2023Flare7K++: Mixing Synthetic and Real Datasets for Nighttime Flare Removal and Beyondcited by 31
- 2018Image Correction via Deep Reciprocating HDR Transformationcited by 30
- 2023Blind Video Deflickering by Neural Filtering with a Flawed Atlascited by 27
- 2022E-CIR: Event-Enhanced Continuous Intensity Recoverycited by 25
- 2022Emergent Visual Sensors for Autonomous Vehiclescited by 19
- 2024MFDNet: Multi-Frequency Deflare Network for Efficient Nighttime Flare Removalcited by 16
- 2020RGB cameras failures and their effects in autonomous driving applicationscited by 12
- 2024GN-FR:Generalizable Neural Radiance Fields for Flare Removalcited by 2
Built on by
Not cited yet.