LightsOut: Diffusion-based Outpainting for Enhanced Lens Flare Removal
Not on the map. Why?
Abstract (arXiv)
Lens flare significantly degrades image quality, impacting critical computer vision tasks like object detection and autonomous driving. Recent Single Image Flare Removal (SIFR) methods perform poorly when off-frame light sources are incomplete or absent. We propose LightsOut, a diffusion-based outpainting framework tailored to enhance SIFR by reconstructing off-frame light sources. Our method leverages a multitask regression module and LoRA fine-tuned diffusion model to ensure realistic and physically consistent outpainting results. Comprehensive experiments demonstrate LightsOut consistently boosts the performance of existing SIFR methods across challenging scenarios without additional retraining, serving as a universally applicable plug-and-play preprocessing solution. Project page: https://ray-1026.github.io/lightsout/
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 63 of its 88 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
63 of 88 references.
References · 63
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
38 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023Controlling Text-to-Image Diffusion by Orthogonal Finetuningcited by 207
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
- 2018Auxiliary Tasks in Multi-task Learningcited by 106
- 2018Single Image Reflection Separation with Perceptual Lossescited by 98
- 2022LEDNet: Joint Low-light Enhancement and Deblurring in the Darkcited by 95
- 2019Foreground-aware Image Inpaintingcited by 90
- 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
- 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 58
- 2019Very Long Natural Scenery Image Prediction by Outpaintingcited by 50
- 2020How to Train Neural Networks for Flare Removalcited by 50
- 2022Flare7K: A Phenomenological Nighttime Flare Removal Datasetcited by 49
- 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generationcited by 45
- 2023Designing a Better Asymmetric VQGAN for StableDiffusioncited by 45
- 2020SESAME: Semantic Editing of Scenes by Adding, Manipulating or Erasing Objectscited by 43
- 2022SinDiffusion: Learning a Diffusion Model from a Single Natural Imagecited by 42
- 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Modelscited by 33
- 2023Flare7K++: Mixing Synthetic and Real Datasets for Nighttime Flare Removal and Beyondcited by 31
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusioncited by 7
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
- 2025Generative Refocusing: Flexible Defocus Control from a Single Imagecited by 3
- 2025Learning Latent Transmission and Glare Maps for Lens Veiling Glare Removalcited by 2
- 2026M3DDM+: An improved video outpainting by a modified masking strategycited by 2
- 2026HDR Reconstruction Boosting with Training-Free and Exposure-Consistent Diffusioncited by 0
- 2026Reflection Separation from a Single Image via Joint Latent Diffusioncited by 0
- 2026High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Controlcited by 0
- 2026Lens Flare Removal and Reconstructioncited by 0
- 2026Lens Flare Removal and Reconstruction30 Sep 2026
- 2026High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Control7 Jul 2026
- 2026Reflection Separation from a Single Image via Joint Latent Diffusion2 Jun 2026
- 2026HDR Reconstruction Boosting with Training-Free and Exposure-Consistent Diffusion23 Feb 2026
- 2026M3DDM+: An improved video outpainting by a modified masking strategy16 Jan 2026
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion29 Dec 2025
- 2025Generative Refocusing: Flexible Defocus Control from a Single Image18 Dec 2025
- 2025Learning Latent Transmission and Glare Maps for Lens Veiling Glare Removal21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Physics-Informed Video Flare Synthesis and Removal Leveraging Motion Independence between Flare and Scene
- 2024Difflare: Removing Image Lens Flare with Latent Diffusion Model
- 2025DeflareMamba: Hierarchical Vision Mamba for Contextually Consistent Lens Flare Removal
- 2026Breaking Spatial Uniformity: Prior-Guided Mamba with Radial Serialization for Lens Flare Removal
- 2025DiffusionLight-Turbo: Accelerated Light Probes for Free via Single-Pass Chrome Ball Inpainting
- 2025Structure-Guided Diffusion Models for High-Fidelity Portrait Shadow Removal
- 2024Diff-Shadow: Global-guided Diffusion Model for Shadow Removal
- 2025Learning to See Through Flare