Learning to See Through Obstructions
Not on the map. Why?
Abstract (arXiv)
We present a learning-based approach for removing unwanted obstructions, such as window reflections, fence occlusions or raindrops, from a short sequence of images captured by a moving camera. Our method leverages the motion differences between the background and the obstructing elements to recover both layers. Specifically, we alternate between estimating dense optical flow fields of the two layers and reconstructing each layer from the flow-warped images via a deep convolutional neural network. The learning-based layer reconstruction allows us to accommodate potential errors in the flow estimation and brittle assumptions such as brightness consistency. We show that training on synthetically generated data transfers well to real images. Our results on numerous challenging scenarios of reflection and fence removal demonstrate the effectiveness of the proposed method.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 7; 2024: 9; 2025: 5; 2026: 7.
38 papers.
Sort:
By area:
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2023Single Image Reflection Separation via Component Synergycited by 38
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2021Robust Reflection Removal with Reflection-free Flash-only Cuescited by 34
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 33
- 2022Temporally Consistent Semantic Video Editingcited by 28
- 2021Neural Image Representations for Multi-Image Fusion and Layer Separationcited by 18
- 2023Neural Spline Fields for Burst Image Fusion and Layer Separationcited by 16
- 2024Language-guided Image Reflection Separationcited by 16
- 2024DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videoscited by 16
- 2022Robust Reflection Removal with Flash-only Cues in the Wildcited by 14
- 2024DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentationcited by 13
26 more
- 2021A Categorized Reflection Removal Dataset with Diverse Real-world Scenescited by 12
- 2023Deep Image Matting: A Comprehensive Surveycited by 12
- 2024Flash-Split: 2D Reflection Removal with Flash Cues and Latent Diffusion Separationcited by 10
- 2021Let's See Clearly: Contaminant Artifact Removal for Moving Camerascited by 9
- 2024Removing Reflections from RAW Photoscited by 9
- 2021SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-Trained Siamese Transformerscited by 7
- 2023Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenescited by 7
- 2023Multi-view Self-supervised Disentanglement for General Image Denoisingcited by 7
- 2021Stereo Waterdrop Removal with Row-wise Dilated Attentioncited by 5
- 2023Seeing the World through Your Eyescited by 5
- 2024FIRM: Flexible Interactive Reflection reMovalcited by 4
- 2022Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspectivecited by 3
- 2023Seeing Behind Dynamic Occlusions with Event Camerascited by 3
- 2024Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splatscited by 3
- 2025Reflection Removal through Efficient Adaptation of Diffusion Transformerscited by 3
- 2026GFRRN: Explore the Gaps in Single Image Reflection Removalcited by 2
- 2025DeclutterNeRF: Generative-Free 3D Scene Recovery for Occlusion Removalcited by 1
- 2025SNNSIR: A Simple Spiking Neural Network for Stereo Image Restorationcited by 1
- 2025Seeing through Unclear Glass: Occlusion Removal with One Shotcited by 1
- 2025TR-Gaussians: High-fidelity Real-time Rendering of Planar Transmission and Reflection with 3D Gaussian Splattingcited by 1
- 2026ReflexSplit: Single Image Reflection Separation via Layer Fusion-Separationcited by 1
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decompositioncited by 1
- 2026SIRR-LMM: Single-image Reflection Removal via Large Multimodal Modelcited by 0
- 2026Adaptive Language-Aware Image Reflection Removal Networkcited by 0
- 2026Principled Reflection Separation via Nonlinear Superposition and Feature Interactioncited by 0
- 2026Reflection Separation from a Single Image via Joint Latent Diffusioncited by 0
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition28 Jul 2026
- 2026Reflection Separation from a Single Image via Joint Latent Diffusion2 Jun 2026
- 2026Principled Reflection Separation via Nonlinear Superposition and Feature Interaction1 Jun 2026
- 2026Adaptive Language-Aware Image Reflection Removal Network6 Mar 2026
- 2026GFRRN: Explore the Gaps in Single Image Reflection Removal26 Feb 2026
- 2026ReflexSplit: Single Image Reflection Separation via Layer Fusion-Separation24 Jan 2026
- 2026SIRR-LMM: Single-image Reflection Removal via Large Multimodal Model12 Jan 2026
- 2025Reflection Removal through Efficient Adaptation of Diffusion Transformers4 Dec 2025
- 2025TR-Gaussians: High-fidelity Real-time Rendering of Planar Transmission and Reflection with 3D Gaussian Splatting17 Nov 2025
- 2025Seeing through Unclear Glass: Occlusion Removal with One Shot1 Sep 2025
- 2025SNNSIR: A Simple Spiking Neural Network for Stereo Image Restoration17 Aug 2025
- 2025DeclutterNeRF: Generative-Free 3D Scene Recovery for Occlusion Removal7 Apr 2025
26 more
- 2024Flash-Split: 2D Reflection Removal with Flash Cues and Latent Diffusion Separation31 Dec 2024
- 2024Generative Omnimatte: Learning to Decompose Video into Layers25 Nov 2024
- 2024Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats3 Oct 2024
- 2024DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentation3 Jun 2024
- 2024FIRM: Flexible Interactive Reflection reMoval3 Jun 2024
- 2024DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videos27 May 2024
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Models10 Apr 2024
- 2024Removing Reflections from RAW Photos28 Feb 2024
- 2024Language-guided Image Reflection Separation19 Feb 2024
- 2023Neural Spline Fields for Burst Image Fusion and Layer Separation21 Dec 2023
- 2023Multi-view Self-supervised Disentanglement for General Image Denoising10 Sep 2023
- 2023Single Image Reflection Separation via Component Synergy19 Aug 2023
- 2023Seeing Behind Dynamic Occlusions with Event Cameras28 Jul 2023
- 2023Seeing the World through Your Eyes15 Jun 2023
- 2023Deep Image Matting: A Comprehensive Survey10 Apr 2023
- 2023Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenes12 Feb 2023
- 2022Removing Objects From Neural Radiance Fields22 Dec 2022
- 2022Robust Reflection Removal with Flash-only Cues in the Wild5 Nov 2022
- 2022Temporally Consistent Semantic Video Editing21 Jun 2022
- 2022Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspective4 Apr 2022
- 2021SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-Trained Siamese Transformers17 Dec 2021
- 2021Stereo Waterdrop Removal with Row-wise Dilated Attention7 Aug 2021
- 2021A Categorized Reflection Removal Dataset with Diverse Real-world Scenes7 Aug 2021
- 2021Neural Image Representations for Multi-Image Fusion and Layer Separation2 Aug 2021
- 2021Let's See Clearly: Contaminant Artifact Removal for Moving Cameras18 Apr 2021
- 2021Robust Reflection Removal with Reflection-free Flash-only Cues7 Mar 2021
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 33
- 2024Flash-Split: 2D Reflection Removal with Flash Cues and Latent Diffusion Separationcited by 10
- 2025Reflection Removal through Efficient Adaptation of Diffusion Transformerscited by 3
- 2026Reflection Separation from a Single Image via Joint Latent Diffusioncited by 0
- 2026Reflection Separation from a Single Image via Joint Latent Diffusion2 Jun 2026
- 2025Reflection Removal through Efficient Adaptation of Diffusion Transformers4 Dec 2025
- 2024Flash-Split: 2D Reflection Removal with Flash Cues and Latent Diffusion Separation31 Dec 2024
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Models10 Apr 2024
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2023Single Image Reflection Separation via Component Synergycited by 38
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2021Robust Reflection Removal with Reflection-free Flash-only Cuescited by 34
- 2022Temporally Consistent Semantic Video Editingcited by 28
- 2021Neural Image Representations for Multi-Image Fusion and Layer Separationcited by 18
- 2023Neural Spline Fields for Burst Image Fusion and Layer Separationcited by 16
- 2024Language-guided Image Reflection Separationcited by 16
- 2024DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videoscited by 16
- 2022Robust Reflection Removal with Flash-only Cues in the Wildcited by 14
- 2024DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentationcited by 13
- 2021A Categorized Reflection Removal Dataset with Diverse Real-world Scenescited by 12
12 most cited of 33 All 33 (JSON)
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition28 Jul 2026
- 2026Principled Reflection Separation via Nonlinear Superposition and Feature Interaction1 Jun 2026
- 2026Adaptive Language-Aware Image Reflection Removal Network6 Mar 2026
- 2026GFRRN: Explore the Gaps in Single Image Reflection Removal26 Feb 2026
- 2026ReflexSplit: Single Image Reflection Separation via Layer Fusion-Separation24 Jan 2026
- 2025TR-Gaussians: High-fidelity Real-time Rendering of Planar Transmission and Reflection with 3D Gaussian Splatting17 Nov 2025
- 2025Seeing through Unclear Glass: Occlusion Removal with One Shot1 Sep 2025
- 2025SNNSIR: A Simple Spiking Neural Network for Stereo Image Restoration17 Aug 2025
- 2025DeclutterNeRF: Generative-Free 3D Scene Recovery for Occlusion Removal7 Apr 2025
- 2024Generative Omnimatte: Learning to Decompose Video into Layers25 Nov 2024
- 2024Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats3 Oct 2024
- 2024DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentation3 Jun 2024
12 newest of 33 All 33 (JSON)