# Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements

arXiv: https://arxiv.org/abs/1904.00637 · HTML: https://mlsanity.com/paper/1904.00637/

## Key facts

- Cited by 54 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Apr 2019.

## Built on by (most cited first, 30 of 54)

- [Free-viewpoint Indoor Neural Relighting from Multi-view Stereo](https://mlsanity.com/paper/2106.13299/) (2021)
- [Single Image Reflection Separation via Component Synergy](https://mlsanity.com/paper/2308.10027/) (2023)
- [Robust Reflection Removal with Reflection-free Flash-only Cues](https://mlsanity.com/paper/2103.04273/) (2021)
- [Revisiting Single Image Reflection Removal In the Wild](https://mlsanity.com/paper/2311.17320/) (2023)
- [Trash or Treasure? An Interactive Dual-Stream Strategy for Single Image Reflection Separation](https://mlsanity.com/paper/2110.10546/) (2021)
- [Reversible Decoupling Network for Single Image Reflection Removal](https://mlsanity.com/paper/2410.08063/) (2024)
- [PolarFree: Polarization-based Reflection-free Imaging](https://mlsanity.com/paper/2503.18055/) (2025)
- [Neural Spline Fields for Burst Image Fusion and Layer Separation](https://mlsanity.com/paper/2312.14235/) (2023)
- [Language-guided Image Reflection Separation](https://mlsanity.com/paper/2402.11874/) (2024)
- [DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videos](https://mlsanity.com/paper/2405.17705/) (2024)
- [Robust Reflection Removal with Flash-only Cues in the Wild](https://mlsanity.com/paper/2211.02914/) (2022)
- [PromptRR: Diffusion Models as Prompt Generators for Single Image Reflection Removal](https://mlsanity.com/paper/2402.02374/) (2024)
- [A Categorized Reflection Removal Dataset with Diverse Real-world Scenes](https://mlsanity.com/paper/2108.03380/) (2021)
- [Dereflection Any Image with Diffusion Priors and Diversified Data](https://mlsanity.com/paper/2503.17347/) (2025)
- [U2-Former: A Nested U-shaped Transformer for Image Restoration](https://mlsanity.com/paper/2112.02279/) (2021)
- [Removing Reflections from RAW Photos](https://mlsanity.com/paper/2404.14414/) (2024)
- [Flash-Split: 2D Reflection Removal with Flash Cues and Latent Diffusion Separation](https://mlsanity.com/paper/2501.00637/) (2024)
- [Let's See Clearly: Contaminant Artifact Removal for Moving Cameras](https://mlsanity.com/paper/2104.08852/) (2021)
- [Large-Field Contextual Feature Learning for Glass Detection](https://mlsanity.com/paper/2209.04639/) (2022)
- [Generative Memory-Guided Semantic Reasoning Model for Image Inpainting](https://mlsanity.com/paper/2110.00261/) (2021)
- [A Lightweight Deep Exclusion Unfolding Network for Single Image Reflection Removal](https://mlsanity.com/paper/2503.01938/) (2025)
- [Depth-Synergized Mamba Meets Memory Experts for All-Day Image Reflection Separation](https://mlsanity.com/paper/2601.00322/) (2026)
- [SeNM-VAE: Semi-Supervised Noise Modeling with Hierarchical Variational Autoencoder](https://mlsanity.com/paper/2403.17502/) (2024)
- [FIRM: Flexible Interactive Reflection reMoval](https://mlsanity.com/paper/2406.01555/) (2024)
- [OpenRR-1k: A Scalable Dataset for Real-World Reflection Removal](https://mlsanity.com/paper/2506.08299/) (2025)
- [Rectifying Latent Space for Generative Single-Image Reflection Removal](https://mlsanity.com/paper/2512.06358/) (2025)
- [Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspective](https://mlsanity.com/paper/2204.01505/) (2022)
- [Benchmarking Ultra-High-Definition Image Reflection Removal](https://mlsanity.com/paper/2308.00265/) (2023)
- [Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats](https://mlsanity.com/paper/2410.02764/) (2024)
- [Contrastive Learning Based Recursive Dynamic Multi-Scale Network for Image Deraining](https://mlsanity.com/paper/2305.18092/) (2023)

## Abstract (arXiv)

Removing undesirable reflections from a single image captured through a glass window is of practical importance to visual computing systems. Although state-of-the-art methods can obtain decent results in certain situations, performance declines significantly when tackling more general real-world cases. These failures stem from the intrinsic difficulty of single image reflection removal -- the fundamental ill-posedness of the problem, and the insufficiency of densely-labeled training data needed for resolving this ambiguity within learning-based neural network pipelines. In this paper, we address these issues by exploiting targeted network enhancements and the novel use of misaligned data. For the former, we augment a baseline network architecture by embedding context encoding modules that are capable of leveraging high-level contextual clues to reduce indeterminacy within areas containing strong reflections. For the latter, we introduce an alignment-invariant loss function that facilitates exploiting misaligned real-world training data that is much easier to collect. Experimental results collectively show that our method outperforms the state-of-the-art with aligned data, and that significant improvements are possible when using additional misaligned data.
