Rectifying Latent Space for Generative Single-Image Reflection Removal
Not on the map. Why?
Abstract (arXiv)
Single-image reflection removal is a highly ill-posed problem, where existing methods struggle to reason about the composition of corrupted regions, causing them to fail at recovery and generalization in the wild. This work reframes an editing-purpose latent diffusion model to effectively perceive and process highly ambiguous, layered image inputs, yielding high-quality outputs. We argue that the challenge of this conversion stems from a critical yet overlooked issue, i.e., the latent space of semantic encoders lacks the inherent structure to interpret a composite image as a linear superposition of its constituent layers. Our approach is built on three synergistic components, including a reflection-equivariant VAE that aligns the latent space with the linear physics of reflection formation, a learnable task-specific text embedding for precise guidance that bypasses ambiguous language, and a depth-guided early-branching sampling strategy to harness generative stochasticity for promising results. Extensive experiments reveal that our model achieves new SOTA performance on multiple benchmarks and generalizes well to challenging real-world cases.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 41 of its 61 references that are in the map. First posted on arXiv 6 Dec 2025.
Builds on
41 of 61 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2024Depth Anything V2cited by 1,385
29 more
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 305
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2017Deep Image Mattingcited by 150
- 2020SaliencyMix: A Saliency Guided Data Augmentation Strategy for Better Regularizationcited by 149
- 2014Hypercolumns for Object Segmentation and Fine-grained Localizationcited by 128
- 2018Single Image Reflection Separation with Perceptual Lossescited by 98
- 2017A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothingcited by 60
- 2019Single Image Reflection Removal through Cascaded Refinementcited by 58
- 2019Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancementscited by 54
- 2020Location-aware Single Image Reflection Removalcited by 43
- 2023Single Image Reflection Separation via Component Synergycited by 38
- 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
- 2023Revisiting Single Image Reflection Removal In the Wildcited by 33
- 2021Trash or Treasure? An Interactive Dual-Stream Strategy for Single Image Reflection Separationcited by 32
- 2018CRRN: Multi-Scale Guided Concurrent Reflection Removal Networkcited by 24
- 2020Two-Stage Single Image Reflection Removal with Reflection-Aware Guidancecited by 22
- 2024Reversible Decoupling Network for Single Image Reflection Removalcited by 22
- 2024PromptRR: Diffusion Models as Prompt Generators for Single Image Reflection Removalcited by 14
- 2025Dereflection Any Image with Diffusion Priors and Diversified Datacited by 12
- 2016Robust Optical Flow Estimation of Double-Layer Images under Transparency or Reflectioncited by 10
- 2025Monocular Depth Estimation and Segmentation for Transparent Object with Iterative Semantic and Geometric Fusioncited by 8
- 2025A Preliminary Study on GPT-Image Generation Model for Image Restorationcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026On the Global Photometric Alignment for Low-Level Visioncited by 1
- 2026From Synthesis to Removal: Physics-Grounded Reflection Simulation and Diffusion-Based Video Dereflectioncited by 0
- 2026LoViF 2026 The First Challenge on Unified Removal of Raindrops and Reflections: Methods and Resultscited by 0
- 2026LoViF 2026 The First Challenge on Unified Removal of Raindrops and Reflections: Methods and Results24 Aug 2026
- 2026From Synthesis to Removal: Physics-Grounded Reflection Simulation and Diffusion-Based Video Dereflection12 Aug 2026
- 2026On the Global Photometric Alignment for Low-Level Vision9 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026PRISM: Latent Composition Consistency for Single-Image Reflection Removal
- 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning
- 2025Both Semantics and Reconstruction Matter: Making Representation Encoders Ready for Text-to-Image Generation and Editing
- 2026Reflection Separation from a Single Image via Joint Latent Diffusion
- 2024Decoding Diffusion: A Scalable Framework for Unsupervised Analysis of Latent Space Biases and Representations Using Natural Language Prompts
- 2024Latent Space Disentanglement in Diffusion Transformers Enables Zero-shot Fine-grained Semantic Editing
- 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Models
- 2024Latent Space Disentanglement in Diffusion Transformers Enables Precise Zero-shot Semantic Editing