mlsanityData to 14 Oct 2026

From Synthesis to Removal: Physics-Grounded Reflection Simulation and Diffusion-Based Video Dereflection

arXiv 2608.11562 ↗First posted 12 Aug 2026cs.CV cs.AI eess.IVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Videos captured through glass often contain reflections that degrade visual quality and interfere with downstream vision tasks. Although single-image reflection removal has been extensively studied, video reflection removal remains largely underexplored due to the lack of paired video data, temporally coherent removal models, and dedicated evaluation benchmarks. We present a closed-loop framework that unifies physics-grounded reflection simulation, diffusion-based video dereflection, and benchmark evaluation. Our S2R-Synthesis pipeline generates paired reflected and reflection-free videos by performing physics-grounded augmentation in the structure space and rendering realistic reflected videos with a trained video diffusion renderer; the augmentation models key glass-related effects including roughness-induced blur, thickness-induced ghosting, and reflectance variation. Based on the synthesized data, we introduce S2R-Removal, the first diffusion-based video reflection removal model, which adapts a pretrained video diffusion prior through reflection-aware latent adaptation and one-step pixel-geometric refinement, recovering the clean transmission in a single denoising step. We further build S2R-Bench, the first benchmark for video reflection removal, supporting both full-reference evaluation and real-world human perceptual assessment. Experiments on S2R-Bench and multiple public image benchmarks demonstrate state-of-the-art performance and faster inference than even non-diffusion baselines, and validate the effectiveness of S2R-Synthesis. Project page: https://codingwzp.github.io/VideoDereflection_S2R.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 9 of its 47 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

9 of 47 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Reflection Removal through Efficient Adaptation of Diffusion Transformers4 Dec
  2. 2024PromptRR: Diffusion Models as Prompt Generators for Single Image Reflection Removal4 Feb

Other references · 7

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  4. 2025Kling-Omni Technical Reportcited by 71
  5. 2025UltraVideo: High-Quality UHD Video Dataset with Comprehensive Captionscited by 57
  6. 2025Rectifying Latent Space for Generative Single-Image Reflection Removalcited by 4
  7. 2026FUMO: Prior-Modulated Diffusion for Single Image Reflection Removalcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimation
  2. 2024Single-image reflection removal via self-supervised diffusion models
  3. 2025Dereflection Any Image with Diffusion Priors and Diversified Data
  4. 2024Denoising Monte Carlo Renders with Diffusion Models
  5. 2026WildShadowRemover: In-the-Wild Video Shadow Removal via Detail-Preserving Video Diffusion Models
  6. 2024DIVD: Deblurring with Improved Video Diffusion Model
  7. 2024Flash-Split: 2D Reflection Removal with Flash Cues and Latent Diffusion Separation
  8. 2026SIRR-LMM: Single-image Reflection Removal via Large Multimodal Model