mlsanityData to 14 Oct 2026

Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion Model

arXiv 2505.21593 ↗First posted 27 May 2025cs.CV cs.AIcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Diffusion models have recently emerged as powerful tools for camera simulation, enabling both geometric transformations and realistic optical effects. Among these, image-based bokeh rendering has shown promising results, but diffusion for video bokeh remains unexplored. Existing image-based methods are plagued by temporal flickering and inconsistent blur transitions, while current video editing methods lack explicit control over the focus plane and bokeh intensity. These issues limit their applicability for controllable video bokeh. In this work, we propose a one-step diffusion framework for generating temporally coherent, depth-aware video bokeh rendering. The framework employs a multi-plane image (MPI) representation adapted to the focal plane to condition the video diffusion model, thereby enabling it to exploit strong 3D priors from pretrained backbones. To further enhance temporal stability, depth robustness, and detail preservation, we introduce a progressive training strategy. Experiments on synthetic and real-world benchmarks demonstrate superior temporal coherence, spatial accuracy, and controllability, outperforming prior baselines. This work represents the first dedicated diffusion framework for video bokeh generation, establishing a new baseline for temporally coherent and controllable depth-of-field effects.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 31 of its 49 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

31 of 49 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Bokeh Diffusion: Defocus Blur Control in Text-to-Image Diffusion Models11 Mar

Other references · 30

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  6. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  7. 2018Albumentations: fast and flexible image augmentationscited by 560
  8. 2018Video-to-Video Synthesiscited by 390
  9. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
  10. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  11. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  12. 2020Real-Time High-Resolution Background Mattingcited by 173
18 more
  1. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
  2. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  3. 2024One-Step Image Translation with Text-to-Image Modelscited by 116
  4. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
  5. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  6. 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 71
  7. 2020Rendering Natural Camera Bokeh Effect with Deep Learningcited by 57
  8. 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
  9. 2019Synthetic Defocus and Look-Ahead Autofocus for Casual Videographycited by 28
  10. 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesiscited by 26
  11. 2019SteReFo: Efficient Image Refocusing with Stereo Visioncited by 25
  12. 2023Drag-A-Video: Non-rigid Video Editing with Point-based Interactioncited by 22
  13. 2017Aperture Supervision for Monocular Depth Estimationcited by 21
  14. 2023Dr.Bokeh: DiffeRentiable Occlusion-aware Bokeh Renderingcited by 19
  15. 2021Stacked Deep Multi-Scale Hierarchical Network for Fast Bokeh Effect Rendering from a Single Imagecited by 18
  16. 2022MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effectscited by 17
  17. 2025Bokehlicious: Photorealistic Bokeh Rendering with Controllable Aperturescited by 11
  18. 2021Unsupervised Learning of Depth and Depth-of-Field Effect from Natural Images with Aperture Rendering Generative Adversarial Networkscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025BokehFlow: Depth-Free Controllable Bokeh Rendering via Flow Matching
  2. 2023GBSD: Generative Bokeh with Stage Diffusion
  3. 2025BokehDiff: Neural Lens Blur with One-Step Diffusion
  4. 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering
  5. 2026TeDiO: Temporal Diagonal Optimization for Training-Free Coherent Video Diffusion
  6. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control
  7. 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap
  8. 2024Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models