Towards Photorealistic and Efficient Bokeh Rendering via Diffusion Framework
Not on the map. Why?
Abstract (arXiv)
Existing mobile devices are constrained by compact optical designs, such as small apertures, which make it difficult to produce natural, optically realistic bokeh effects. Although recent learning-based methods have shown promising results, they still struggle with photos captured under high digital zoom levels, which often suffer from reduced resolution and loss of fine details. A naive solution is to enhance image quality before applying bokeh rendering, yet this two-stage pipeline reduces efficiency and introduces unnecessary error accumulation. To overcome these limitations, we propose MagicBokeh, a unified diffusion-based framework designed for high-quality and efficient bokeh rendering. Through an alternative training strategy and a focus-aware masked attention mechanism, our method jointly optimizes bokeh rendering and super-resolution, substantially improving both controllability and visual fidelity. Furthermore, we introduce degradation-aware depth module to enable more accurate depth estimation from low-quality inputs. Experimental results demonstrate that MagicBokeh efficiently produces photorealistic bokeh effects, particularly on real-world low-resolution images, paving the way for future advancements in bokeh rendering. Our code and models are available at https://github.com/vivoCameraResearch/MagicBokeh.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 63 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
44 of 63 references.
References · 44
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024Depth Anything V2cited by 1,385
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
32 more
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2023Adversarial Diffusion Distillationcited by 741
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 235
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
- 2022DifFace: Blind Face Restoration with Diffused Error Contractioncited by 96
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 70
- 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillationcited by 66
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 64
- 2024Diffusion Models, Image Super-Resolution And Everything: A Surveycited by 63
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2020Rendering Natural Camera Bokeh Effect with Deep Learningcited by 57
- 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
- 2019Synthetic Defocus and Look-Ahead Autofocus for Casual Videographycited by 28
- 2019SteReFo: Efficient Image Refocusing with Stereo Visioncited by 25
- 2023Dr.Bokeh: DiffeRentiable Occlusion-aware Bokeh Renderingcited by 19
- 2022MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effectscited by 17
- 2023Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Modelscited by 15
- 2023DC2: Dual-Camera Defocus Control by Learning to Refocuscited by 12
- 2025BokehDiff: Neural Lens Blur with One-Step Diffusioncited by 8
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modelingcited by 5
- 2025SDMatte: Grafting Diffusion Models for Interactive Mattingcited by 4
- 2025Realism Control One-step Diffusion for Real-World Image Super-Resolutioncited by 4
- 2025Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion Modelcited by 1
Built on by
Not cited yet.