LensStyle: Learning the Optical Aesthetics for Controllable Stylized Lens Effect Rendering
Not on the map. Why?
Abstract (arXiv)
The visual aesthetics of photographs are deeply influenced by lens characteristics such as aperture shape, optical vignetting and optical diffraction, which together define a camera's unique optical style. Existing lens effect rendering methods primarily focus on accurately simulating the blur transition from small to large apertures but overlook the stylistic aspects of lens effects. As a result, they fail to produce diverse bokeh effects under large apertures or capture distinctive photographic phenomena such as starbursts that emerge under small apertures. In this work, we introduce LensStyle, a unified framework for controllable stylized lens effect rendering that explicitly models lens aesthetics through joint continuous-discrete control. Our model incorporates a Dual-Path Controller that disentangles continuous optical parameter modulation (e.g., focus distance and blur strength) from discrete lens-style conditioning (e.g., circular, polygonal, donut, cat-eye, and starburst effects), enabling fine-grained, interpretable, and physically grounded lens manipulation within a single unified framework. To support model training, we curate a comprehensive MultiLens dataset containing multi-lens image pairs synthesized under real optical constraints. Extensive experiments demonstrate that LensStyle achieves superior realism, controllability, and aesthetic quality compared with existing lens effect rendering approaches and diffusion-based image editing models, advancing computational photography toward multiple-lens-style simulation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 4 Sep 2026.
Builds on
45 of 54 references.
References · 45
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2013Auto-Encoding Variational Bayescited by 3,980
33 more
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2024Depth Anything V2cited by 1,385
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2023Adversarial Diffusion Distillationcited by 741
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
- 2023Flow Matching in Latent Spacecited by 155
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
- 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 70
- 2020Rendering Natural Camera Bokeh Effect with Deep Learningcited by 57
- 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
- 2023Boosting Latent Diffusion with Flow Matchingcited by 44
- 2023Latent Space Editing in Transformer-Based Flow Matchingcited by 32
- 2019Synthetic Defocus and Look-Ahead Autofocus for Casual Videographycited by 28
- 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesiscited by 26
- 2023Dr.Bokeh: DiffeRentiable Occlusion-aware Bokeh Renderingcited by 19
- 2025SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editingcited by 18
- 2022MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effectscited by 17
- 2023Curved Diffusion: A Generative Model With Optical Geometry Controlcited by 13
- 2025Bokeh Diffusion: Defocus Blur Control in Text-to-Image Diffusion Modelscited by 10
- 2025Bokehlicious: Photorealistic Bokeh Rendering with Controllable Aperturescited by 10
- 2023Defocus to focus: Photo-realistic bokeh rendering by fusing defocus and radiance priorscited by 8
- 2025BokehDiff: Neural Lens Blur with One-Step Diffusioncited by 8
- 2025DiffCamera: Arbitrary Refocusing on Imagescited by 5
- 2023Point-and-Shoot All-in-Focus Photo Synthesis from Smartphone Camera Paircited by 4
- 2025BokehFlow: Depth-Free Controllable Bokeh Rendering via Flow Matchingcited by 3
- 2025Fine-grained Defocus Blur Control for Generative Image Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LightLab: Controlling Light Sources in Images with Diffusion Models
- 2023GBSD: Generative Bokeh with Stage Diffusion
- 2024AKiRa: Augmentation Kit on Rays for optical video generation
- 2025TransLight: Image-Guided Customized Lighting Control with Generative Decoupling
- 2025PractiLight: Practical Light Control Using Foundational Diffusion Models
- 2025GOBench: Benchmarking Geometric Optics Generation and Understanding of MLLMs
- 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design
- 2025The Photographer Eye: Teaching Multimodal Large Language Models to Understand Image Aesthetics like Photographers