mlsanityData to 7 Oct 2026

LensStyle: Learning the Optical Aesthetics for Controllable Stylized Lens Effect Rendering

arXiv 2609.04939 ↗First posted 4 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The visual aesthetics of photographs are deeply influenced by lens characteristics such as aperture shape, optical vignetting and optical diffraction, which together define a camera's unique optical style. Existing lens effect rendering methods primarily focus on accurately simulating the blur transition from small to large apertures but overlook the stylistic aspects of lens effects. As a result, they fail to produce diverse bokeh effects under large apertures or capture distinctive photographic phenomena such as starbursts that emerge under small apertures. In this work, we introduce LensStyle, a unified framework for controllable stylized lens effect rendering that explicitly models lens aesthetics through joint continuous-discrete control. Our model incorporates a Dual-Path Controller that disentangles continuous optical parameter modulation (e.g., focus distance and blur strength) from discrete lens-style conditioning (e.g., circular, polygonal, donut, cat-eye, and starburst effects), enabling fine-grained, interpretable, and physically grounded lens manipulation within a single unified framework. To support model training, we curate a comprehensive MultiLens dataset containing multi-lens image pairs synthesized under real optical constraints. Extensive experiments demonstrate that LensStyle achieves superior realism, controllability, and aesthetic quality compared with existing lens effect rendering approaches and diffusion-based image editing models, advancing computational photography toward multiple-lens-style simulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

45 of 54 references.

References · 45

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  10. 2022Flow Matching for Generative Modelingcited by 5,426
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  12. 2013Auto-Encoding Variational Bayescited by 3,980
33 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  5. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  7. 2024Depth Anything V2cited by 1,385
  8. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  9. 2023Adversarial Diffusion Distillationcited by 741
  10. 2025Mean Flows for One-step Generative Modelingcited by 524
  11. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  12. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  13. 2023Flow Matching in Latent Spacecited by 155
  14. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
  15. 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 70
  16. 2020Rendering Natural Camera Bokeh Effect with Deep Learningcited by 57
  17. 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
  18. 2023Boosting Latent Diffusion with Flow Matchingcited by 44
  19. 2023Latent Space Editing in Transformer-Based Flow Matchingcited by 32
  20. 2019Synthetic Defocus and Look-Ahead Autofocus for Casual Videographycited by 28
  21. 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesiscited by 26
  22. 2023Dr.Bokeh: DiffeRentiable Occlusion-aware Bokeh Renderingcited by 19
  23. 2025SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editingcited by 18
  24. 2022MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effectscited by 17
  25. 2023Curved Diffusion: A Generative Model With Optical Geometry Controlcited by 13
  26. 2025Bokeh Diffusion: Defocus Blur Control in Text-to-Image Diffusion Modelscited by 10
  27. 2025Bokehlicious: Photorealistic Bokeh Rendering with Controllable Aperturescited by 10
  28. 2023Defocus to focus: Photo-realistic bokeh rendering by fusing defocus and radiance priorscited by 8
  29. 2025BokehDiff: Neural Lens Blur with One-Step Diffusioncited by 8
  30. 2025DiffCamera: Arbitrary Refocusing on Imagescited by 5
  31. 2023Point-and-Shoot All-in-Focus Photo Synthesis from Smartphone Camera Paircited by 4
  32. 2025BokehFlow: Depth-Free Controllable Bokeh Rendering via Flow Matchingcited by 3
  33. 2025Fine-grained Defocus Blur Control for Generative Image Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LightLab: Controlling Light Sources in Images with Diffusion Models
  2. 2023GBSD: Generative Bokeh with Stage Diffusion
  3. 2024AKiRa: Augmentation Kit on Rays for optical video generation
  4. 2025TransLight: Image-Guided Customized Lighting Control with Generative Decoupling
  5. 2025PractiLight: Practical Light Control Using Foundational Diffusion Models
  6. 2025GOBench: Benchmarking Geometric Optics Generation and Understanding of MLLMs
  7. 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design
  8. 2025The Photographer Eye: Teaching Multimodal Large Language Models to Understand Image Aesthetics like Photographers