mlsanityData to 14 Oct 2026

Curved Diffusion: A Generative Model With Optical Geometry Control

arXiv 2311.17609 ↗First posted 29 Nov 2023cs.CV cs.GR cs.LGcited by 13

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

State-of-the-art diffusion models can generate highly realistic images based on various conditioning like text, segmentation, and depth. However, an essential aspect often overlooked is the specific camera geometry used during image capture. The influence of different optical systems on the final scene appearance is frequently overlooked. This study introduces a framework that intimately integrates a text-to-image diffusion model with the particular lens geometry used in image rendering. Our method is based on a per-pixel coordinate conditioning method, enabling the control over the rendering geometry. Notably, we demonstrate the manipulation of curvature properties, achieving diverse visual effects, such as fish-eye, panoramic views, and spherical texturing using a single diffusion model.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 25 of its 30 references that are in the map. First posted on arXiv 29 Nov 2023.

Builds on

25 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  2. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 23

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  9. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  10. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  11. 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
  12. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
11 more
  1. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  2. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  3. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
  4. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  5. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  6. 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
  7. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 103
  8. 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
  9. 2023Training-free Diffusion Model Adaptation for Variable-Sized Text-to-Image Synthesiscited by 56
  10. 2021Progressively Complementary Network for Fisheye Image Rectification Using Appearance Flowcited by 23
  11. 2022Deep vanishing point detection: Geometric priors make dataset variations vanishcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 7; 2026: 4.

13 papers.

Sort:

By area:

  1. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 128
  2. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 83
  3. 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
  4. 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
  5. 2025Bokeh Diffusion: Defocus Blur Control in Text-to-Image Diffusion Modelscited by 10
  6. 2025TanDiT: Tangent-Plane Diffusion Transformer for High-Quality 360deg Panorama Generationcited by 3
  7. 2026Rethinking Camera Choice: An Empirical Study on Fisheye Camera Properties in Robotic Manipulationcited by 3
  8. 2025PanoDiff-SR: Synthesizing Dental Panoramic Radiographs using Diffusion and Super-resolutioncited by 2
  9. 2025Fine-grained Defocus Blur Control for Generative Image Modelscited by 1
  10. 2026LensStyle: Learning the Optical Aesthetics for Controllable Stylized Lens Effect Renderingcited by 1
  11. 2025Every Camera Effect, Every Time, All at Once: 4D Gaussian Ray Tracing for Physics-based Camera Effect Data Generationcited by 0
  12. 2026MIVIFI: Bridging Perspective and Fisheye Domains for Training Multi-View Fisheye Image Generation Modelscited by 0
1 more
  1. 2026Linear Fusion MultiDiffusion for Fast Training-Free Spherical Panorama Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Breathing New Life into 3D Assets with Generative Repainting
  2. 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
  3. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
  4. 2024Diffusion Models in 3D Vision: A Survey
  5. 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D
  6. 2023Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis
  7. 2026PE-Field 4D: Video Generation Models as Canvas
  8. 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimation