mlsanityData to 14 Oct 2026

ControlVP: Interactive Geometric Refinement of AI-Generated Images with Consistent Vanishing Points

arXiv 2512.07504 ↗First posted 8 Dec 2025cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent text-to-image models, such as Stable Diffusion, have achieved impressive visual quality, yet they often suffer from geometric inconsistencies that undermine the structural realism of generated scenes. One prominent issue is vanishing point inconsistency, where projections of parallel lines fail to converge correctly in 2D space. This leads to structurally implausible geometry that degrades spatial realism, especially in architectural scenes. We propose ControlVP, a user-guided framework for correcting vanishing point inconsistencies in generated images. Our approach extends a pre-trained diffusion model by incorporating structural guidance derived from building contours. We also introduce geometric constraints that explicitly encourage alignment between image edges and perspective cues. Our method enhances global geometric consistency while maintaining visual fidelity comparable to the baselines. This capability is particularly valuable for applications that require accurate spatial structure, such as image-to-3D reconstruction. The dataset and source code are available at https://github.com/RyotaOkumura/ControlVP .

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 20 of its 44 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

20 of 44 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Enhancing Diffusion Models with 3D Perspective Geometry Constraints1 Dec
  2. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan

Other references · 18

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2024Depth Anything V2cited by 1,422
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  10. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  11. 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
  12. 2020HoliCity: A City-Scale Data Platform for Learning Holistic 3D Structurescited by 29
6 more
  1. 2024Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Frameworkcited by 25
  2. 2019NeurVPS: Neural Vanishing Point Scanning via Conic Convolutioncited by 24
  3. 2023Kandinsky 3.0 Technical Reportcited by 19
  4. 2022Deep vanishing point detection: Geometric priors make dataset variations vanishcited by 18
  5. 2021Avoiding Degeneracy for Monocular Visual SLAM with Point and Line Featurescited by 13
  6. 2024Vanishing-Point-Guided Video Semantic Segmentation of Driving Scenescited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Proportion and Perspective Control for Flow-Based Image Generation
  2. 2026When Geometry Aligns: Dihedral Hidden-State Transformations in UNet, ViT, and DiT Architectures
  3. 2025Geometric Consistency Refinement for Single Image Novel View Synthesis via Test-Time Adaptation of Diffusion Models
  4. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models
  5. 2026Geometrically Consistent Multi-View Scene Generation from Freehand Sketches
  6. 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
  7. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
  8. 2026CrossProjection: Geometric Grounding Beyond Viewpoint Change in Architectural Drawings