mlsanityData to 7 Oct 2026

Stabilizing Camera-Controlled Novel View Synthesis at Inference Time

arXiv 2609.03639 ↗First posted 3 Sep 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Training-free, camera-controlled novel view synthesis from a single image using pre-trained video diffusion models often becomes unstable under large camera motion and long generation horizons. Existing approaches commonly combine several inference-time components, making it unclear which design choices are most important for stability. We show that the main source of stability is simple. Decomposing camera motion into small autoregressive steps limits per-step geometric distortion and reduces error accumulation. A controlled camera-step study shows that performance remains stable for small motions and degrades more strongly as the per-step motion approaches 18-20^circ. We further evaluate geometry-constrained spatial attention and low-frequency appearance anchoring as supporting refinements, together with an efficient registration-free warping pipeline. Across RealEstate10K and MegaScene, CamTrol++ improves temporal and geometric consistency, downstream 3D reconstruction quality, and generation efficiency over training-free baselines. The method remains effective for 56-frame generation and under substantial controlled depth corruption. These results show that careful control of camera motion at inference time can substantially improve the stability of camera-controlled novel view synthesis without retraining or modifying the diffusion backbone.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 52 of its 65 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

52 of 65 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025Training-free Geometric Image Editing on Diffusion Models31 Jul
  2. 2025WAVE: Warp-Based View Guidance for Consistent Novel View Synthesis Using a Single Image30 Jun
  3. 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations17 May
  4. 2025Zero4D: Training-Free 4D Video Generation From Single Video Using Off-the-Shelf Video Diffusion28 Mar
  5. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
  6. 2025Synthesizing Consistent Novel Views via 3D Epipolar Attention without Re-Training25 Feb
  7. 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editing10 Dec
  8. 2024Novel View Synthesis with Pixel-Space Diffusion Models12 Nov
  9. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion7 Nov
  10. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
  11. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  12. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models4 Oct
2 more
  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  2. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  9. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  10. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  11. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  12. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
26 more
  1. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  2. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  3. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  4. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
  5. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  6. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
  7. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  8. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  9. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  10. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
  11. 2024Training-free Camera Control for Video Generationcited by 119
  12. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
  13. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  14. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 107
  15. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 87
  16. 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesiscited by 78
  17. 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
  18. 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
  19. 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Modelscited by 57
  20. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 33
  21. 2024EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splattingcited by 22
  22. 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Imagescited by 16
  23. 2024TweedieMix: Improving Multi-Concept Fusion for Diffusion-based Image/Video Generationcited by 14
  24. 2024Compositional Video Generation as Flow Equalizationcited by 12
  25. 2025UniView: Enhancing Novel View Synthesis From A Single Image By Unifying Reference Featurescited by 1
  26. 2026NeoMap: Training-free Novel-View Synthesis from Single Images and Videoscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ConfCtrl: Enabling Precise Camera Control in Video Diffusion via Confidence-Aware Interpolation
  2. 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion
  3. 2025Next-Scale Autoregressive Models are Zero-Shot Single-Image Object View Synthesizers
  4. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis
  5. 2025CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesis
  6. 2025Geometric Consistency Refinement for Single Image Novel View Synthesis via Test-Time Adaptation of Diffusion Models
  7. 2025Dynamic View Synthesis as an Inverse Problem
  8. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models