mlsanityData to 14 Oct 2026

Dynamic View Synthesis as an Inverse Problem

arXiv 2506.08004 ↗First posted 9 Jun 2025cs.CV cs.AIcited by 12

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

In this work, we address dynamic view synthesis from monocular videos as an inverse problem in a training-free setting. By redesigning the noise initialization phase of a pre-trained video diffusion model, we enable high-fidelity dynamic view synthesis without any weight updates or auxiliary modules. We begin by identifying a fundamental obstacle to deterministic inversion arising from zero-terminal signal-to-noise ratio (SNR) schedules and resolve it by introducing a novel noise representation, termed K-order Recursive Noise Representation. We derive a closed form expression for this representation, enabling precise and efficient alignment between the VAE-encoded and the DDIM inverted latents. To synthesize newly visible regions resulting from camera motion, we introduce Stochastic Latent Modulation, which performs visibility aware sampling over the latent space to complete occluded regions. Comprehensive experiments demonstrate that dynamic view synthesis can be effectively performed through structured latent manipulation in the noise initialization phase.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 63 of its 70 references that are in the map. First posted on arXiv 9 Jun 2025.

Builds on

63 of 70 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translation12 Mar
  2. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models7 Mar
  3. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
  4. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency24 Jul
  5. 2024MultiDiff: Consistent Novel View Synthesis from a Single Image26 Jun
  6. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
  7. 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
  8. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image27 Oct
  9. 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models12 Dec

Other references · 54

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  11. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  12. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
38 more
  1. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  2. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  3. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  4. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  5. 2023ModelScope Text-to-Video Technical Reportcited by 658
  6. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  7. 2023CoTracker: It is Better to Track Togethercited by 522
  8. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  9. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  10. 2022Kubric: A scalable dataset generatorcited by 381
  11. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  12. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  13. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  14. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  15. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  16. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  17. 2024Global Structure-from-Motion Revisitedcited by 218
  18. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
  19. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
  20. 2019Few-shot Video-to-Video Synthesiscited by 197
  21. 2023Robust Dynamic Radiance Fieldscited by 194
  22. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  23. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
  24. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
  25. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
  26. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  27. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  28. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
  29. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
  30. 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 75
  31. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
  32. 2020World-Consistent Video-to-Video Synthesiscited by 69
  33. 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
  34. 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
  35. 2025GS-DiT: Advancing Video Generation with Pseudo 4D Gaussian Fields through Efficient Dense 3D Point Trackingcited by 39
  36. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Modelscited by 17
  37. 2024MotionShop: Zero-Shot Motion Transfer in Video Diffusion Models with Mixture of Score Guidancecited by 14
  38. 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformerscited by 12

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 9.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videos
  2. 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos
  3. 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
  4. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer
  5. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
  6. 2025Learning High-Quality Initial Noise for Single-View Synthesis with Diffusion Models
  7. 2025Novel View Synthesis using DDIM Inversion
  8. 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion