Dynamic View Synthesis as an Inverse Problem
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
In this work, we address dynamic view synthesis from monocular videos as an inverse problem in a training-free setting. By redesigning the noise initialization phase of a pre-trained video diffusion model, we enable high-fidelity dynamic view synthesis without any weight updates or auxiliary modules. We begin by identifying a fundamental obstacle to deterministic inversion arising from zero-terminal signal-to-noise ratio (SNR) schedules and resolve it by introducing a novel noise representation, termed K-order Recursive Noise Representation. We derive a closed form expression for this representation, enabling precise and efficient alignment between the VAE-encoded and the DDIM inverted latents. To synthesize newly visible regions resulting from camera motion, we introduce Stochastic Latent Modulation, which performs visibility aware sampling over the latent space to complete occluded regions. Comprehensive experiments demonstrate that dynamic view synthesis can be effectively performed through structured latent manipulation in the noise initialization phase.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 63 of its 70 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
63 of 70 references.
Closest ancestors · 9
Same direction, newest first
- 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translation12 Mar
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models7 Mar
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency24 Jul
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Image26 Jun
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
- 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image27 Oct
- 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models12 Dec
Other references · 54
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
38 more
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2022Kubric: A scalable dataset generatorcited by 381
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
- 2019Few-shot Video-to-Video Synthesiscited by 197
- 2023Robust Dynamic Radiance Fieldscited by 194
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
- 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 75
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
- 2020World-Consistent Video-to-Video Synthesiscited by 69
- 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
- 2025GS-DiT: Advancing Video Generation with Pseudo 4D Gaussian Fields through Efficient Dense 3D Point Trackingcited by 39
- 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Modelscited by 17
- 2024MotionShop: Zero-Shot Motion Transfer in Video Diffusion Models with Mixture of Score Guidancecited by 14
- 2025LoRAShop: Training-Free Multi-Concept Image Generation and Editing with Rectified Flow Transformerscited by 12
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 9.
12 papers.
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 21
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenescited by 12
- 2025ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encodingcited by 11
- 2025PostCam: Camera-Controllable Novel-View Video Generation with Query-Shared Cross-Attentioncited by 6
- 2025InverseCrafter: Efficient Video ReCapture as a Latent Domain Inverse Problemcited by 6
- 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generationcited by 1
- 2026Compositional Video Generation via Inference-Time Guidancecited by 0
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolutioncited by 0
- 2026MotionEnhancer: Leveraging Video Diffusion for Motion-Enhanced Vision-Language Modelscited by 0
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesiscited by 0
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlowcited by 0
- 2026PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstructioncited by 0
- 2026PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction5 Sep 2026
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlow3 Sep 2026
- 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation2 Jul 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026MotionEnhancer: Leveraging Video Diffusion for Motion-Enhanced Vision-Language Models5 Jun 2026
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution28 May 2026
- 2026Compositional Video Generation via Inference-Time Guidance14 May 2026
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr 2026
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenes23 Jan 2026
- 2025InverseCrafter: Efficient Video ReCapture as a Latent Domain Inverse Problem5 Dec 2025
- 2025ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encoding25 Nov 2025
- 2025PostCam: Camera-Controllable Novel-View Video Generation with Query-Shared Cross-Attention21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videos
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videos
- 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
- 2025Learning High-Quality Initial Noise for Single-View Synthesis with Diffusion Models
- 2025Novel View Synthesis using DDIM Inversion
- 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion