Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Generating 4D scenes from a single-view video is inherently ill-posed: a single viewpoint lacks the information needed to recover a complete, dynamic scene with full coverage. Existing methods are typically limited to monocular videos, simple 3D effects, or only small viewpoint perturbations around the original viewpoint, falling short of true 4D generation. Meanwhile, the lack of large-scale datasets capturing full-scope 4D scenes with synchronized multi-view videos further hinders progress in this direction. We propose a novel single-view video-to-4D framework that casts full-scope 4D generation as a multi-view video synthesis followed by optimization-based 4D reconstruction from the generated views. To instantiate this formulation end-to-end, we make three key contributions. First, we introduce Real-MV-4D, a large-scale dataset of synchronized multi-view videos captured in diverse real-world environments to provide the 4D supervision. Second, we train a multi-view video diffusion model driven by a novel fused time(T)-view(V) attention mechanism that directly embeds geometric reprojection priors and explicit camera conditioning into its view-time interactions. Unlike basic feature fusion, this direct binding strictly aligns the generation process with physical 3D priors to produce a dense, synchronized T× V video grid. Third, rather than relying on non-interactive and inconsistent 2D video interpolations, we lift the synthesized multi-view videos into an explicit 4D representation (i.e. 4DGS), regularized by a Flow Matching Distillation loss that exploits the multi-view prior to improve novel-view rendering. Extensive experiments demonstrate that our method outperforms existing approaches in both visual fidelity and geometric consistency, enabling full-scope 4D scene generation from single-view videos.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 62 of its 81 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
62 of 81 references.
Closest ancestors · 14
Same direction, newest first
- 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy18 Aug
- 2025FB-4D: Spatial-Temporal Coherent Dynamic 3D Content Generation with Feature Banks26 Mar
- 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generation20 Mar
- 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translation12 Mar
- 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints10 Dec
- 20244Real-Video: Learning Generalizable Photo-Realistic 4D Video Diffusion5 Dec
- 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion7 Nov
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generation31 May
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
- 2023A Unified Approach for Text- and Image-guided 4D Scene Generation28 Nov
- 2023Animate124: Animating One Image to 4D Dynamic Scene24 Nov
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
2 more
Other references · 48
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
36 more
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2022Flexible Diffusion Modeling of Long Videoscited by 294
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
- 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 167
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 87
- 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 75
- 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
- 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
- 2024GVGEN: Text-to-3D Generation with Volumetric Representationcited by 51
- 2024GenXD: Generating Any 3D and 4D Scenescited by 50
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 43
- 2025Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scenecited by 42
- 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistencycited by 35
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
- 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 34
- 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 34
- 2023Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Viewscited by 33
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
- 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generationcited by 21
- 2025TeleWorld: Towards Dynamic Multimodal Synthesis with a 4D World Modelcited by 16
- 20254Real-Video-V2: Fused View-Time Attention and Feedforward Reconstruction for 4D Scene Generationcited by 14
- 2024LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priorscited by 12
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenescited by 12
- 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Modelscited by 10
- 2025One4D: Unified 4D Generation and Reconstruction via Decoupled LoRA Controlcited by 8
- 2024Bringing Objects to Life: training-free 4D generation from 3D objects through view consistent noisecited by 5
- 2025Track, Inpaint, Resplat: Subject-driven 3D and 4D Generation with Progressive Texture Infillingcited by 2
- 2025Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generationcited by 2
- 2026DP-DeGauss: Dynamic Probabilistic Gaussian Decomposition for Egocentric 4D Scene Reconstructioncited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillationcited by 0
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation10 Sep 2026
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search7 Sep 2026
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image4 Sep 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control26 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models
- 2025Zero4D: Training-Free 4D Video Generation From Single Video Using Off-the-Shelf Video Diffusion
- 20254DVD: Cascaded Dense-view Video Diffusion Model for High-quality 4D Content Generation
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency
- 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstruction
- 20264DAnyone: Create Anyone in 4D from a Casual Monocular Video
- 2026Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction
- 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models