mlsanityData to 14 Oct 2026

Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video

arXiv 2605.25500 ↗First posted 25 May 2026cs.CVcited by 5

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Generating 4D scenes from a single-view video is inherently ill-posed: a single viewpoint lacks the information needed to recover a complete, dynamic scene with full coverage. Existing methods are typically limited to monocular videos, simple 3D effects, or only small viewpoint perturbations around the original viewpoint, falling short of true 4D generation. Meanwhile, the lack of large-scale datasets capturing full-scope 4D scenes with synchronized multi-view videos further hinders progress in this direction. We propose a novel single-view video-to-4D framework that casts full-scope 4D generation as a multi-view video synthesis followed by optimization-based 4D reconstruction from the generated views. To instantiate this formulation end-to-end, we make three key contributions. First, we introduce Real-MV-4D, a large-scale dataset of synchronized multi-view videos captured in diverse real-world environments to provide the 4D supervision. Second, we train a multi-view video diffusion model driven by a novel fused time(T)-view(V) attention mechanism that directly embeds geometric reprojection priors and explicit camera conditioning into its view-time interactions. Unlike basic feature fusion, this direct binding strictly aligns the generation process with physical 3D priors to produce a dense, synchronized T× V video grid. Third, rather than relying on non-interactive and inconsistent 2D video interpolations, we lift the synthesized multi-view videos into an explicit 4D representation (i.e. 4DGS), regularized by a Flow Matching Distillation loss that exploits the multi-view prior to improve novel-view rendering. Extensive experiments demonstrate that our method outperforms existing approaches in both visual fidelity and geometric consistency, enabling full-scope 4D scene generation from single-view videos.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 62 of its 81 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

62 of 81 references.

Closest ancestors · 14

Same direction, newest first

  1. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy18 Aug
  2. 2025FB-4D: Spatial-Temporal Coherent Dynamic 3D Content Generation with Feature Banks26 Mar
  3. 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generation20 Mar
  4. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translation12 Mar
  5. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints10 Dec
  6. 20244Real-Video: Learning Generalizable Photo-Realistic 4D Video Diffusion5 Dec
  7. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion7 Nov
  8. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generation31 May
  9. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
  10. 2023A Unified Approach for Text- and Image-guided 4D Scene Generation28 Nov
  11. 2023Animate124: Animating One Image to 4D Dynamic Scene24 Nov
  12. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
2 more
  1. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction13 Apr
  2. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 48

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  7. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  8. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  9. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  10. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  11. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  12. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
36 more
  1. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  2. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  3. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  4. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  5. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  6. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
  7. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  8. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  9. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
  10. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 167
  11. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  12. 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 87
  13. 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 75
  14. 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
  15. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  16. 2024GVGEN: Text-to-3D Generation with Volumetric Representationcited by 51
  17. 2024GenXD: Generating Any 3D and 4D Scenescited by 50
  18. 2025Puppeteer: Rig and Animate Your 3D Modelscited by 43
  19. 2025Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scenecited by 42
  20. 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistencycited by 35
  21. 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
  22. 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 34
  23. 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 34
  24. 2023Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Viewscited by 33
  25. 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
  26. 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generationcited by 21
  27. 2025TeleWorld: Towards Dynamic Multimodal Synthesis with a 4D World Modelcited by 16
  28. 20254Real-Video-V2: Fused View-Time Attention and Feedforward Reconstruction for 4D Scene Generationcited by 14
  29. 2024LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priorscited by 12
  30. 2026AnyView: Synthesizing Any Novel View in Dynamic Scenescited by 12
  31. 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Modelscited by 10
  32. 2025One4D: Unified 4D Generation and Reconstruction via Decoupled LoRA Controlcited by 8
  33. 2024Bringing Objects to Life: training-free 4D generation from 3D objects through view consistent noisecited by 5
  34. 2025Track, Inpaint, Resplat: Subject-driven 3D and 4D Generation with Progressive Texture Infillingcited by 2
  35. 2025Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generationcited by 2
  36. 2026DP-DeGauss: Dynamic Probabilistic Gaussian Decomposition for Egocentric 4D Scene Reconstructioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models
  2. 2025Zero4D: Training-Free 4D Video Generation From Single Video Using Off-the-Shelf Video Diffusion
  3. 20254DVD: Cascaded Dense-view Video Diffusion Model for High-quality 4D Content Generation
  4. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency
  5. 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstruction
  6. 20264DAnyone: Create Anyone in 4D from a Casual Monocular Video
  7. 2026Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction
  8. 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models