mlsanityData to 7 Oct 2026

Video4Spatial: Towards Visuospatial Intelligence with Context-Guided Video Generation

arXiv 2512.03040 ↗First posted 2 Dec 2025cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

We investigate whether video generative models can exhibit visuospatial intelligence, a capability central to human cognition, using only visual data. To this end, we present Video4Spatial, a framework showing that video diffusion models conditioned solely on video-based scene context can perform complex spatial tasks. We validate on two tasks: scene navigation - following camera-pose instructions while remaining consistent with 3D geometry of the scene, and object grounding - which requires semantic localization, instruction following, and planning. Both tasks use video-only inputs, without auxiliary modalities such as depth or poses. With simple yet effective design choices in the framework and data curation, Video4Spatial demonstrates strong spatial understanding from video context: it plans navigation and grounds target objects end-to-end, follows camera-pose instructions while maintaining spatial consistency, and generalizes to long contexts and out-of-domain environments. Taken together, these results advance video generative models toward general visuospatial reasoning.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 93 of its 102 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

93 of 102 references.

References · 93

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  11. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
38 more
  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  4. 2022Video Diffusion Modelscited by 2,280
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  10. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  12. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  13. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  14. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  15. 2023ModelScope Text-to-Video Technical Reportcited by 651
  16. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  17. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  18. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  19. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  20. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  21. 2024Long Context Transfer from Language to Visioncited by 502
  22. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  23. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  24. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  25. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  26. 2018Video-to-Video Synthesiscited by 388
  27. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
  28. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  29. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  30. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  31. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  32. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  33. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  34. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  35. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  36. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  37. 2024Navigation World Modelscited by 262
  38. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260

50 most cited of 93 All 93 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding
  2. 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Tasks
  3. 2026Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding
  4. 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning
  5. 2025SIMS-V: Simulated Instruction-Tuning for Spatial Video Understanding
  6. 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces
  7. 2026Which Pretraining Paradigm Better Serves Spatial Intelligence? An Empirical Comparison of Vision-Language and Video Generation Models
  8. 2026Gen4U: Unifying Video Generation and Understanding via Diffusion