Video4Spatial: Towards Visuospatial Intelligence with Context-Guided Video Generation
Not on the map. Why?
Abstract (arXiv)
We investigate whether video generative models can exhibit visuospatial intelligence, a capability central to human cognition, using only visual data. To this end, we present Video4Spatial, a framework showing that video diffusion models conditioned solely on video-based scene context can perform complex spatial tasks. We validate on two tasks: scene navigation - following camera-pose instructions while remaining consistent with 3D geometry of the scene, and object grounding - which requires semantic localization, instruction following, and planning. Both tasks use video-only inputs, without auxiliary modalities such as depth or poses. With simple yet effective design choices in the framework and data curation, Video4Spatial demonstrates strong spatial understanding from video context: it plans navigation and grounds target objects end-to-end, follows camera-pose instructions while maintaining spatial consistency, and generalizes to long contexts and out-of-domain environments. Taken together, these results advance video generative models toward general visuospatial reasoning.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 93 of its 102 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
93 of 102 references.
References · 93
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
38 more
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2024Long Context Transfer from Language to Visioncited by 502
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2018Video-to-Video Synthesiscited by 388
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 373
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2024Navigation World Modelscited by 262
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
50 most cited of 93 All 93 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding
- 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Tasks
- 2026Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding
- 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning
- 2025SIMS-V: Simulated Instruction-Tuning for Spatial Video Understanding
- 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces
- 2026Which Pretraining Paradigm Better Serves Spatial Intelligence? An Empirical Comparison of Vision-Language and Video Generation Models
- 2026Gen4U: Unifying Video Generation and Understanding via Diffusion