Look-Before-Move: Narrative-Grounded World Visual Attention in Dynamic 3D Story Worlds
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
As embodied AI and world models increasingly operate in dynamic 3D environments, visual perception must move beyond passively interpreting given observations toward actively deciding what to observe. We study this problem through camera planning in dynamic 3D story worlds, where the camera must not only generate smooth motion, but also decide what visual evidence should be acquired before it moves. We formulate this capability as Narrative-Grounded World Visual Attention, where the camera acts as an embodied observer that determines what to observe, how to compose the observation, and how to shift attention over time under narrative intent and physical 3D constraints. To realize this capability, we propose Look-Before-Move, a camera planning framework that separates observation specification from motion execution. It first builds a Semantic Observation Contract to convert directorial intent into executable visual constraints, then performs Monte Carlo Viewpoint Search to find narrative-compliant and geometrically feasible viewpoints, and finally applies Semantic Trajectory Grounding to connect selected viewpoints into continuous, collision-aware, and temporally coherent camera motion. We further construct a dynamic 3D Story World Benchmark based on StoryBlender, covering 50 stories, 457 scenes, and 1585 shots with animated characters, semantic scene configurations, and executable 3D environments. Experiments show that our framework improves subject perception, intent consistency, and trajectory quality over representative baselines, demonstrating the importance of organizing visual attention before generating camera motion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 16 of its 38 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
16 of 38 references.
References · 16
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2025Towards Understanding Camera Motions in Any Videocited by 64
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 56
- 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spacescited by 28
- 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attentioncited by 24
- 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
- 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agentscited by 21
4 more
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generationcited by 16
- 2024Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Modelscited by 9
- 2025Camera Trajectory Generation: A Comprehensive Survey of Methods, Metrics, and Future Directionscited by 4
- 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamicscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20263D-Belief: Embodied Belief Inference via Generative 3D World Modeling
- 2026Can Image Models Imagine Time? ImageTime: A Novel Benchmark for Probing Visual World Modeling Through Spatiotemporal Consistency
- 2026CinemaTraj: Composing Atomic Camera Trajectories for 3D Scenes with LLM Agents
- 2025AstraNav-World: World Model for Foresight Control and Consistency
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
- 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation
- 2025From 2D to 3D Cognition: A Brief Survey of General World Models
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models