Active World-Model with 4D-informed Retrieval for Exploration and Awareness
On the map: World models → World models for language agents
Abstract (arXiv)
Physical awareness, especially in a large and dynamic environment, is shaped by sensing decisions that determine observability across space, time, and scale, while observations impact the quality of sensing decisions. This loopy information structure makes physical awareness a fundamentally challenging decision problem with partial observations. While in the past decade we have witnessed the unprecedented success of reinforcement learning (RL) in problems with full observability, decision problems with partial observation, such as POMDPs, remain largely open: real-world explorations are excessively costly, while sim-to-real pipeline suffer from unobserved viewpoints. We introduce AW4RE (Active World-model with 4D-informed Retrieval for Exploration), an awareness-centric generative world model that provides a sensor-native surrogate environment for exploring sensing queries. Conditioned on a queried sensing action, AW4RE estimates the action-conditioned observation process. This is done by combining 4D-informed evidence retrieval, action-conditioned geometric support with temporal coherence, and conditional generative completion. Experiments demonstrate that AW4RE produces more grounded and consistent predictions than geometry-aware generative baselines under extreme viewpoint shifts, temporal gaps, and sparse geometric support.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 9 of its 15 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
9 of 15 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024Genie: Generative Interactive Environmentscited by 706
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2024Training-free Camera Control for Video Generationcited by 119
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026All Roads Lead to Rome: Flow-driven Multi-Anchor Exploration for Open-Environment Active 3D Mapping ↗
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2026SearchWorld: Spatial Value-Grounded Imagination for UAV Object Search via World Models
- 2025Deep Active Inference with Diffusion Policy and Multiple Timescale World Model for Real-World Exploration and Navigation
- 2026LASER: Learning Active Sensing for Continuum Field Reconstruction
- 2023Learning Spatial and Temporal Hierarchies: Hierarchical Active Inference for navigation in Multi-Room Maze Environments
- 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
- 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AI