mlsanityData to 7 Oct 2026

Constructing the Umwelt: Cognitive Planning through Belief-Intent Co-Evolution

arXiv 2511.05540 ↗First posted 30 Oct 2025cs.RO cs.AI cs.CVcited by 0

On the map: World models → World models for language agents

also in 1 more
Abstract (arXiv)

This paper challenges a prevailing epistemological assumption in End-to-End Autonomous Driving: that high-performance planning necessitates high-fidelity world reconstruction. Inspired by cognitive science, we propose the Mental Bayesian Causal World Model (MBCWM) and instantiate it as the Tokenized Intent World Model (TIWM), a novel cognitive computing architecture. Its core philosophy posits that intelligence emerges not from pixel-level objective fidelity, but from the Cognitive Consistency between the agent's internal intentional world and physical reality. By synthesizing von Uexk"ull's textitUmwelt theory, the neural assembly hypothesis, and the triple causal model (integrating symbolic deduction, probabilistic induction, and force dynamics) into an end-to-end embodied planning system, we demonstrate the feasibility of this paradigm on the nuPlan benchmark. Experimental results in open-loop validation confirm that our Belief-Intent Co-Evolution mechanism effectively enhances planning performance. Crucially, in closed-loop simulations, the system exhibits emergent human-like cognitive behaviors, including map affordance understanding, free exploration, and self-recovery strategies. We identify Cognitive Consistency as the core learning mechanism: during long-term training, belief (state understanding) and intent (future prediction) spontaneously form a self-organizing equilibrium through implicit computational replay, achieving semantic alignment between internal representations and physical world affordances. TIWM offers a neuro-symbolic, cognition-first alternative to reconstruction-based planners, establishing a new direction: planning as active understanding, not passive reaction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 23 of its 65 references that are in the map. First posted on arXiv 30 Oct 2025.

Builds on

23 of 65 references.

References · 23

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  4. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  5. 2022Planning-oriented Autonomous Drivingcited by 1,068
  6. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  7. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  8. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  9. 2019Causal Confusion in Imitation Learningcited by 286
  10. 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
  11. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  12. 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
11 more
  1. 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
  2. 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
  3. 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 103
  4. 2018Baidu Apollo EM Motion Plannercited by 99
  5. 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Drivingcited by 84
  6. 2024World Models for Autonomous Driving: An Initial Surveycited by 79
  7. 2020Controllable Pareto Multi-Task Learningcited by 51
  8. 2024Navigation-Guided Sparse Scene Representation for End-to-End Autonomous Drivingcited by 46
  9. 2024Improving Agent Behaviors with RL Fine-tuning for Autonomous Drivingcited by 27
  10. 2017DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge About the World and the Selfcited by 5
  11. 2022Learning from Demonstrations of Critical Driving Behaviours Using Driver's Risk Fieldcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Self-Evolving Cognitive Framework via Causal World Modeling for Embodied Scientific Intelligence
  2. 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
  3. 2026Reasoning models do not yet follow their reasoning in autonomous driving: The KITScenes LongTail Dataset
  4. 2025From Understanding the World to Intervening in It: A Unified Multi-Scale Framework for Embodied Cognition
  5. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving
  6. 2025From Human Intention to Action Prediction: Intention-Driven End-to-End Autonomous Driving
  7. 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving
  8. 2025CogDriver: Integrating Cognitive Inertia for Temporally Coherent Planning in Autonomous Driving