NavThinker: Action-Conditioned World Models for Coupled Prediction and Planning in Social Navigation
On the map: World models → World models for navigation
Abstract (arXiv)
Social navigation requires robots to act safely in dynamic human environments. Effective behavior demands thinking ahead: reasoning about how the scene and pedestrians evolve under different robot actions rather than reacting to current observations alone. This creates a coupled prediction-planning challenge, where robot actions and human motion mutually influence each other. To address this challenge, we propose NavThinker, a future-aware framework that couples an action-conditioned world model with on-policy reinforcement learning. The world model operates in the Depth Anything V2 patch feature space and performs autoregressive prediction of future scene geometry and human motion; multi-head decoders then produce future depth maps and human trajectories, yielding a future-aware state aligned with traversability and interaction risk. Crucially, we train the policy with DD-PPO while injecting world-model think-ahead signals via: (i) action-conditioned future features fused into the current observation embedding and (ii) social reward shaping from predicted human trajectories. Experiments on single- and multi-robot Social-HM3D show state-of-the-art navigation success, with zero-shot transfer to Social-MP3D and real-world deployment on a Unitree Go2, validating generalization and practical applicability. Webpage: https://hutslib.github.io/NavThinker.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 11 of its 38 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
11 of 38 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018World Modelscited by 1,444
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2023STORM: Efficient Stochastic Transformer based World Models for Reinforcement Learningcited by 88
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 9
- 2026GeoSem-WAM: Geometry- and Semantic-Aware World Action Modelscited by 8
- 2026Think When It Matters: Conditional VLM Reasoning for Social Navigation with RL Policiescited by 0
- 2026Quo Vadis, World Modeling?cited by 0
- 2026Feeling Terrain Before Crossing: World Models for Off-Road Navigationcited by 0
- 2026Social-WM: Safety-Aware Latent World Models for Robot Social Navigationcited by 0
- 2026Social-WM: Safety-Aware Latent World Models for Robot Social Navigation30 Sep 2026
- 2026Feeling Terrain Before Crossing: World Models for Off-Road Navigation17 Sep 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Think When It Matters: Conditional VLM Reasoning for Social Navigation with RL Policies13 Jul 2026
- 2026GeoSem-WAM: Geometry- and Semantic-Aware World Action Models2 Jun 2026
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation20 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learning
- 2021SOCIALGYM: A Framework for Benchmarking Social Robot Navigation
- 2024Human-Robot Cooperative Distribution Coupling for Hamiltonian-Constrained Social Navigation
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning
- 2026WALL-SS: Scaling Long-horizon World Models via Next-Scale Autoregression
- 2026G2-Nav: Grounded and Guarded Vision-Language Costmaps for Robot Social Navigation ↗