From Crowd Motion Prediction to Robot Navigation in Crowds
Not on the map. Why?
Abstract (arXiv)
We focus on robot navigation in crowded environments. To navigate safely and efficiently within crowds, robots need models for crowd motion prediction. Building such models is hard due to the high dimensionality of multiagent domains and the challenge of collecting or simulating interaction-rich crowd-robot demonstrations. While there has been important progress on models for offline pedestrian motion forecasting, transferring their performance on real robots is nontrivial due to close interaction settings and novelty effects on users. In this paper, we investigate the utility of a recent state-of-the-art motion prediction model (S-GAN) for crowd navigation tasks. We incorporate this model into a model predictive controller (MPC) and deploy it on a self-balancing robot which we subject to a diverse range of crowd behaviors in the lab. We demonstrate that while S-GAN motion prediction accuracy transfers to the real world, its value is not reflected on navigation performance, measured with respect to safety and efficiency; in fact, the MPC performs indistinguishably even when using a simple constant-velocity prediction model, suggesting that substantial model improvements might be needed to yield significant gains for crowd navigation tasks. Footage from our experiments can be found at https://youtu.be/mzFiXg8KsZ0.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Mar 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 4; 2024: 2; 2025: 3; 2026: 3.
12 papers.
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 10
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictionscited by 10
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowdscited by 6
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observationscited by 5
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecastingcited by 4
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2023Visual Forecasting as a Mid-level Representation for Avoidancecited by 1
- 2024Socially-Aware Shared Control Navigation for Assistive Mobile Robots in the Built Environmentcited by 1
- 2026HumAIN: Human-Aware Implicit Social Robot Navigationcited by 0
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Datasetcited by 0
- 2026CoCoNav: Conformal Control for Safe Robot Navigation in Crowdscited by 0
- 2026CoCoNav: Conformal Control for Safe Robot Navigation in Crowds7 Aug 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026HumAIN: Human-Aware Implicit Social Robot Navigation8 Jul 2026
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations1 Oct 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictions11 Mar 2025
- 2024Socially-Aware Shared Control Navigation for Assistive Mobile Robots in the Built Environment27 May 2024
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowds26 May 2024
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions21 Nov 2023
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting20 Oct 2023
- 2023Visual Forecasting as a Mid-level Representation for Avoidance17 Sep 2023
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planning13 Jun 2023