Navigating the Human Maze: Real-Time Robot Pathfinding with Generative Imitation Learning
On the map: Offline RL and imitation learning from data → Social robot navigation
Abstract (arXiv)
This paper addresses navigation in crowded environments by integrating goal-conditioned generative models with Sampling-based Model Predictive Control (SMPC). We introduce goal-conditioned autoregressive models to generate crowd behaviors, capturing intricate interactions among individuals. The model processes potential robot trajectory samples and predicts the reactions of surrounding individuals, enabling proactive robotic navigation in complex scenarios. Extensive experiments show that this algorithm enables real-time navigation, significantly reducing collision rates and path lengths, and outperforming selected baseline methods. The practical effectiveness of this algorithm is validated on an actual robotic platform, demonstrating its capability in dynamic settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social robot navigation, one of 13 directions in Offline RL and imitation learning from data. Builds on 34 of its 59 references that are in the map. First posted on arXiv 7 Aug 2024.
Builds on
34 of 59 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Generative Adversarial Networkscited by 5,603
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2016OpenAI Gymcited by 1,684
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2017Hindsight Experience Replaycited by 1,096
- 2021A Minimalist Approach to Offline Reinforcement Learningcited by 882
22 more
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 748
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2021COMBO: Conservative Offline Model-Based Policy Optimizationcited by 365
- 2017Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuningcited by 288
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2018Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learningcited by 162
- 2022Model-Based Imitation Learning for Urban Drivingcited by 149
- 2019Training Agents using Upside-Down Reinforcement Learningcited by 106
- 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 104
- 2022From Play to Policy: Conditional Behavior Generation from Uncurated Robot Datacited by 103
- 2021Core Challenges of Social Robot Navigation: A Surveycited by 97
- 2019Exploring Model-based Planning with Policy Networkscited by 90
- 2020Sample-efficient Cross-Entropy Method for Real-time Planningcited by 90
- 2021d3rlpy: An Offline Deep Reinforcement Learning Librarycited by 84
- 2020The Marathon 2: A Navigation Systemcited by 67
- 2019Collision Avoidance in Pedestrian-Rich Environments with Deep Reinforcement Learningcited by 44
- 2019Relational Graph Learning for Crowd Navigationcited by 42
- 2019PyRobot: An Open-source Robotics Framework for Research and Benchmarkingcited by 39
- 20173DOF Pedestrian Trajectory Prediction Learned from Long-Term Autonomous Mobile Robot Deployment Datacited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Diffusion Policies for Short-Horizon Planning in Robot Crowd Navigation
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Tasks
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictions
- 2026Trajectory Learning with Graph Representations for Social Robot Navigation
- 2026Crowd-FM: Learned Optimal Selection of Conditional Flow Matching-generated Trajectories for Crowd Navigation
- 2020NaviGAN: A Generative Approach for Socially Compliant Navigation
- 2026FLUX: Accelerating Cross-Embodiment Generative Navigation Policies via Rectified Flow and Static-to-Dynamic Learning
- 2026Diffusion for Long-Horizon Multi-Robot Path Planning in Human-Shared Environments ↗