Relational Graph Learning for Crowd Navigation
Not on the map. Why?
Abstract (arXiv)
We present a relational graph learning approach for robotic crowd navigation using model-based deep reinforcement learning that plans actions by looking into the future. Our approach reasons about the relations between all agents based on their latent features and uses a Graph Convolutional Network to encode higher-order interactions in each agent's state representation, which is subsequently leveraged for state prediction and value estimation. The ability to predict human motion allows us to perform multi-step lookahead planning, taking into account the temporal evolution of human crowds. We evaluate our approach against a state-of-the-art baseline for crowd navigation and ablations of our model to demonstrate that navigation with our approach is more efficient, results in fewer collisions, and avoids failure cases involving oscillatory and freezing behaviors.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 5; 2024: 12; 2025: 6; 2026: 6.
42 papers.
Sort:
By area:
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 46
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2022Interaction Modeling with Multiplex Attentioncited by 14
- 2022Important Object Identification with Semi-Supervised Learning for Autonomous Drivingcited by 13
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictionscited by 10
- 2024MATRIX: Multi-Agent Trajectory Generation with Diverse Contextscited by 9
- 2022Occlusion-Aware Crowd Navigation Using People as Sensorscited by 8
- 2024NeuPAN: Direct Point Robot Navigation with End-to-End Model-based Learningcited by 7
- 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigationcited by 7
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environmentscited by 6
- 2024Socially Integrated Navigation: A Social Acting Robot with Deep Reinforcement Learningcited by 5
- 2024Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Spacecited by 5
30 more
- 2021Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planningcited by 4
- 2021Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigationcited by 4
- 2022DMMGAN: Diverse Multi Motion Prediction of 3D Human Joints using Attention-Based Generative Adverserial Networkcited by 4
- 2024Attention Graph for Multi-Robot Social Navigation with Deep Reinforcement Learningcited by 4
- 2021A Graph Neural Network to Model Disruption in Human-Aware Robot Navigationcited by 3
- 2021Optimal Solving of Constrained Path-Planning Problems with Graph Convolutional Networks and Optimized Tree Searchcited by 3
- 2023SocNavGym: A Reinforcement Learning Gym for Social Navigationcited by 3
- 2023Exploring Social Motion Latent Space and Human Awareness for Effective Robot Navigation in Crowded Environmentscited by 2
- 2024Online Context Learning for Socially Compliant Navigationcited by 2
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigationcited by 2
- 2024Context-aware Mamba-based Reinforcement Learning for social robot navigationcited by 2
- 2025COLSON: Controllable Learning-Based Social Navigation via Diffusion-Based Reinforcement Learningcited by 2
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approachescited by 2
- 2026Crowd-FM: Learned Optimal Selection of Conditional Flow Matching-generated Trajectories for Crowd Navigationcited by 2
- 2021An advantage actor-critic algorithm for robotic motion planning in dense and dynamic scenarioscited by 1
- 2022Multi-subgoal Robot Navigation in Crowds with History Information and Interactionscited by 1
- 2023InCrowdFormer: On-Ground Pedestrian World Model From Egocentric Viewscited by 1
- 2023Hybrid of representation learning and reinforcement learning for dynamic and complex robotic motion planningcited by 1
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenariocited by 1
- 2021A review of motion planning algorithms for intelligent roboticscited by 0
- 2021Relative velocity-based reward functions for crowd navigation of robotscited by 0
- 2024Belief Aided Navigation using Bayesian Reinforcement Learning for Avoiding Humans in Blind Spotscited by 0
- 2024Navigating the Human Maze: Real-Time Robot Pathfinding with Generative Imitation Learningcited by 0
- 2025EmoBipedNav: Emotion-aware Social Navigation for Bipedal Robots with Deep Reinforcement Learningcited by 0
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environmentscited by 0
- 2026GIANT - Global Path Integration and Attentive Graph Networks for Multi-Agent Trajectory Planningcited by 0
- 2026Incremental Residual Reinforcement Learning Toward Real-World Learning for Social Navigationcited by 0
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigmscited by 0
- 2026Diffusion Policies for Short-Horizon Planning in Robot Crowd Navigationcited by 0
- 2026SoGuDiff: Socially Guided Diffusion for Steerable, Norm-Grounded Robot Navigationcited by 0
- 2026SoGuDiff: Socially Guided Diffusion for Steerable, Norm-Grounded Robot Navigation24 Sep 2026
- 2026Diffusion Policies for Short-Horizon Planning in Robot Crowd Navigation27 Aug 2026
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigms1 Aug 2026
- 2026Incremental Residual Reinforcement Learning Toward Real-World Learning for Social Navigation9 Apr 2026
- 2026GIANT - Global Path Integration and Attentive Graph Networks for Multi-Agent Trajectory Planning4 Mar 2026
- 2026Crowd-FM: Learned Optimal Selection of Conditional Flow Matching-generated Trajectories for Crowd Navigation6 Feb 2026
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments30 Dec 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario12 Sep 2025
- 2025COLSON: Controllable Learning-Based Social Navigation via Diffusion-Based Reinforcement Learning18 Mar 2025
- 2025EmoBipedNav: Emotion-aware Social Navigation for Bipedal Robots with Deep Reinforcement Learning16 Mar 2025
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictions11 Mar 2025
30 more
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments19 Nov 2024
- 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigation14 Oct 2024
- 2024Navigating the Human Maze: Real-Time Robot Pathfinding with Generative Imitation Learning7 Aug 2024
- 2024Context-aware Mamba-based Reinforcement Learning for social robot navigation5 Aug 2024
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigation8 Jul 2024
- 2024Online Context Learning for Socially Compliant Navigation17 Jun 2024
- 2024Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space22 May 2024
- 2024Belief Aided Navigation using Bayesian Reinforcement Learning for Avoiding Humans in Blind Spots15 Mar 2024
- 2024Socially Integrated Navigation: A Social Acting Robot with Deep Reinforcement Learning14 Mar 2024
- 2024NeuPAN: Direct Point Robot Navigation with End-to-End Model-based Learning11 Mar 2024
- 2024MATRIX: Multi-Agent Trajectory Generation with Diverse Contexts9 Mar 2024
- 2024Attention Graph for Multi-Robot Social Navigation with Deep Reinforcement Learning31 Jan 2024
- 2023Exploring Social Motion Latent Space and Human Awareness for Effective Robot Navigation in Crowded Environments11 Oct 2023
- 2023Hybrid of representation learning and reinforcement learning for dynamic and complex robotic motion planning7 Sep 2023
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecasting10 May 2023
- 2023SocNavGym: A Reinforcement Learning Gym for Social Navigation27 Apr 2023
- 2023InCrowdFormer: On-Ground Pedestrian World Model From Egocentric Views16 Mar 2023
- 2022Occlusion-Aware Crowd Navigation Using People as Sensors2 Oct 2022
- 2022DMMGAN: Diverse Multi Motion Prediction of 3D Human Joints using Attention-Based Generative Adverserial Network13 Sep 2022
- 2022Interaction Modeling with Multiplex Attention23 Aug 2022
- 2022Multi-subgoal Robot Navigation in Crowds with History Information and Interactions4 May 2022
- 2022Important Object Identification with Semi-Supervised Learning for Autonomous Driving5 Mar 2022
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graph3 Mar 2022
- 2021Relative velocity-based reward functions for crowd navigation of robots28 Dec 2021
- 2021Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigation23 Sep 2021
- 2021Optimal Solving of Constrained Path-Planning Problems with Graph Convolutional Networks and Optimized Tree Search2 Aug 2021
- 2021Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planning26 Feb 2021
- 2021A Graph Neural Network to Model Disruption in Human-Aware Robot Navigation17 Feb 2021
- 2021An advantage actor-critic algorithm for robotic motion planning in dense and dynamic scenarios5 Feb 2021
- 2021A review of motion planning algorithms for intelligent robotics4 Feb 2021
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictionscited by 10
- 2025COLSON: Controllable Learning-Based Social Navigation via Diffusion-Based Reinforcement Learningcited by 2
- 2026Crowd-FM: Learned Optimal Selection of Conditional Flow Matching-generated Trajectories for Crowd Navigationcited by 2
- 2026Diffusion Policies for Short-Horizon Planning in Robot Crowd Navigationcited by 0
- 2026SoGuDiff: Socially Guided Diffusion for Steerable, Norm-Grounded Robot Navigationcited by 0
- 2026SoGuDiff: Socially Guided Diffusion for Steerable, Norm-Grounded Robot Navigation24 Sep 2026
- 2026Diffusion Policies for Short-Horizon Planning in Robot Crowd Navigation27 Aug 2026
- 2026Crowd-FM: Learned Optimal Selection of Conditional Flow Matching-generated Trajectories for Crowd Navigation6 Feb 2026
- 2025COLSON: Controllable Learning-Based Social Navigation via Diffusion-Based Reinforcement Learning18 Mar 2025
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictions11 Mar 2025
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 46
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2022Interaction Modeling with Multiplex Attentioncited by 14
- 2022Important Object Identification with Semi-Supervised Learning for Autonomous Drivingcited by 13
- 2024MATRIX: Multi-Agent Trajectory Generation with Diverse Contextscited by 9
- 2022Occlusion-Aware Crowd Navigation Using People as Sensorscited by 8
- 2024NeuPAN: Direct Point Robot Navigation with End-to-End Model-based Learningcited by 7
- 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigationcited by 7
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environmentscited by 6
- 2024Socially Integrated Navigation: A Social Acting Robot with Deep Reinforcement Learningcited by 5
- 2021Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planningcited by 4
- 2021Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigationcited by 4
12 most cited of 33 All 33 (JSON)
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigms1 Aug 2026
- 2026Incremental Residual Reinforcement Learning Toward Real-World Learning for Social Navigation9 Apr 2026
- 2026GIANT - Global Path Integration and Attentive Graph Networks for Multi-Agent Trajectory Planning4 Mar 2026
- 2025DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments30 Dec 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario12 Sep 2025
- 2025EmoBipedNav: Emotion-aware Social Navigation for Bipedal Robots with Deep Reinforcement Learning16 Mar 2025
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments19 Nov 2024
- 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigation14 Oct 2024
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigation8 Jul 2024
- 2024Online Context Learning for Socially Compliant Navigation17 Jun 2024
- 2024Belief Aided Navigation using Bayesian Reinforcement Learning for Avoiding Humans in Blind Spots15 Mar 2024
12 newest of 33 All 33 (JSON)