Socially Aware Motion Planning with Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
For robotic vehicles to navigate safely and efficiently in pedestrian-rich environments, it is important to model subtle human behaviors and navigation rules (e.g., passing on the right). However, while instinctive to humans, socially compliant navigation is still difficult to quantify due to the stochasticity in people's behaviors. Existing works are mostly focused on using feature-matching techniques to describe and imitate human paths, but often do not generalize well since the feature values can vary from person to person, and even run to run. This work notes that while it is challenging to directly specify the details of what to do (precise mechanisms of human navigation), it is straightforward to specify what not to do (violations of social norms). Specifically, using deep reinforcement learning, this work develops a time-efficient navigation policy that respects common social norms. The proposed method is shown to enable fully autonomous navigation of a robotic vehicle moving at human walking speed in an environment with many pedestrians.
Key facts. Cited by 128 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 22; 2023: 24; 2024: 23; 2025: 16; 2026: 11.
128 papers.
Sort:
By area:
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2021Memory-based Deep Reinforcement Learning for POMDPscited by 53
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 46
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2021Social Coordination and Altruism in Autonomous Drivingcited by 28
- 2021Explainable Reinforcement Learning for Broad-XAI: A Conceptual Framework and Surveycited by 24
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2022Safe Reinforcement Learning Using Black-Box Reachability Analysiscited by 22
38 more
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2021Where to go next: Learning a Subgoal Recommendation Policy for Navigation Among Pedestrianscited by 20
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
- 2023On the Convergence and Sample Complexity Analysis of Deep Q-Networks with ε-Greedy Explorationcited by 17
- 2023ViHOPE: Visuotactile In-Hand Object 6D Pose Estimation with Shape Completioncited by 14
- 2021Risk-Conditioned Distributional Soft Actor-Critic for Risk-Sensitive Navigationcited by 13
- 2021Conflict Avoidance in Social Navigation -- a Surveycited by 13
- 2021Arena-Rosnav: Towards Deployment of Deep-Reinforcement-Learning-Based Obstacle Avoidance into Conventional Autonomous Navigation Systemscited by 12
- 2022A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learningcited by 12
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
- 2021From Learning to Relearning: A Framework for Diminishing Bias in Social Robot Navigationcited by 11
- 2022Position-Agnostic Autonomous Navigation in Vineyards with Deep Reinforcement Learningcited by 11
- 2021Learning Sparse Interaction Graphs of Partially Detected Pedestrians for Trajectory Predictioncited by 10
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigationcited by 10
- 2025SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigationcited by 10
- 2021Efficient Performance Bounds for Primal-Dual Reinforcement Learning from Demonstrationscited by 9
- 2023HabiCrowd: A High Performance Simulator for Crowd-Aware Visual Navigationcited by 9
- 2022Occlusion-Aware Crowd Navigation Using People as Sensorscited by 8
- 2023Sequential Neural Barriers for Scalable Dynamic Obstacle Avoidancecited by 8
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigationcited by 8
- 2021Human-Inspired Multi-Agent Navigation using Knowledge Distillationcited by 7
- 2022Federated Reinforcement Learning for Collective Navigation of Robotic Swarmscited by 7
- 2022NavDreams: Towards Camera-Only RL Navigation Among Humanscited by 7
- 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigationcited by 7
- 2025Discrete GCBF Proximal Policy Optimization for Multi-agent Safe Optimal Controlcited by 7
- 2025Multi-Agent LLM Actor-Critic Framework for Social Robot Navigationcited by 7
- 2022SOCIALMAPF: Optimal and Efficient Multi-Agent Path Finding with Strategic Agents for Social Navigationcited by 6
- 2022Exploiting Proximity-Aware Tasks for Embodied Social Navigationcited by 6
- 2024REValueD: Regularised Ensemble Value-Decomposition for Factorisable Markov Decision Processescited by 6
- 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Modelcited by 6
- 2021Connecting Deep-Reinforcement-Learning-based Obstacle Avoidance with Conventional Global Planners using Waypoint Generatorscited by 5
- 2021Benchmarking Augmentation Methods for Learning Robust Navigation Agents: the Winning Entry of the 2021 iGibson Challengecited by 5
- 2024Socially Integrated Navigation: A Social Acting Robot with Deep Reinforcement Learningcited by 5
- 2024Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Spacecited by 5
- 2026From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selectioncited by 5
- 2021Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planningcited by 4
- 2021Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigationcited by 4
- 2021Multi-agent Soft Actor-Critic Based Hybrid Motion Planner for Mobile Robotscited by 4
50 most cited of 128 All 128 (JSON)
- 2026A Convergence Framework for Deep V-Learning: Error Propagation and Sharp Action-Gap Bounds16 Sep 2026
- 2026PRISM: Predictive Representation of Interaction Style and Motion for Social Robot Navigation16 Sep 2026
- 2026SRL-MPC: Shape-Aware Reinforcement Learned Model Predictive Control21 Aug 2026
- 2026Towards Socially Compliant Navigation in Deep Reinforcement Learning via Proxemics-Based Reward Modeling13 Aug 2026
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigms1 Aug 2026
- 2026JPPD: Joint Prediction_Planning Diffusion with Differentiable Safety Guidance for Dynamic Obstacle Avoidance in Intelligent Transportation Systems14 Jun 2026
- 2026Act on What You See: Unlocking Safe Social Navigation in Vision-Language-Action Models9 Jun 2026
- 2026Incremental Residual Reinforcement Learning Toward Real-World Learning for Social Navigation9 Apr 2026
- 2026AutoTraces: Autoregressive Trajectory Forecasting via Multimodal Large Language Models9 Mar 2026
- 2026Don't Freeze, Don't Crash: Extending the Safe Operating Range of Neural Navigation in Dense Crowds6 Mar 2026
- 2026From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selection9 Feb 2026
- 2025Hybrid Motion Planning with Deep Reinforcement Learning for Mobile Robot Navigation31 Dec 2025
38 more
- 2025Intrinsic-Motivation Multi-Robot Social Formation Navigation with Coordinated Exploration15 Dec 2025
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation26 Nov 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025CoFineLLM: Conformal Finetuning of LLMs for Language-Instructed Robot Planning9 Nov 2025
- 2025Learning to Navigate Socially Through Proactive Risk Perception9 Oct 2025
- 2025Integrating Offline Pre-Training with Online Fine-Tuning: A Reinforcement Learning Approach for Robot Social Navigation1 Oct 2025
- 2025ComposableNav: Instruction-Following Navigation in Dynamic Environments via Composable Diffusion22 Sep 2025
- 2025SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation10 Sep 2025
- 2025Accelerated Learning with Linear Temporal Logic using Differentiable Simulation1 Jun 2025
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARL21 Apr 2025
- 2025COLSON: Controllable Learning-Based Social Navigation via Diffusion-Based Reinforcement Learning18 Mar 2025
- 2025Multi-Agent LLM Actor-Critic Framework for Social Robot Navigation12 Mar 2025
- 2025Discrete GCBF Proximal Policy Optimization for Multi-agent Safe Optimal Control5 Feb 2025
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learning12 Jan 2025
- 2025In Search of a Lost Metric: Human Empowerment as a Pillar of Socially Conscious Navigation2 Jan 2025
- 2024Improving the Generalization of Unseen Crowd Behaviors for Reinforcement Learning based Local Motion Planners16 Oct 2024
- 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigation14 Oct 2024
- 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Model26 Sep 2024
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigation20 Sep 2024
- 2024Arena 4.0: A Comprehensive ROS2 Development and Benchmarking Platform for Human-centric Navigation Using Generative-Model-based Environment Generation19 Sep 2024
- 2024Robot Navigation with Entity-Based Collision Avoidance using Deep Reinforcement Learning26 Aug 2024
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes7 Aug 2024
- 2024Context-aware Mamba-based Reinforcement Learning for social robot navigation5 Aug 2024
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigation8 Jul 2024
- 2024Online Context Learning for Socially Compliant Navigation17 Jun 2024
- 2024Scaling Value Iteration Networks to 5000 Layers for Extreme Long-Term Planning12 Jun 2024
- 2024Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space22 May 2024
- 2024Following the Human Thread in Social Navigation17 Apr 2024
- 2024Learning Strategies For Successful Crowd Navigation9 Apr 2024
- 2024Towards Human-Centered Construction Robotics: A Reinforcement Learning-Driven Companion Robot for Contextually Assisting Carpentry Workers27 Mar 2024
- 2024Unifying Large Language Model and Deep Reinforcement Learning for Human-in-Loop Interactive Socially-aware Navigation22 Mar 2024
- 2024ODTFormer: Efficient Obstacle Detection and Tracking with Stereo Cameras Based on Transformer21 Mar 2024
- 2024Socially Integrated Navigation: A Social Acting Robot with Deep Reinforcement Learning14 Mar 2024
- 2024Mixed Strategy Nash Equilibrium for Crowd Navigation3 Mar 2024
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigation1 Mar 2024
- 2024Attention Graph for Multi-Robot Social Navigation with Deep Reinforcement Learning31 Jan 2024
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigation22 Jan 2024
- 2024REValueD: Regularised Ensemble Value-Decomposition for Factorisable Markov Decision Processes16 Jan 2024
50 newest of 128 All 128 (JSON)
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
- 2021Efficient Performance Bounds for Primal-Dual Reinforcement Learning from Demonstrationscited by 9
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learningcited by 3
- 2022SoLo T-DIRL: Socially-Aware Dynamic Local Planner based on Trajectory-Ranked Deep Inverse Reinforcement Learningcited by 2
- 2021Sample Efficient Social Navigation Using Inverse Reinforcement Learningcited by 1
- 2025Integrating Offline Pre-Training with Online Fine-Tuning: A Reinforcement Learning Approach for Robot Social Navigationcited by 0
- 2025Integrating Offline Pre-Training with Online Fine-Tuning: A Reinforcement Learning Approach for Robot Social Navigation1 Oct 2025
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learning12 Jan 2025
- 2022SoLo T-DIRL: Socially-Aware Dynamic Local Planner based on Trajectory-Ranked Deep Inverse Reinforcement Learning16 Sep 2022
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation28 Mar 2022
- 2021Efficient Performance Bounds for Primal-Dual Reinforcement Learning from Demonstrations28 Dec 2021
- 2021Sample Efficient Social Navigation Using Inverse Reinforcement Learning18 Jun 2021
- 2021Social Coordination and Altruism in Autonomous Drivingcited by 28
- 2024Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Spacecited by 5
- 2022Don't Watch Me: A Spatio-Temporal Trojan Attack on Deep-Reinforcement-Learning-Augment Autonomous Drivingcited by 3
- 2022Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Drivingcited by 3
- 2023Imagination-Augmented Hierarchical Reinforcement Learning for Safe and Interactive Autonomous Driving in Urban Environmentscited by 3
- 2024Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space22 May 2024
- 2023Imagination-Augmented Hierarchical Reinforcement Learning for Safe and Interactive Autonomous Driving in Urban Environments17 Nov 2023
- 2022Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Driving30 Dec 2022
- 2022Don't Watch Me: A Spatio-Temporal Trojan Attack on Deep-Reinforcement-Learning-Augment Autonomous Driving22 Nov 2022
- 2021Social Coordination and Altruism in Autonomous Driving1 Jul 2021
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2021Memory-based Deep Reinforcement Learning for POMDPscited by 53
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 46
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2021Explainable Reinforcement Learning for Broad-XAI: A Conceptual Framework and Surveycited by 24
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2022Safe Reinforcement Learning Using Black-Box Reachability Analysiscited by 22
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2021Where to go next: Learning a Subgoal Recommendation Policy for Navigation Among Pedestrianscited by 20
12 most cited of 110 All 110 (JSON)
- 2026A Convergence Framework for Deep V-Learning: Error Propagation and Sharp Action-Gap Bounds16 Sep 2026
- 2026PRISM: Predictive Representation of Interaction Style and Motion for Social Robot Navigation16 Sep 2026
- 2026SRL-MPC: Shape-Aware Reinforcement Learned Model Predictive Control21 Aug 2026
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigms1 Aug 2026
- 2026JPPD: Joint Prediction_Planning Diffusion with Differentiable Safety Guidance for Dynamic Obstacle Avoidance in Intelligent Transportation Systems14 Jun 2026
- 2026Incremental Residual Reinforcement Learning Toward Real-World Learning for Social Navigation9 Apr 2026
- 2026Don't Freeze, Don't Crash: Extending the Safe Operating Range of Neural Navigation in Dense Crowds6 Mar 2026
- 2026From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selection9 Feb 2026
- 2025Hybrid Motion Planning with Deep Reinforcement Learning for Mobile Robot Navigation31 Dec 2025
- 2025Intrinsic-Motivation Multi-Robot Social Formation Navigation with Coordinated Exploration15 Dec 2025
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation26 Nov 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
12 newest of 110 All 110 (JSON)