Core Challenges of Social Robot Navigation: A Survey
Not on the map. Why?
Abstract (arXiv)
Robot navigation in crowded public spaces is a complex task that requires addressing a variety of engineering and human factors challenges. These challenges have motivated a great amount of research resulting in important developments for the fields of robotics and human-robot interaction over the past three decades. Despite the significant progress and the massive recent interest, we observe a number of significant remaining challenges that prohibit the seamless deployment of autonomous robots in public pedestrian environments. In this survey article, we organize existing challenges into a set of categories related to broader open problems in motion planning, behavior design, and evaluation methodologies. Within these categories, we review past work, and offer directions for future research. Our work builds upon and extends earlier survey efforts by a) taking a critical perspective and diagnosing fundamental limitations of adopted practices in the field and b) offering constructive feedback and ideas that we aspire will drive research in the field over the coming decade.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Mar 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 9; 2023: 14; 2024: 29; 2025: 30; 2026: 12.
97 papers.
Sort:
By area:
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 61
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
- 2025TrackVLA: Embodied Visual Tracking in the Wildcited by 46
- 2024ExACT: Language-guided Conceptual Reasoning and Uncertainty Estimation for Event-based Action Recognition and Morecited by 33
- 2021Core Challenges in Embodied Vision-Language Planningcited by 30
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigationcited by 27
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Modelscited by 27
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
- 2024Active Test-Time Adaptation: Theoretical Analyses and An Algorithmcited by 18
- 2021Conflict Avoidance in Social Navigation -- a Surveycited by 13
38 more
- 2025EgoNormia: Benchmarking Physical Social Norm Understandingcited by 13
- 2022EvolveHypergraph: Group-Aware Dynamic Relational Reasoning for Trajectory Predictioncited by 10
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigationcited by 10
- 2024SpikMamba: When SNN meets Mamba in Event-based Human Action Recognitioncited by 10
- 2025SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigationcited by 10
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigationcited by 8
- 2022SOCIALMAPF: Optimal and Efficient Multi-Agent Path Finding with Strategic Agents for Social Navigationcited by 6
- 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Modelcited by 6
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environmentscited by 6
- 2022A Cognitive Framework for Delegation Between Error-Prone AI and Human Agentscited by 5
- 2023SOCIALGYM 2.0: Simulator for Multi-Agent Social Robot Navigation in Shared Human Spacescited by 5
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Datacited by 5
- 2024Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgerycited by 5
- 2024Socially Integrated Navigation: A Social Acting Robot with Deep Reinforcement Learningcited by 5
- 2024Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Spacecited by 5
- 2025ViLAM: Distilling Vision-Language Reasoning into Attention Maps for Social Robot Navigationcited by 5
- 2025TrajEvo: Designing Trajectory Prediction Heuristics via LLM-driven Evolutioncited by 5
- 2025TrajEvo: Trajectory Prediction Heuristics Design via LLM-driven Evolutioncited by 5
- 2025Towards Generalizable Safety in Crowd Navigation via Conformal Uncertainty Handlingcited by 5
- 2025Social 3D Scene Graphs: Modeling Human Actions and Relations for Interactive Service Robotscited by 5
- 2025SocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-Tuningcited by 5
- 2026From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selectioncited by 5
- 2022T2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Predictioncited by 4
- 2023A Study on Learning Social Robot Navigation with Multimodal Perceptioncited by 4
- 2024Long-Term Typhoon Trajectory Prediction: A Physics-Conditioned Approach Without Reanalysis Datacited by 4
- 2024Attention Graph for Multi-Robot Social Navigation with Deep Reinforcement Learningcited by 4
- 2024Unifying Large Language Model and Deep Reinforcement Learning for Human-in-Loop Interactive Socially-aware Navigationcited by 4
- 2025HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interactioncited by 4
- 2025Artificial Intelligent Disobedience: Rethinking the Agency of Our Artificial Teammatescited by 4
- 2022Gesture2Path: Imitation Learning for Gesture-aware Navigationcited by 3
- 2022Learning Social Navigation from Demonstrations with Conditional Neural Processescited by 3
- 2023SocNavGym: A Reinforcement Learning Gym for Social Navigationcited by 3
- 2023Optimizing Algorithms From Pairwise User Preferencescited by 3
- 2024Mixed Strategy Nash Equilibrium for Crowd Navigationcited by 3
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learningcited by 3
- 2025EgoCogNav: Cognition-aware Human Egocentric Navigationcited by 3
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigationcited by 3
- 2023Decentralized Social Navigation with Non-Cooperative Robots via Bi-Level Optimizationcited by 2
50 most cited of 97 All 97 (JSON)
- 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction30 Sep 2026
- 2026SoGuDiff: Socially Guided Diffusion for Steerable, Norm-Grounded Robot Navigation24 Sep 2026
- 2026LEAP-NBV: Lightweight Edge Active-Perception for Foundation-Model Next-Best-View Planning21 Sep 2026
- 2026Towards Socially Compliant Navigation in Deep Reinforcement Learning via Proxemics-Based Reward Modeling13 Aug 2026
- 2026Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming27 Jul 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026EvoNav: Evolutionary Reward Function Design for Robot Navigation with Large Language Models12 May 2026
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigation29 Mar 2026
- 2026Enhancing Lightweight Vision Language Models through Group Competitive Learning for Socially Compliant Navigation12 Mar 2026
- 2026Improving through Interaction: Searching Behavioral Representation Spaces with CMA-ES-IG9 Mar 2026
- 2026OSIL: Learning Offline Safe Imitation Policies with Safety Inferred from Non-preferred Trajectories11 Feb 2026
- 2026From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selection9 Feb 2026
38 more
- 2025Few-Shot Inference of Human Perceptions of Robot Performance in Social Navigation Scenarios17 Dec 2025
- 2025SocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-Tuning15 Dec 2025
- 2025SINRL: Socially Integrated Navigation with Reinforcement Learning using Spiking Neural Networks8 Dec 2025
- 2025QuickLAP: Quick Language-Action Preference Learning for Semi-Autonomous Agents22 Nov 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025FreeAskWorld: An Interactive and Closed-Loop Simulator for Human-Centric Embodied AI17 Nov 2025
- 2025EgoCogNav: Cognition-aware Human Egocentric Navigation15 Nov 2025
- 2025Learning to Navigate Socially Through Proactive Risk Perception9 Oct 2025
- 2025Social 3D Scene Graphs: Modeling Human Actions and Relations for Interactive Service Robots29 Sep 2025
- 2025SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation10 Sep 2025
- 2025Learning Social Heuristics for Human-Aware Path Planning2 Sep 2025
- 2025A Lightweight Crowd Model for Robot Social Navigation27 Aug 2025
- 2025Towards Generalizable Safety in Crowd Navigation via Conformal Uncertainty Handling7 Aug 2025
- 2025TrajEvo: Trajectory Prediction Heuristics Design via LLM-driven Evolution7 Aug 2025
- 2025Artificial Intelligent Disobedience: Rethinking the Agency of Our Artificial Teammates27 Jun 2025
- 2025HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interaction25 Jun 2025
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuning20 Jun 2025
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Models17 Jun 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Leveraging Analytic Gradients in Provably Safe Reinforcement Learning2 Jun 2025
- 2025TrackVLA: Embodied Visual Tracking in the Wild29 May 2025
- 2025Enhancing Robot Navigation Policies with Task-Specific Uncertainty Managements20 May 2025
- 2025TrajEvo: Designing Trajectory Prediction Heuristics via LLM-driven Evolution7 May 2025
- 2025Future-Oriented Navigation: Dynamic Obstacle Avoidance with One-Shot Energy-Based Multimodal Motion Prediction1 May 2025
- 2025Causality-enhanced Decision-Making for Autonomous Mobile Robots in Dynamic Environments16 Apr 2025
- 2025ViLAM: Distilling Vision-Language Reasoning into Attention Maps for Social Robot Navigation12 Mar 2025
- 2025EgoNormia: Benchmarking Physical Social Norm Understanding27 Feb 2025
- 2025Learning Priors of Human Motion With Vision Transformers30 Jan 2025
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learning12 Jan 2025
- 2025In Search of a Lost Metric: Human Empowerment as a Pillar of Socially Conscious Navigation2 Jan 2025
- 2024SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms27 Dec 2024
- 2024TH"OR-MAGNI Act: Actions for Human Motion Modeling in Robot-Shared Industrial Spaces18 Dec 2024
- 2024SANGO: Socially Aware Navigation through Grouped Obstacles29 Nov 2024
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments19 Nov 2024
- 2024Geometric Graph Neural Network Modeling of Human Interactions in Crowded Environments22 Oct 2024
- 2024SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition22 Oct 2024
- 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Model26 Sep 2024
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigation20 Sep 2024
50 newest of 97 All 97 (JSON)
- 2022Gesture2Path: Imitation Learning for Gesture-aware Navigationcited by 3
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learningcited by 3
- 2024ARMCHAIR: integrated inverse reinforcement learning and model predictive control for human-robot collaborationcited by 2
- 2026OSIL: Learning Offline Safe Imitation Policies with Safety Inferred from Non-preferred Trajectoriescited by 1
- 2024Navigating the Human Maze: Real-Time Robot Pathfinding with Generative Imitation Learningcited by 0
- 2026OSIL: Learning Offline Safe Imitation Policies with Safety Inferred from Non-preferred Trajectories11 Feb 2026
- 2025Learning Implicit Social Navigation Behavior using Deep Inverse Reinforcement Learning12 Jan 2025
- 2024Navigating the Human Maze: Real-Time Robot Pathfinding with Generative Imitation Learning7 Aug 2024
- 2024ARMCHAIR: integrated inverse reinforcement learning and model predictive control for human-robot collaboration29 Feb 2024
- 2022Gesture2Path: Imitation Learning for Gesture-aware Navigation19 Sep 2022
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
- 2025SocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-Tuningcited by 5
- 2025HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interactioncited by 4
- 2026Enhancing Lightweight Vision Language Models through Group Competitive Learning for Socially Compliant Navigationcited by 0
- 2026Enhancing Lightweight Vision Language Models through Group Competitive Learning for Socially Compliant Navigation12 Mar 2026
- 2025SocialNav-MoE: A Mixture-of-Experts Vision Language Model for Socially Compliant Navigation with Reinforcement Fine-Tuning15 Dec 2025
- 2025HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interaction25 Jun 2025
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Models30 Mar 2024
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 61
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
- 2025TrackVLA: Embodied Visual Tracking in the Wildcited by 46
- 2024ExACT: Language-guided Conceptual Reasoning and Uncertainty Estimation for Event-based Action Recognition and Morecited by 33
- 2021Core Challenges in Embodied Vision-Language Planningcited by 30
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigationcited by 27
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
- 2024Active Test-Time Adaptation: Theoretical Analyses and An Algorithmcited by 18
- 2021Conflict Avoidance in Social Navigation -- a Surveycited by 13
- 2025EgoNormia: Benchmarking Physical Social Norm Understandingcited by 13
- 2022EvolveHypergraph: Group-Aware Dynamic Relational Reasoning for Trajectory Predictioncited by 10
12 most cited of 80 All 80 (JSON)
- 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction30 Sep 2026
- 2026LEAP-NBV: Lightweight Edge Active-Perception for Foundation-Model Next-Best-View Planning21 Sep 2026
- 2026Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming27 Jul 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026EvoNav: Evolutionary Reward Function Design for Robot Navigation with Large Language Models12 May 2026
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigation29 Mar 2026
- 2026Improving through Interaction: Searching Behavioral Representation Spaces with CMA-ES-IG9 Mar 2026
- 2026From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selection9 Feb 2026
- 2025Few-Shot Inference of Human Perceptions of Robot Performance in Social Navigation Scenarios17 Dec 2025
- 2025SINRL: Socially Integrated Navigation with Reinforcement Learning using Spiking Neural Networks8 Dec 2025
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025FreeAskWorld: An Interactive and Closed-Loop Simulator for Human-Centric Embodied AI17 Nov 2025
12 newest of 80 All 80 (JSON)