Occlusion-Aware Crowd Navigation Using People as Sensors
Not on the map. Why?
Abstract (arXiv)
Autonomous navigation in crowded spaces poses a challenge for mobile robots due to the highly dynamic, partially observable environment. Occlusions are highly prevalent in such settings due to a limited sensor field of view and obstructing human agents. Previous work has shown that observed interactive behaviors of human agents can be used to estimate potential obstacles despite occlusions. We propose integrating such social inference techniques into the planning pipeline. We use a variational autoencoder with a specially designed loss function to learn representations that are meaningful for occlusion inference. This work adopts a deep reinforcement learning approach to incorporate the learned representation for occlusion-aware planning. In simulation, our occlusion-aware policy achieves comparable collision avoidance performance to fully observable navigation by estimating agents in occluded spaces. We demonstrate successful policy transfer from simulation to the real-world Turtlebot 2i. To the best of our knowledge, this work is the first to use social occlusion inference for crowd navigation.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 2 Oct 2022.
Builds on
24 of 43 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2017Self-Supervised Visual Planning with Temporal Skip Connectionscited by 137
- 2017Socially Aware Motion Planning with Deep Reinforcement Learningcited by 128
- 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 104
- 2019Relational Graph Learning for Crowd Navigationcited by 42
- 2020Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learningcited by 36
- 2019DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPscited by 21
- 2020Learning-based 3D Occupancy Prediction for Autonomous Navigation in Occluded Environmentscited by 20
- 2019Safe Reinforcement Learning with Scene Decomposition for Navigating Complex Urban Environmentscited by 18
12 more
- 2019Dynamic Environment Prediction in Urban Scenes using Recurrent Representation Learningcited by 18
- 2020Double-Prong ConvLSTM for Spatiotemporal Occupancy Prediction in Dynamic Environmentscited by 13
- 2020Attention Augmented ConvLSTM for Environment Predictioncited by 12
- 2017Belief State Planning for Autonomously Navigating Urban Intersectionscited by 11
- 2017Pedestrian Prediction by Planning using Deep Neural Networkscited by 11
- 2019Seeing Behind Things: Extending Semantic Segmentation to Occluded Regionscited by 11
- 2020ROLL: Visual Self-Supervised Reinforcement Learning with Object Reasoningcited by 10
- 2021Multi-Agent Variational Occlusion Inference Using People as Sensorscited by 10
- 2017People as Sensors: Imputing Maps from Human Actionscited by 7
- 2019Behavior Planning of Autonomous Cars with Social Perceptioncited by 6
- 2019Semantic Foreground Inpainting from Weak Supervisioncited by 6
- 2021What we see and What we don't see: Imputing Occluded Crowd Structures from Robot Sensingcited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 1.
8 papers.
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environmentscited by 14
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigationcited by 8
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environmentscited by 6
- 2024Disentangling Uncertainty for Safe Social Navigation using Deep Reinforcement Learningcited by 2
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approachescited by 2
- 2024Belief Aided Navigation using Bayesian Reinforcement Learning for Avoiding Humans in Blind Spotscited by 0
- 2024Structured Graph Network for Constrained Robot Crowd Navigation with Low Fidelity Simulationcited by 0
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments19 Nov 2024
- 2024Disentangling Uncertainty for Safe Social Navigation using Deep Reinforcement Learning16 Sep 2024
- 2024Structured Graph Network for Constrained Robot Crowd Navigation with Low Fidelity Simulation27 May 2024
- 2024Belief Aided Navigation using Bayesian Reinforcement Learning for Avoiding Humans in Blind Spots15 Mar 2024
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigation1 Mar 2024
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environments25 Sep 2023
- 2023SACSoN: Scalable Autonomous Control for Social Navigation2 Jun 2023