mlsanityData to 7 Oct 2026

Occlusion-Aware Crowd Navigation Using People as Sensors

arXiv 2210.00552 ↗First posted 2 Oct 2022cs.RO cs.HC cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Autonomous navigation in crowded spaces poses a challenge for mobile robots due to the highly dynamic, partially observable environment. Occlusions are highly prevalent in such settings due to a limited sensor field of view and obstructing human agents. Previous work has shown that observed interactive behaviors of human agents can be used to estimate potential obstacles despite occlusions. We propose integrating such social inference techniques into the planning pipeline. We use a variational autoencoder with a specially designed loss function to learn representations that are meaningful for occlusion inference. This work adopts a deep reinforcement learning approach to incorporate the learned representation for occlusion-aware planning. In simulation, our occlusion-aware policy achieves comparable collision avoidance performance to fully observable navigation by estimating agents in occluded spaces. We demonstrate successful policy transfer from simulation to the real-world Turtlebot 2i. To the best of our knowledge, this work is the first to use social occlusion inference for crowd navigation.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 2 Oct 2022.

Builds on

24 of 43 references.

References · 24

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2013Auto-Encoding Variational Bayescited by 3,980
  5. 2017Self-Supervised Visual Planning with Temporal Skip Connectionscited by 137
  6. 2017Socially Aware Motion Planning with Deep Reinforcement Learningcited by 128
  7. 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 104
  8. 2019Relational Graph Learning for Crowd Navigationcited by 42
  9. 2020Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learningcited by 36
  10. 2019DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPscited by 21
  11. 2020Learning-based 3D Occupancy Prediction for Autonomous Navigation in Occluded Environmentscited by 20
  12. 2019Safe Reinforcement Learning with Scene Decomposition for Navigating Complex Urban Environmentscited by 18
12 more
  1. 2019Dynamic Environment Prediction in Urban Scenes using Recurrent Representation Learningcited by 18
  2. 2020Double-Prong ConvLSTM for Spatiotemporal Occupancy Prediction in Dynamic Environmentscited by 13
  3. 2020Attention Augmented ConvLSTM for Environment Predictioncited by 12
  4. 2017Belief State Planning for Autonomously Navigating Urban Intersectionscited by 11
  5. 2017Pedestrian Prediction by Planning using Deep Neural Networkscited by 11
  6. 2019Seeing Behind Things: Extending Semantic Segmentation to Occluded Regionscited by 11
  7. 2020ROLL: Visual Self-Supervised Reinforcement Learning with Object Reasoningcited by 10
  8. 2021Multi-Agent Variational Occlusion Inference Using People as Sensorscited by 10
  9. 2017People as Sensors: Imputing Maps from Human Actionscited by 7
  10. 2019Behavior Planning of Autonomous Cars with Social Perceptioncited by 6
  11. 2019Semantic Foreground Inpainting from Weak Supervisioncited by 6
  12. 2021What we see and What we don't see: Imputing Occluded Crowd Structures from Robot Sensingcited by 1

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 5; 2025: 1.

8 papers.