mlsanityData to 14 Oct 2026

Sixth-Sense: Self-Supervised Learning of Spatial Awareness of Humans from a Planar Lidar

arXiv 2502.21029 ↗First posted 28 Feb 2025cs.RO cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable localization of people is fundamental for service and social robots that must operate in close interaction with humans. State-of-the-art human detectors often rely on RGB-D cameras or costly 3D LiDARs. However, most commercial robots are equipped with cameras with a narrow field of view, leaving them unaware of users approaching from other directions, or inexpensive 1D LiDARs whose readings are hard to interpret. To address these limitations, we propose a self-supervised approach to detect humans and estimate their 2D pose from 1D LiDAR data, using detections from an RGB-D camera as supervision. Trained on 70 minutes of autonomously collected data, our model detects humans omnidirectionally in unseen environments with 71% precision, 80% recall, and mean absolute errors of 13cm in distance and 44deg in orientation, measured against ground truth data. Beyond raw detection accuracy, this capability is relevant for robots operating in shared public spaces, where omnidirectional awareness of nearby people is crucial for safe navigation, appropriate approach behavior, and timely human-robot interaction initiation using low-cost, privacy-preserving sensing. Deployment in two additional public environments further suggests that the approach can serve as a practical wide-FOV awareness layer for socially aware service robotics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 24 references that are in the map. First posted on arXiv 28 Feb 2025.

Builds on

9 of 24 references.

References · 9

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  3. 20203D Human Motion Estimation via Motion Compression and Refinementcited by 98
  4. 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
  5. 2021Uncertainty-Aware Self-Supervised Learning of Spatial Perception Taskscited by 8
  6. 2023Self-Supervised Prediction of the Intention to Interact with a Service Robotcited by 7
  7. 2018Learning Long-Range Perception Using Self-Supervision from Short-Range Sensors and Odometrycited by 5
  8. 2024Predicting the Intention to Interact with a Service Robot:the Role of Gaze Cuescited by 5
  9. 2024A Service Robot in the Wild: Analysis of Users Intentions, Robot Behaviors, and Their Impact on the Interactioncited by 1

Built on by

Not cited yet.