mlsanityData to 14 Oct 2026

HumAIN: Human-Aware Implicit Social Robot Navigation

arXiv 2607.07357 ↗First posted 8 Jul 2026cs.RO cs.AIcited by 0

On the map: Knowledge distillation → Multimodal distillation

Abstract (arXiv)

Effective social robot navigation requires sensitivity to human behavior, often revealed through subtle skeletal cues like gait and orientation. We present Human-Aware Implicit Social Robot Navigation (HumAIN), a novel framework that fuses implicit social cues directly into the planning loop via knowledge distillation. We first employ a transformer-based teacher model that fuses rich multi-modal inputs, including historic images, skeletal keypoints, robot state, and a robot's target goal, to learn robust, human-aware representations for the robot's future trajectory planning. To enable real-time deployment, we then distill this knowledge into a lightweight student model. By optimizing for both trajectory reconstruction and latent feature alignment with the teacher, the student learns to infer complex social dynamics from minimal inputs. Bridging the prediction-planning gap with an efficient distilled architecture, our method enables robots to reason about human behavior in a manner that is adaptive, robust, and socially compliant. We validate HumAIN through extensive experiments, where it improves trajectory prediction metrics by an average of 29.8% across all metrics compared to state-of-the-art baselines. These results highlight the benefit of using implicit, whole-body cues to achieve human-like navigation awareness on resource-constrained platforms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal distillation, one of 12 directions in Knowledge distillation. Builds on 33 of its 46 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

33 of 46 references.

References · 33

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Knowledge Distillation: A Surveycited by 1,603
  3. 2025DINOv3cited by 1,414
  4. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  5. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
  6. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
  7. 2023ViNT: A Foundation Model for Visual Navigationcited by 222
  8. 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
  9. 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 127
  10. 2017PRM-RL: Long-range Robotic Navigation Tasks by Combining Reinforcement Learning and Sampling-based Planningcited by 69
  11. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 69
  12. 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 56
21 more
  1. 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
  2. 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 41
  3. 2023Social-Transmotion: Promptable Human Trajectory Predictioncited by 33
  4. 2021VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigationcited by 31
  5. 2023Toward Human-Like Social Robot Navigation: A Large-Scale, Multi-Modal, Social Human Navigation Datasetcited by 31
  6. 2023Robots That Can See: Leveraging Human Pose for Trajectory Predictioncited by 23
  7. 2021APPL: Adaptive Planner Parameter Learningcited by 20
  8. 2020APPLI: Adaptive Planner Parameter Learning From Interventionscited by 19
  9. 2024OLiVia-Nav: An Online Lifelong Vision Language Approach for Mobile Robot Social Navigationcited by 18
  10. 2020ProxEmo: Gait-based Emotion Learning and Multi-view Proxemic Fusion for Socially-Aware Robot Navigationcited by 17
  11. 2023Rethinking Social Robot Navigation: Leveraging the Best of Two Worldscited by 15
  12. 2021Conflict Avoidance in Social Navigation -- a Surveycited by 14
  13. 2023From Crowd Motion Prediction to Robot Navigation in Crowdscited by 13
  14. 2023NaviSTAR: Socially Aware Robot Navigation with Hybrid Spatio-Temporal Graph Transformer and Preference Learningcited by 13
  15. 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowdscited by 6
  16. 2024VANP: Learning Where to See for Navigation with Self-Supervised Vision-Action Pre-Trainingcited by 5
  17. 2025Social-Pose: Enhancing Trajectory Prediction with Human Body Posecited by 5
  18. 2025MAction-SocialNav: Multi-Action Socially Compliant Navigation via Reasoning-enhanced Prompt Tuningcited by 3
  19. 2025Narrate2Nav: Real-Time Visual Navigation with Implicit Language Reasoning in Human-Centric Environmentscited by 2
  20. 2024VertiCoder: Self-Supervised Kinodynamic Representation Learning on Vertically Challenging Terraincited by 1
  21. 2025UPTor: Unified 3D Human Pose Dynamics and Trajectory Prediction for Human-Robot Interactioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches
  2. 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation
  3. 2026Social-WM: Safety-Aware Latent World Models for Robot Social Navigation
  4. 2021SOCIALGYM: A Framework for Benchmarking Social Robot Navigation
  5. 2022Gesture2Path: Imitation Learning for Gesture-aware Navigation
  6. 2024Learning Early Social Maneuvers for Enhanced Social Navigation ↗
  7. 2026SOPD-SocialNav: Selective On-Policy Distillation for Vision-Language Social Navigation
  8. 2025SocialNav-Map: Dynamic Mapping with Human Trajectory Prediction for Zero-Shot Social Navigation