mlsanityData to 7 Oct 2026

From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selection

arXiv 2602.09002 ↗First posted 9 Feb 2026cs.RO cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Navigating socially in human environments requires more than satisfying geometric constraints, as collision-free paths may still interfere with ongoing activities or conflict with social norms. Addressing this challenge calls for analyzing interactions between agents and incorporating common-sense reasoning into planning. This paper presents a social robot navigation framework that integrates geometric planning with contextual social reasoning. The system first extracts obstacles and human dynamics to generate geometrically feasible candidate paths, then leverages a fine-tuned vision-language model (VLM) to evaluate these paths, informed by contextually grounded social expectations, selecting a socially optimized path for the controller. This task-specific VLM distills social reasoning from large foundation models into a smaller and efficient model, allowing the framework to perform real-time adaptation in diverse human-robot interaction contexts. Experiments in four social navigation contexts demonstrate that our method achieves the best overall performance with the lowest personal space violation duration, the minimal pedestrian-facing time, and no social zone intrusions. Project page: https://path-etiquette.github.io

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

34 of 43 references.

References · 34

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
  4. 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
  5. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
  6. 2023ViNT: A Foundation Model for Visual Navigationcited by 210
  7. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
  8. 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMscited by 187
  9. 2018Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learningcited by 162
  10. 2017Socially Aware Motion Planning with Deep Reinforcement Learningcited by 128
  11. 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
  12. 2021Core Challenges of Social Robot Navigation: A Surveycited by 97
22 more
  1. 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
  2. 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
  3. 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 46
  4. 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
  5. 2024CoNVOI: Context-aware Navigation using Vision Language Models in Outdoor and Indoor Environmentscited by 43
  6. 2020Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learningcited by 36
  7. 2020DenseCAvoid: Real-time Navigation in Dense Crowds using Anticipatory Behaviorscited by 25
  8. 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
  9. 2024OLiVia-Nav: An Online Lifelong Vision Language Approach for Mobile Robot Social Navigationcited by 18
  10. 2021Group-based Motion Prediction for Navigation in Crowded Environmentscited by 15
  11. 2021Robotic Guide Dog: Leading a Human with Leash-Guided Hybrid Physical Interactioncited by 14
  12. 2023Rethinking Social Robot Navigation: Leveraging the Best of Two Worldscited by 14
  13. 2023SICNav: Safe and Interactive Crowd Navigation using Model Predictive Control and Bilevel Optimizationcited by 14
  14. 2024VL-TGS: Trajectory Generation and Selection using Vision Language Models in Mapless Outdoor Environmentscited by 11
  15. 2021Winding Through: Crowd Navigation via Topological Invariancecited by 10
  16. 2023Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Modelscited by 8
  17. 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigationcited by 8
  18. 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigationcited by 7
  19. 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Modelcited by 6
  20. 2024Arena 3.0: Advancing Social Navigation in Collaborative and Highly Dynamic Environmentscited by 5
  21. 2024Mixed Strategy Nash Equilibrium for Crowd Navigationcited by 3
  22. 2025MOSU: Autonomous Long-range Robot Navigation with Multi-modal Scene Understandingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-Language Models for Deployable Social Robot Navigation: Bridging Semantic Reasoning and Low-Level Control
  2. 2026HCSG: Human-Centric Semantic-Geometric Reasoning for Vision-Language Navigation
  3. 2025Assessing Human Cooperation for Enhancing Social Robot Navigation ↗
  4. 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction
  5. 2024Social-LLaVA: Enhancing Robot Navigation through Human-Language Reasoning in Social Spaces
  6. 2025SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation
  7. 2025MAction-SocialNav: Multi-Action Socially Compliant Navigation via Reasoning-enhanced Prompt Tuning
  8. 2026G2-Nav: Grounded and Guarded Vision-Language Costmaps for Robot Social Navigation ↗