From Obstacles to Etiquette: Robot Social Navigation with VLM-Informed Path Selection
Not on the map. Why?
Abstract (arXiv)
Navigating socially in human environments requires more than satisfying geometric constraints, as collision-free paths may still interfere with ongoing activities or conflict with social norms. Addressing this challenge calls for analyzing interactions between agents and incorporating common-sense reasoning into planning. This paper presents a social robot navigation framework that integrates geometric planning with contextual social reasoning. The system first extracts obstacles and human dynamics to generate geometrically feasible candidate paths, then leverages a fine-tuned vision-language model (VLM) to evaluate these paths, informed by contextually grounded social expectations, selecting a socially optimized path for the controller. This task-specific VLM distills social reasoning from large foundation models into a smaller and efficient model, allowing the framework to perform real-time adaptation in diverse human-robot interaction contexts. Experiments in four social navigation contexts demonstrate that our method achieves the best overall performance with the lowest personal space violation duration, the minimal pedestrian-facing time, and no social zone intrusions. Project page: https://path-etiquette.github.io
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
34 of 43 references.
References · 34
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
- 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMscited by 187
- 2018Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learningcited by 162
- 2017Socially Aware Motion Planning with Deep Reinforcement Learningcited by 128
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
- 2021Core Challenges of Social Robot Navigation: A Surveycited by 97
22 more
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 46
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
- 2024CoNVOI: Context-aware Navigation using Vision Language Models in Outdoor and Indoor Environmentscited by 43
- 2020Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learningcited by 36
- 2020DenseCAvoid: Real-time Navigation in Dense Crowds using Anticipatory Behaviorscited by 25
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
- 2024OLiVia-Nav: An Online Lifelong Vision Language Approach for Mobile Robot Social Navigationcited by 18
- 2021Group-based Motion Prediction for Navigation in Crowded Environmentscited by 15
- 2021Robotic Guide Dog: Leading a Human with Leash-Guided Hybrid Physical Interactioncited by 14
- 2023Rethinking Social Robot Navigation: Leveraging the Best of Two Worldscited by 14
- 2023SICNav: Safe and Interactive Crowd Navigation using Model Predictive Control and Bilevel Optimizationcited by 14
- 2024VL-TGS: Trajectory Generation and Selection using Vision Language Models in Mapless Outdoor Environmentscited by 11
- 2021Winding Through: Crowd Navigation via Topological Invariancecited by 10
- 2023Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Modelscited by 8
- 2024SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigationcited by 8
- 2024DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigationcited by 7
- 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Modelcited by 6
- 2024Arena 3.0: Advancing Social Navigation in Collaborative and Highly Dynamic Environmentscited by 5
- 2024Mixed Strategy Nash Equilibrium for Crowd Navigationcited by 3
- 2025MOSU: Autonomous Long-range Robot Navigation with Multi-modal Scene Understandingcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Enhancing Lightweight Vision Language Models through Group Competitive Learning for Socially Compliant Navigationcited by 0
- 2026Act on What You See: Unlocking Safe Social Navigation in Vision-Language-Action Modelscited by 0
- 2026Think When It Matters: Conditional VLM Reasoning for Social Navigation with RL Policiescited by 0
- 2026Commonsense-Grounded Path Planning from Abstract Instructionscited by 0
- 2026Where Should I Join? Robot Group Joining via Language-Guided Goal Predictioncited by 0
- 2026Where Should I Join? Robot Group Joining via Language-Guided Goal Prediction23 Sep 2026
- 2026Commonsense-Grounded Path Planning from Abstract Instructions19 Sep 2026
- 2026Think When It Matters: Conditional VLM Reasoning for Social Navigation with RL Policies13 Jul 2026
- 2026Act on What You See: Unlocking Safe Social Navigation in Vision-Language-Action Models9 Jun 2026
- 2026Enhancing Lightweight Vision Language Models through Group Competitive Learning for Socially Compliant Navigation12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vision-Language Models for Deployable Social Robot Navigation: Bridging Semantic Reasoning and Low-Level Control
- 2026HCSG: Human-Centric Semantic-Geometric Reasoning for Vision-Language Navigation
- 2025Assessing Human Cooperation for Enhancing Social Robot Navigation ↗
- 2026STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction
- 2024Social-LLaVA: Enhancing Robot Navigation through Human-Language Reasoning in Social Spaces
- 2025SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation
- 2025MAction-SocialNav: Multi-Action Socially Compliant Navigation via Reasoning-enhanced Prompt Tuning
- 2026G2-Nav: Grounded and Guarded Vision-Language Costmaps for Robot Social Navigation ↗