Multi-Agent LLM Actor-Critic Framework for Social Robot Navigation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Recent advances in robotics and large language models (LLMs) have sparked growing interest in human-robot collaboration and embodied intelligence. To enable the broader deployment of robots in human-populated environments, socially-aware robot navigation (SAN) has become a key research area. While deep reinforcement learning approaches that integrate human-robot interaction (HRI) with path planning have demonstrated strong benchmark performance, they often struggle to adapt to new scenarios and environments. LLMs offer a promising avenue for zero-shot navigation through commonsense inference. However, most existing LLM-based frameworks rely on centralized decision-making, lack robust verification mechanisms, and face inconsistencies in translating macro-actions into precise low-level control signals. To address these challenges, we propose SAMALM, a decentralized multi-agent LLM actor-critic framework for multi-robot social navigation. In this framework, a set of parallel LLM actors, each reflecting distinct robot personalities or configurations, directly generate control signals. These actions undergo a two-tier verification process via a global critic that evaluates group-level behaviors and individual critics that assess each robot's context. An entropy-based score fusion mechanism further enhances self-verification and re-query, improving both robustness and coordination. Experimental results confirm that SAMALM effectively balances local autonomy with global oversight, yielding socially compliant behaviors and strong adaptability across diverse multi-robot scenarios. More details and videos about this work are available at: https://sites.google.com/view/SAMALM.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 32 of its 39 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
32 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 31
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 435
- 2024Navigation World Modelscited by 262
- 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 171
19 more
- 2017Socially Aware Motion Planning with Deep Reinforcement Learningcited by 128
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 123
- 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 122
- 2022Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deploymentcited by 101
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 46
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
- 2024CoNVOI: Context-aware Navigation using Vision Language Models in Outdoor and Indoor Environmentscited by 43
- 2024LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planningcited by 23
- 2023Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Frameworkcited by 16
- 2023Multi-Robot Cooperative Socially-Aware Navigation Using Multi-Agent Reinforcement Learningcited by 15
- 2023SICNav: Safe and Interactive Crowd Navigation using Model Predictive Control and Bilevel Optimizationcited by 14
- 2023NaviSTAR: Socially Aware Robot Navigation with Hybrid Spatio-Temporal Graph Transformer and Preference Learningcited by 12
- 2023World Models for Math Story Problemscited by 11
- 2024Topology-Driven Parallel Trajectory Optimization in Dynamic Environmentscited by 5
- 2024Attention Graph for Multi-Robot Social Navigation with Deep Reinforcement Learningcited by 4
- 2022Human-Aware Physical Human-Robot Collaborative Transportation and Manipulation with Multiple Aerial Robotscited by 3
- 2024HeR-DRL:Heterogeneous Relational Deep Reinforcement Learning for Decentralized Multi-Robot Crowd Navigationcited by 3
- 2024Human-Robot Cooperative Distribution Coupling for Hamiltonian-Constrained Social Navigationcited by 2
- 2024HIPer: A Human-Inspired Scene Perception Model for Multifunctional Mobile Robotscited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learningcited by 18
- 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policiescited by 2
- 2026MARO: Learning Stronger Reasoning from Social Interactioncited by 1
- 2026Advances and Innovations in the Multi-Agent Robotic System (MARS) Challengecited by 1
- 2026Ego to World: Collaborative Spatial Reasoning in Embodied Systems via Reinforcement Learningcited by 1
- 2026The Robot's Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanningcited by 1
- 2026The Robot's Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanning20 Mar 2026
- 2026Ego to World: Collaborative Spatial Reasoning in Embodied Systems via Reinforcement Learning16 Mar 2026
- 2026Advances and Innovations in the Multi-Agent Robotic System (MARS) Challenge26 Jan 2026
- 2026MARO: Learning Stronger Reasoning from Social Interaction18 Jan 2026
- 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policies2 Nov 2025
- 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learning10 Jun 2025
- 2025Multi-agent Embodied AI: Advances and Future Directions8 May 2025
Similar, not cited
Close in wording, no citation either way
- 2024Unifying Large Language Model and Deep Reinforcement Learning for Human-in-Loop Interactive Socially-aware Navigation
- 2026SAGE: A Socially-Aware Generative Engine for Heterogeneous Multi-Agent Navigation ↗
- 2025Logic-Guided Socially-aware Robot Navigation World Model
- 2021SOCIALGYM: A Framework for Benchmarking Social Robot Navigation
- 2026Enhancing Lightweight Vision Language Models through Group Competitive Learning for Socially Compliant Navigation
- 2024CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations
- 2025LISN: Language-Instructed Social Navigation with VLM-based Controller Modulating
- 2026SOPD-SocialNav: Selective On-Policy Distillation for Vision-Language Social Navigation