Robot guide with multi-agent control and automatic scenario generation with LLM
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The article describes the development of a hybrid social robot control architecture to overcome the limitations of traditional approaches, where behavior scripts manually synchronize the robot's actions and text, and existing methods focus primarily on short dialogue responses. The architecture of the proposed system combines a multi-agent resource management system with automatic generation of behavior scenarios based on large language models. This system automates the preparation of text and commands for the robot's non-verbal behavior for extended narratives and resolves resource conflicts between multiple execution mechanisms. The system was tested on the MENTOR-1 tour guide robot, for which it successfully generated scenarios automatically and demonstrated more natural and rich behavior compared to existing approaches. The proposed approach provides full automation of both scenario preparation and execution through efficient resource management, enhancing the quality of social robot interaction in long-term storytelling tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 18 of its 55 references that are in the map. First posted on arXiv 12 Sep 2025.
Builds on
18 of 55 references.
References · 18
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 202
- 2018Robots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robotscited by 110
- 2020A Survey of Behavior Trees in Robotics and AIcited by 55
- 2023LLM-BRAIn: AI-driven Fast Generation of Robot Behaviour Tree based on Large Language Modelcited by 24
- 2024BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMscited by 14
- 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
- 2023Developing Social Robots with Empathetic Non-Verbal Cues Using Large Language Modelscited by 12
- 2022Artificial Emotional Intelligence in Socially Assistive Robots for Older Adults: A Pilot Studycited by 9
6 more
- 2020Decentralized Task and Path Planning for Multi-Robot Systemscited by 6
- 2022Deep Gesture Generation for Social Robots Using Type-Specific Librariescited by 5
- 2024Ain't Misbehavin' -- Using LLMs to Generate Expressive Robot Behavior in Conversations with the Tabletop Robot Harucited by 5
- 2023iCub Detecting Gazed Objects: A Pipeline Estimating Human Attentioncited by 3
- 2024Upgrading Pepper Robot s Social Interaction with Advanced Hardware and Perception Enhancementscited by 2
- 2022The Effect of Robot Posture and Idle Motion on Spontaneous Emotional Contagion during Robot-Human Interactionscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MistyPilot: Enabling Social-Robot Control through Multi-Agent LLM Skill Orchestration
- 2023LLM-MARS: Large Language Model for Behavior Tree Generation and NLP-enhanced Dialogue in Multi-Agent Robot Systems
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models
- 2024Two Heads Are Better Than One: Collaborative LLM Embodied Agents for Human-Robot Interaction
- 2025Large Language Models for Multi-Robot Systems: A Survey
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey
- 2024The Drama Machine: Simulating Character Development with LLM Agents
- 2026ARdena: Scenario-driven control of real-time LLM agents