Structured LLM Reasoning for Zero-Shot Human--Robot Coordination Under Hidden Goals
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
We present a structured large-language-model (LLM) architecture for zero-shot human--robot coordination in a cooperative construction task with private goal views. Guided by a Dec-POMDP formulation, the architecture decomposes decision-making into (i) action-conditioned Theory-of-Mind (ToM) inference, (ii) hierarchical planning, (iii) conversation interpretation, (iv) action verification, and (v) feedback-based replanning. We compare the proposed method with an ablation without ToM inference and a multi-agent reinforcement-learning policy trained offline over many goal pairs. In human-participant experiments, the proposed method required fewer interaction steps and yielded higher post-interaction trust ratings than both baselines. These results suggest that systematically decomposing the team decision problem, using LLMs as tractable surrogates for otherwise intractable inference and planning computations, and retaining conventional verification for physical feasibility can improve both task coordination and the human experience.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 29 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
9 of 29 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2023Cognitive Architectures for Language Agentscited by 429
- 2025Collaborating Action by Action: A Multi-agent LLM Framework for Embodied Reasoningcited by 21
- 2025Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysiscited by 9
- 2025LogicGuard: Improving Embodied LLM agents through Temporal Logic based Criticscited by 5
- 2025Language-Driven Coordination and Learning in Multi-Agent Simulation Environmentscited by 3
- 2026KGLAMP: Knowledge Graph-guided Language model for Adaptive Multi-robot Planning and Replanningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models
- 2024TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Models
- 2026STEP: State-Aware Task Estimation and Planning with Multi-Modal LLMs for Human-Robot Collaboration
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models
- 2024MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation
- 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning
- 2025Theory of Mind in Action: The Instruction Inference Task in Dynamic Human-Agent Collaboration
- 2023Theory of Mind for Multi-Agent Collaboration via Large Language Models