Mosaic: Runtime-Efficient Multi-Agent Embodied Planning
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
LLM-based multi-agent embodied planning remains impractical due to prohibitively high execution latency. We identify failed actions as the dominant bottleneck, stemming from two core challenges: inaccurate state tracking under partial observability and inefficient coordination that produces redundant or conflicting actions. We introduce Mosaic, a runtime-efficient multi-agent planning framework that addresses both challenges. Mosaic maintains accurate yet lightweight state tracking through agent-centric semantic memory that stores objects in relative coordinates, enabling geometric transformations and coordination. It ensures efficient coordination through Integer Linear Programming that allocates actions at every planning step, enforcing physical feasibility and inter-agent coordination constraints. Across AI2-THOR and search-and-rescue benchmarks, Mosaic achieves 27-32% faster execution, 30-33% fewer LLM calls, 25-31% fewer steps, and 4-10% points higher success rates. These results demonstrate that efficient memory and constraint-guided coordination are critical for scalable, low-latency multi-agent planning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 52 of its 68 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
52 of 68 references.
Closest ancestors · 2
Same direction, newest first
- 2024KARMA: Augmenting Embodied AI Agents with Long-and-short Term Memory Systems23 Sep
- 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments14 Jul
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024GPT-4o System Cardcited by 4,588
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 2020Learning to Explore using Active Neural SLAMcited by 316
38 more
- 2020Integrated Task and Motion Planningcited by 290
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 185
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 153
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
- 2024LLM Multi-Agent Systems: Challenges and Open Problemscited by 120
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 107
- 2024Chain of Thoughtlessness? An Analysis of CoT in Planningcited by 103
- 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 75
- 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
- 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Plannercited by 32
- 2025Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigationcited by 30
- 2024TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Modelscited by 29
- 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Modelcited by 25
- 2024LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planningcited by 24
- 2024Testing and Understanding Erroneous Planning in LLM Agents through Synthesized User Inputscited by 22
- 2019Improving Coordination in Small-Scale Multi-Agent Deep Reinforcement Learning through Memory-driven Communicationcited by 18
- 2024GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignmentcited by 16
- 2024Recover: A Neuro-Symbolic Framework for Failure Detection and Recoverycited by 15
- 2024Evaluating Uncertainty-based Failure Detection for Closed-Loop LLM Plannerscited by 15
- 2021HAMMER: Multi-Level Coordination of Reinforcement Learning Agents via Learned Messagingcited by 13
- 2023Decentralized Monte Carlo Tree Search for Partially Observable Multi-agent Pathfindingcited by 12
- 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 12
- 2025Meta-Memory: Retrieving and Integrating Semantic-Spatial Memories for Robot Spatial Reasoningcited by 9
- 2025Memo: Training Memory-Efficient Embodied Agents with Reinforcement Learningcited by 9
- 2023Optimal task and motion planning and execution for human-robot multi-agent systems in dynamic environmentscited by 8
- 2024Hierarchical LLMs In-the-Loop Optimization for Real-Time Multi-Robot Target Tracking under Unknown Hazardscited by 8
- 2024CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversationscited by 7
- 2023Heterogeneous Embodied Multi-Agent Collaborationcited by 6
- 2025STMA: A Spatio-Temporal Memory Agent for Long-Horizon Embodied Task Planningcited by 6
- 2025Decentralized Collective World Model for Emergent Communication and Coordinationcited by 5
- 2025Task Memory Engine: Spatial Memory for Robust Multi-Step LLM Agentscited by 5
- 2025Mem4Nav: Boosting Vision-and-Language Navigation in Urban Environments with a Hierarchical Spatial-Cognition Long-Short Memory Systemcited by 3
- 2025Communicating Plans, Not Percepts: Scalable Multi-Agent Coordination with Embodied World Modelscited by 3
- 2023Towards A Natural Language Interface for Flexible Multi-Agent Task Assignmentcited by 2
- 2025MAST: Multi-Agent Spatial Transformer for Learning to Collaboratecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026EdgeCraft: Automated Model Crafting for Edge IoTcited by 0
- 2026EdgeCraft: Automated Model Crafting for Edge IoT28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026RPMS: Enhancing LLM-Based Embodied Planning through Rule-Augmented Memory Synergy
- 2026AgenticCache: Cache-Driven Asynchronous Planning for Embodied AI Agents
- 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agents
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory
- 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agents
- 2026CoCoBench: A Cooperative Coordination Benchmark for Embodied Multi-Agent Task Planning
- 2026Consistent Plan-Act for Long-Horizon Agentic Tasks
- 2026GraphThink: Graph-Enhanced LLM Thinking for Long-Horizon Embodied Task Planning