mlsanityData to 14 Oct 2026

Mosaic: Runtime-Efficient Multi-Agent Embodied Planning

arXiv 2607.09603 ↗First posted 10 Jul 2026cs.MAcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

LLM-based multi-agent embodied planning remains impractical due to prohibitively high execution latency. We identify failed actions as the dominant bottleneck, stemming from two core challenges: inaccurate state tracking under partial observability and inefficient coordination that produces redundant or conflicting actions. We introduce Mosaic, a runtime-efficient multi-agent planning framework that addresses both challenges. Mosaic maintains accurate yet lightweight state tracking through agent-centric semantic memory that stores objects in relative coordinates, enabling geometric transformations and coordination. It ensures efficient coordination through Integer Linear Programming that allocates actions at every planning step, enforcing physical feasibility and inter-agent coordination constraints. Across AI2-THOR and search-and-rescue benchmarks, Mosaic achieves 27-32% faster execution, 30-33% fewer LLM calls, 25-31% fewer steps, and 4-10% points higher success rates. These results demonstrate that efficient memory and constraint-guided coordination are critical for scalable, low-latency multi-agent planning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 52 of its 68 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

52 of 68 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024KARMA: Augmenting Embodied AI Agents with Long-and-short Term Memory Systems23 Sep
  2. 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments14 Jul

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  7. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  8. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  9. 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
  10. 2022Visual Language Maps for Robot Navigationcited by 365
  11. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  12. 2020Learning to Explore using Active Neural SLAMcited by 316
38 more
  1. 2020Integrated Task and Motion Planningcited by 290
  2. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
  3. 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
  4. 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
  5. 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 185
  6. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 153
  7. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
  8. 2024LLM Multi-Agent Systems: Challenges and Open Problemscited by 120
  9. 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 107
  10. 2024Chain of Thoughtlessness? An Analysis of CoT in Planningcited by 103
  11. 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 75
  12. 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
  13. 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Plannercited by 32
  14. 2025Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigationcited by 30
  15. 2024TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Modelscited by 29
  16. 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Modelcited by 25
  17. 2024LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planningcited by 24
  18. 2024Testing and Understanding Erroneous Planning in LLM Agents through Synthesized User Inputscited by 22
  19. 2019Improving Coordination in Small-Scale Multi-Agent Deep Reinforcement Learning through Memory-driven Communicationcited by 18
  20. 2024GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignmentcited by 16
  21. 2024Recover: A Neuro-Symbolic Framework for Failure Detection and Recoverycited by 15
  22. 2024Evaluating Uncertainty-based Failure Detection for Closed-Loop LLM Plannerscited by 15
  23. 2021HAMMER: Multi-Level Coordination of Reinforcement Learning Agents via Learned Messagingcited by 13
  24. 2023Decentralized Monte Carlo Tree Search for Partially Observable Multi-agent Pathfindingcited by 12
  25. 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 12
  26. 2025Meta-Memory: Retrieving and Integrating Semantic-Spatial Memories for Robot Spatial Reasoningcited by 9
  27. 2025Memo: Training Memory-Efficient Embodied Agents with Reinforcement Learningcited by 9
  28. 2023Optimal task and motion planning and execution for human-robot multi-agent systems in dynamic environmentscited by 8
  29. 2024Hierarchical LLMs In-the-Loop Optimization for Real-Time Multi-Robot Target Tracking under Unknown Hazardscited by 8
  30. 2024CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversationscited by 7
  31. 2023Heterogeneous Embodied Multi-Agent Collaborationcited by 6
  32. 2025STMA: A Spatio-Temporal Memory Agent for Long-Horizon Embodied Task Planningcited by 6
  33. 2025Decentralized Collective World Model for Emergent Communication and Coordinationcited by 5
  34. 2025Task Memory Engine: Spatial Memory for Robust Multi-Step LLM Agentscited by 5
  35. 2025Mem4Nav: Boosting Vision-and-Language Navigation in Urban Environments with a Hierarchical Spatial-Cognition Long-Short Memory Systemcited by 3
  36. 2025Communicating Plans, Not Percepts: Scalable Multi-Agent Coordination with Embodied World Modelscited by 3
  37. 2023Towards A Natural Language Interface for Flexible Multi-Agent Task Assignmentcited by 2
  38. 2025MAST: Multi-Agent Spatial Transformer for Learning to Collaboratecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026RPMS: Enhancing LLM-Based Embodied Planning through Rule-Augmented Memory Synergy
  2. 2026AgenticCache: Cache-Driven Asynchronous Planning for Embodied AI Agents
  3. 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agents
  4. 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory
  5. 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agents
  6. 2026CoCoBench: A Cooperative Coordination Benchmark for Embodied Multi-Agent Task Planning
  7. 2026Consistent Plan-Act for Long-Horizon Agentic Tasks
  8. 2026GraphThink: Graph-Enhanced LLM Thinking for Long-Horizon Embodied Task Planning