mlsanityData to 14 Oct 2026

LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments

arXiv 2407.10031 ↗First posted 14 Jul 2024cs.RO cs.MAcited by 32

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

The ability of Language Models (LMs) to understand natural language makes them a powerful tool for parsing human instructions into task plans for autonomous robots. Unlike traditional planning methods that rely on domain-specific knowledge and handcrafted rules, LMs generalize from diverse data and adapt to various tasks with minimal tuning, acting as a compressed knowledge base. However, LMs in their standard form face challenges with long-horizon tasks, particularly in partially observable multi-agent settings. We propose an LM-based Long-Horizon Planner for Multi-Agent Robotics (LLaMAR), a cognitive architecture for planning that achieves state-of-the-art results in long-horizon tasks within partially observable environments. LLaMAR employs a plan-act-correct-verify framework, allowing self-correction from action execution feedback without relying on oracles or simulators. Additionally, we present MAP-THOR, a comprehensive test suite encompassing household tasks of varying complexity within the AI2-THOR environment. Experiments show that LLaMAR achieves a 30% higher success rate than other state-of-the-art LM-based multi-agent planners in MAP-THOR and Search & Rescue tasks. Code can be found at https://github.com/nsidn98/LLaMAR

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 55 of its 74 references that are in the map. First posted on arXiv 14 Jul 2024.

Builds on

55 of 74 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents1 Mar
  2. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models8 Dec
  3. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents18 Jan

Other references · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  7. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  8. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  9. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  10. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  11. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  12. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
38 more
  1. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  2. 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
  3. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  4. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  5. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  6. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
  7. 2018Data-Efficient Hierarchical Reinforcement Learningcited by 455
  8. 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
  9. 2018VirtualHome: Simulating Household Activities via Programscited by 415
  10. 2022Visual Language Maps for Robot Navigationcited by 365
  11. 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 312
  12. 2020Decoupling Representation Learning from Reinforcement Learningcited by 269
  13. 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
  14. 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
  15. 2021TEACh: Task-driven Embodied Agents that Chatcited by 197
  16. 2015Multiagent Cooperation and Competition with Deep Reinforcement Learningcited by 184
  17. 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
  18. 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
  19. 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 164
  20. 2020Rearrangement: A Challenge for Embodied AIcited by 155
  21. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 153
  22. 2020Multi-Task Reinforcement Learning with Soft Modularizationcited by 143
  23. 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 108
  24. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
  25. 2024Chain of Thoughtlessness? An Analysis of CoT in Planningcited by 103
  26. 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
  27. 2021Skill Induction and Planning with Latent Languagecited by 99
  28. 2024Can Large Language Models Reason and Plan?cited by 82
  29. 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 65
  30. 2020A Cordial Sync: Going Beyond Marginal Policies for Multi-Agent Embodied Taskscited by 52
  31. 2017Visual Semantic Planning using Deep Successor Representationscited by 45
  32. 2019Two Body Problem: Collaborative Visual Task Completioncited by 45
  33. 2019Hierarchical Cooperative Multi-Agent Reinforcement Learning with Skill Discoverycited by 43
  34. 2024TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Modelscited by 29
  35. 2022Generating Executable Action Plans with Environmentally-Aware Language Modelscited by 21
  36. 2017HoME: a Household Multimodal Environmentcited by 20
  37. 2021Hierarchies of Planning and Reinforcement Learning for Robot Navigationcited by 11
  38. 2023Learning and Leveraging Verifiers to Improve Planning Capabilities of Pre-trained Language Modelscited by 10

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 18; 2026: 11.

32 papers.

Sort:

By area:

  1. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
  2. 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 72
  3. 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
  4. 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Plannercited by 32
  5. 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Codecited by 30
  6. 2025Embodied AI: From LLMs to World Modelscited by 24
  7. 2025Agents of Change: Self-Evolving LLM Agents for Strategic Planningcited by 21
  8. 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learningcited by 18
  9. 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agentscited by 17
  10. 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systemscited by 14
  11. 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
  12. 2025LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy Generationcited by 13
20 more
  1. 2026The Verifier Tax: Horizon Dependent Safety Success Tradeoffs in Tool Using LLM Agentscited by 11
  2. 2024MageBench: Bridging Large Multimodal Models to Agentscited by 6
  3. 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 5
  4. 2025The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemascited by 5
  5. 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agentscited by 5
  6. 2024Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modelingcited by 4
  7. 2025ELHPlan: Efficient Long-Horizon Task Planning for Multi-Agent Collaborationcited by 3
  8. 2025Orchestrator: Active Inference for Multi-Agent Systems in Long-Horizon Taskscited by 2
  9. 2025TACOS: Task Agnostic COordinator of a multi-drone Systemcited by 2
  10. 2026EmboTeam: Grounding LLM Reasoning into Reactive Behavior Trees via PDDL for Embodied Multi-Robot Collaborationcited by 2
  11. 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planningcited by 2
  12. 2026LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behaviorcited by 2
  13. 2025HiBerNAC: Hierarchical Brain-inspired Robotic Neural Agent Collective for Disentangling Complex Manipulationcited by 1
  14. 2026Advances and Innovations in the Multi-Agent Robotic System (MARS) Challengecited by 1
  15. 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systemscited by 1
  16. 2026Mosaic: Runtime-Efficient Multi-Agent Embodied Planningcited by 1
  17. 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systemscited by 1
  18. 2025Empowering LLMs with Parameterized Skills for Adversarial Long-Horizon Planningcited by 0
  19. 2026Object Search in Partially-Known Environments via LLM-informed Model-based Planning and Prompt Selectioncited by 0
  20. 2026Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Methodcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks
  2. 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning
  3. 2026From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?
  4. 2024Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation
  5. 2026DUPLEX: Agentic Dual-System Planning via LLM-Driven Information Extraction
  6. 2025Combining Large Language Models and Symbolic Reasoning for Multi-Robot Temporal Planning through Explainable Knowledge Bases
  7. 2024ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution
  8. 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planning