LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The ability of Language Models (LMs) to understand natural language makes them a powerful tool for parsing human instructions into task plans for autonomous robots. Unlike traditional planning methods that rely on domain-specific knowledge and handcrafted rules, LMs generalize from diverse data and adapt to various tasks with minimal tuning, acting as a compressed knowledge base. However, LMs in their standard form face challenges with long-horizon tasks, particularly in partially observable multi-agent settings. We propose an LM-based Long-Horizon Planner for Multi-Agent Robotics (LLaMAR), a cognitive architecture for planning that achieves state-of-the-art results in long-horizon tasks within partially observable environments. LLaMAR employs a plan-act-correct-verify framework, allowing self-correction from action execution feedback without relying on oracles or simulators. Additionally, we present MAP-THOR, a comprehensive test suite encompassing household tasks of varying complexity within the AI2-THOR environment. Experiments show that LLaMAR achieves a 30% higher success rate than other state-of-the-art LM-based multi-agent planners in MAP-THOR and Search & Rescue tasks. Code can be found at https://github.com/nsidn98/LLaMAR
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 55 of its 74 references that are in the map. First posted on arXiv 14 Jul 2024.
Builds on
55 of 74 references.
Closest ancestors · 3
Same direction, newest first
- 2023Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents1 Mar
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models8 Dec
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents18 Jan
Other references · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Visual Instruction Tuningcited by 7,869
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
38 more
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2018Data-Efficient Hierarchical Reinforcement Learningcited by 455
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2018VirtualHome: Simulating Household Activities via Programscited by 415
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 312
- 2020Decoupling Representation Learning from Reinforcement Learningcited by 269
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 197
- 2015Multiagent Cooperation and Competition with Deep Reinforcement Learningcited by 184
- 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
- 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
- 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 164
- 2020Rearrangement: A Challenge for Embodied AIcited by 155
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 153
- 2020Multi-Task Reinforcement Learning with Soft Modularizationcited by 143
- 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 108
- 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
- 2024Chain of Thoughtlessness? An Analysis of CoT in Planningcited by 103
- 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2024Can Large Language Models Reason and Plan?cited by 82
- 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 65
- 2020A Cordial Sync: Going Beyond Marginal Policies for Multi-Agent Embodied Taskscited by 52
- 2017Visual Semantic Planning using Deep Successor Representationscited by 45
- 2019Two Body Problem: Collaborative Visual Task Completioncited by 45
- 2019Hierarchical Cooperative Multi-Agent Reinforcement Learning with Skill Discoverycited by 43
- 2024TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Modelscited by 29
- 2022Generating Executable Action Plans with Environmentally-Aware Language Modelscited by 21
- 2017HoME: a Household Multimodal Environmentcited by 20
- 2021Hierarchies of Planning and Reinforcement Learning for Robot Navigationcited by 11
- 2023Learning and Leveraging Verifiers to Improve Planning Capabilities of Pre-trained Language Modelscited by 10
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 18; 2026: 11.
32 papers.
Sort:
By area:
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
- 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 72
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Plannercited by 32
- 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Codecited by 30
- 2025Embodied AI: From LLMs to World Modelscited by 24
- 2025Agents of Change: Self-Evolving LLM Agents for Strategic Planningcited by 21
- 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learningcited by 18
- 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agentscited by 17
- 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systemscited by 14
- 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
- 2025LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy Generationcited by 13
20 more
- 2026The Verifier Tax: Horizon Dependent Safety Success Tradeoffs in Tool Using LLM Agentscited by 11
- 2024MageBench: Bridging Large Multimodal Models to Agentscited by 6
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 5
- 2025The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemascited by 5
- 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agentscited by 5
- 2024Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modelingcited by 4
- 2025ELHPlan: Efficient Long-Horizon Task Planning for Multi-Agent Collaborationcited by 3
- 2025Orchestrator: Active Inference for Multi-Agent Systems in Long-Horizon Taskscited by 2
- 2025TACOS: Task Agnostic COordinator of a multi-drone Systemcited by 2
- 2026EmboTeam: Grounding LLM Reasoning into Reactive Behavior Trees via PDDL for Embodied Multi-Robot Collaborationcited by 2
- 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planningcited by 2
- 2026LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behaviorcited by 2
- 2025HiBerNAC: Hierarchical Brain-inspired Robotic Neural Agent Collective for Disentangling Complex Manipulationcited by 1
- 2026Advances and Innovations in the Multi-Agent Robotic System (MARS) Challengecited by 1
- 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systemscited by 1
- 2026Mosaic: Runtime-Efficient Multi-Agent Embodied Planningcited by 1
- 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systemscited by 1
- 2025Empowering LLMs with Parameterized Skills for Adversarial Long-Horizon Planningcited by 0
- 2026Object Search in Partially-Known Environments via LLM-informed Model-based Planning and Prompt Selectioncited by 0
- 2026Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Methodcited by 0
- 2026Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Method28 Sep 2026
- 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systems1 Aug 2026
- 2026Mosaic: Runtime-Efficient Multi-Agent Embodied Planning10 Jul 2026
- 2026LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behavior26 Jun 2026
- 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems28 May 2026
- 2026Object Search in Partially-Known Environments via LLM-informed Model-based Planning and Prompt Selection25 Mar 2026
- 2026The Verifier Tax: Horizon Dependent Safety Success Tradeoffs in Tool Using LLM Agents18 Mar 2026
- 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning25 Feb 2026
- 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agents4 Feb 2026
- 2026Advances and Innovations in the Multi-Agent Robotic System (MARS) Challenge26 Jan 2026
- 2026EmboTeam: Grounding LLM Reasoning into Reactive Behavior Trees via PDDL for Embodied Multi-Robot Collaboration16 Jan 2026
- 2025The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemas8 Oct 2025
20 more
- 2025TACOS: Task Agnostic COordinator of a multi-drone System2 Oct 2025
- 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agents30 Sep 2025
- 2025ELHPlan: Efficient Long-Horizon Task Planning for Multi-Agent Collaboration29 Sep 2025
- 2025Embodied AI: From LLMs to World Models24 Sep 2025
- 2025Empowering LLMs with Parameterized Skills for Adversarial Long-Horizon Planning16 Sep 2025
- 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learning10 Sep 2025
- 2025Orchestrator: Active Inference for Multi-Agent Systems in Long-Horizon Tasks6 Sep 2025
- 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systems2 Jul 2025
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectives11 Jun 2025
- 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learning10 Jun 2025
- 2025HiBerNAC: Hierarchical Brain-inspired Robotic Neural Agent Collective for Disentangling Complex Manipulation9 Jun 2025
- 2025Agents of Change: Self-Evolving LLM Agents for Strategic Planning5 Jun 2025
- 2025LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy Generation2 Jun 2025
- 2025Multi-agent Embodied AI: Advances and Future Directions8 May 2025
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks12 Mar 2025
- 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Code10 Mar 2025
- 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Review17 Feb 2025
- 2024MageBench: Bridging Large Multimodal Models to Agents5 Dec 2024
- 2024Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modeling2 Oct 2024
- 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Planner30 Sep 2024
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
- 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 72
- 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Plannercited by 32
- 2025Agents of Change: Self-Evolving LLM Agents for Strategic Planningcited by 21
- 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agentscited by 17
- 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systemscited by 14
- 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
- 2025LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy Generationcited by 13
- 2026The Verifier Tax: Horizon Dependent Safety Success Tradeoffs in Tool Using LLM Agentscited by 11
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 5
- 2025The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemascited by 5
- 2025ELHPlan: Efficient Long-Horizon Task Planning for Multi-Agent Collaborationcited by 3
12 most cited of 19 All 19 (JSON)
- 2026Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Method28 Sep 2026
- 2026When Prompts Control Robots: Prompt Injection Attacks in Multi-Agent Robotic Systems1 Aug 2026
- 2026Mosaic: Runtime-Efficient Multi-Agent Embodied Planning10 Jul 2026
- 2026LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behavior26 Jun 2026
- 2026When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems28 May 2026
- 2026The Verifier Tax: Horizon Dependent Safety Success Tradeoffs in Tool Using LLM Agents18 Mar 2026
- 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning25 Feb 2026
- 2025The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemas8 Oct 2025
- 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agents30 Sep 2025
- 2025ELHPlan: Efficient Long-Horizon Task Planning for Multi-Agent Collaboration29 Sep 2025
- 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learning10 Sep 2025
- 2025Orchestrator: Active Inference for Multi-Agent Systems in Long-Horizon Tasks6 Sep 2025
12 newest of 19 All 19 (JSON)
- 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Codecited by 30
- 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agentscited by 5
- 2026EmboTeam: Grounding LLM Reasoning into Reactive Behavior Trees via PDDL for Embodied Multi-Robot Collaborationcited by 2
- 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agents4 Feb 2026
- 2026EmboTeam: Grounding LLM Reasoning into Reactive Behavior Trees via PDDL for Embodied Multi-Robot Collaboration16 Jan 2026
- 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Code10 Mar 2025
- 2025Embodied AI: From LLMs to World Modelscited by 24
- 2025Embodied AI: From LLMs to World Models24 Sep 2025
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2024Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modelingcited by 4
- 2025TACOS: Task Agnostic COordinator of a multi-drone Systemcited by 2
- 2025Empowering LLMs with Parameterized Skills for Adversarial Long-Horizon Planningcited by 0
- 2026Object Search in Partially-Known Environments via LLM-informed Model-based Planning and Prompt Selectioncited by 0
- 2026Object Search in Partially-Known Environments via LLM-informed Model-based Planning and Prompt Selection25 Mar 2026
- 2025TACOS: Task Agnostic COordinator of a multi-drone System2 Oct 2025
- 2025Empowering LLMs with Parameterized Skills for Adversarial Long-Horizon Planning16 Sep 2025
- 2025Multi-agent Embodied AI: Advances and Future Directions8 May 2025
- 2024Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modeling2 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2023Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks
- 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning
- 2026From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?
- 2024Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation
- 2026DUPLEX: Agentic Dual-System Planning via LLM-Driven Information Extraction
- 2025Combining Large Language Models and Symbolic Reasoning for Multi-Robot Temporal Planning through Explainable Knowledge Bases
- 2024ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution
- 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planning