MAP: A Map-then-Act Paradigm for Long-Horizon Interactive Agent Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Current interactive LLM agents rely on goal-conditioned stepwise planning, where environmental understanding is acquired reactively during execution rather than established beforehand. This temporal inversion leads to Delayed Environmental Perception: agents must infer environmental constraints through trial-and-error, resulting in an Epistemic Bottleneck that traps them in inefficient failure cycles. Inspired by human affordance perception and cognitive map theory, we propose the Map-then-Act Paradigm (MAP), a plug-and-play framework that shifts environment understanding before execution. MAP consists of three stages: (1) Global Exploration, acquiring environment-general priors; (2) Task-Specific Mapping, constructing a structured cognitive map; and (3) Knowledge-Augmented Execution, solving tasks grounded on the map. Experiments show consistent gains across benchmarks and LLMs. On ARC-AGI-3, MAP enables frontier models to surpass near-zero baseline performance in 22 of 25 game environments. We further introduce MAP-2K, a dataset of map-then-act trajectories, and show that training on it outperforms expert execution traces, suggesting that understanding environments is more fundamental than imitation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 30 of its 49 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
30 of 49 references.
Closest ancestors · 3
Same direction, newest first
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan
- 2025Look Back to Reason Forward: Revisitable Memory for Long-Context LLM Agents27 Sep
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents18 Jun
Other references · 27
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 263
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 183
15 more
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
- 2026Learning to Discover at Test Timecited by 115
- 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 109
- 2025Agent Learning via Early Experiencecited by 85
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 85
- 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 73
- 2026Skill-Pro: Learning Reusable Skills from Experience via Non-Parametric PPO for LLM Agentscited by 47
- 2026ARC-AGI-3: A New Challenge for Frontier Agentic Intelligencecited by 37
- 2025Learning on the Job: An Experience-Driven Self-Evolving Agent for Long-Horizon Taskscited by 22
- 2026Learning to Self-Verify Makes Language Models Better Reasonerscited by 21
- 2026Exploratory Memory-Augmented LLM Agent via Hybrid On- and Off-Policy Optimizationcited by 19
- 2025Coarse-to-Fine Grounded Memory for LLM Agent Planningcited by 18
- 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memorycited by 17
- 2026What Do LLM Agents Know About Their World? Task2Quiz: A Paradigm for Studying Environment Understandingcited by 3
- 2025Efficient and Generalizable Environmental Understanding for Visual Navigationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Spatial Reasoning in LLM Game Agents: Impact of Causal Context and Multi-Step Planning
- 2025GroundAct: Can LLM Agents Ground Actions in Environmental States?
- 2026ProPlay: Procedural World Models for Self-Evolving LLM Agents
- 2025Thinking on Maps: How Foundation Model Agents Explore, Remember, and Reason Map Environments
- 2026Ask the World Before Acting: Environment Probing for Calibrated Agent World Models
- 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agents
- 2025The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemas
- 2025EvoEmpirBench: Dynamic Spatial Reasoning with Agent-ExpVer