SAGA: Scene-Aware, Goal-Evolving Agents for Long-Horizon Strategy Game Planning
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
Grand-strategy games such as Civilization pose a distinctive long-horizon planning problem: an agent must divide one shared resource pool among six competing domains -- technology, government, diplomacy, city development, expansion, and military -- under partial observability, with no feedback except a delayed final score. Current LLM agents fall short in three ways: 1) they cannot infer spatial relations from raw coordinates; 2) they allocate resources poorly, because feeding the entire growing state into one prompt and planning all domains in a single output diffuses attention and biases decisions toward urgent events; and 3) they cannot improve, as the delayed score gives no signal within or across games. We present SAGA, an LLM multi-agent framework pairing one mechanism with each weakness: (i) a Map-Semantic Scene Graph turning coordinates into per-entity statements of distance, direction, and threat; (ii) a Tool-Augmented Planner that retrieves only the state a decision needs, cutting the order of magnitude of its input, and issues a separate plan per domain to six specialist controllers, so urgent events do not derail long-term plans; and (iii) a Dual-Horizon Feedback Loop setting short-term goals during play and distilling each game into lessons for the next. On CivRealm, a Civilization-style benchmark, SAGA leads five LLM baselines on mean final score and is the only method significantly ahead of all of them on city development, the first investment baselines sacrifice, with 27% fewer output tokens; with cross-game learning it scores highest after five games, and its fifth game consistently surpasses its first across four maps. Our code is available at https://github.com/Kazecloudk/SAGA-Scene-Aware-Goal-Evolving-Agents-for-Long-Horizon-Strategy-Game-Planning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 26 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
19 of 26 references.
Closest ancestors · 7
Same direction, newest first
- 2025Society of Mind Meets Real-Time Strategy: A Hierarchical Multi-Agent Framework for Strategic Reasoning8 Aug
- 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policy27 Feb
- 2024CivRealm: A Learning and Reasoning Odyssey in Civilization for Decision-Making Agents19 Jan
- 2023Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approach19 Dec
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Models25 May
- 2023Reflexion: Language Agents with Verbal Reinforcement Learning20 Mar
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun
Other references · 12
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 306
- 2019The Hanabi Challenge: A New Frontier for AI Researchcited by 194
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 129
- 2021Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Potcited by 97
- 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agentscited by 66
- 2025SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoningcited by 41
- 2019No Press Diplomacy: Modeling Multi-Agent Gameplaycited by 37
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SAG-Agent: Enabling Long-Horizon Reasoning in Strategy Games via Dynamic Knowledge Graphs
- 2026The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillation
- 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning
- 2026Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarios
- 2026CivBench: A Long-Horizon Benchmark for Tool-Mediated Agents in Civilization VI
- 2025Agents of Change: Self-Evolving LLM Agents for Strategic Planning
- 2026Why Reasoning Fails to Plan: A Planning-Centric Analysis of Long-Horizon Decision Making in LLM Agents
- 2026MAP: A Map-then-Act Paradigm for Long-Horizon Interactive Agent Reasoning