mlsanityData to 7 Oct 2026

Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarios

arXiv 2603.23875 ↗First posted 25 Mar 2026cs.MAcited by 0

On the map: LLM agents and tool use → Reinforcement learning for LLM agents

Abstract (arXiv)

Large language models (LLMs) have demonstrated exceptional potential in complex reasoning,pioneering a new paradigm for autonomous agent decision making in dynamic settings. However, in Real-Time Strategy (RTS) scenarios, LLMs suffer from a critical speed-quality trade-off. Specifically expansive state spaces and time limits render inference delays prohibitive, while stochastic planning errors undermine logical consistency. To address these challenges, we present SEMA (Self-Evolving Multi-Agent), a novel framework designed for high-performance, low-latency decision-making in RTS environments. This collaborative multi-agent framework facilitates self-evolution by adaptively calibrating model bias through in-episode assessment and cross-episode analysis. We further incorporate dynamic observation pruning based on structural entropy to model game states topologically. By distilling high dimensional data into core semantic information, this approach significantly reduces inference time. We also develop a hybrid knowledge-memory mechanism that integrates micro-trajectories, macro-experience, and hierarchical domain knowledge, thereby enhancing both strategic adaptability and decision consistency. Experiments across multiple StarCraft II maps demonstrate that SEMA achieves superior win rates while reducing average decision latency by over 50%, validating its efficiency and robustness in complex RTS scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 32 of its 46 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

32 of 46 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Society of Mind Meets Real-Time Strategy: A Hierarchical Multi-Agent Framework for Strategic Reasoning8 Aug
  2. 2025STeCa: Step-level Trajectory Calibration for LLM Agent Learning20 Feb
  3. 2023Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approach19 Dec
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Models25 May

Other references · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  8. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  9. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  10. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  11. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  12. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
16 more
  1. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  2. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  3. 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Changecited by 372
  4. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
  5. 2017StarCraft II: A New Challenge for Reinforcement Learningcited by 268
  6. 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 100
  7. 2023MindAgent: Emergent Gaming Interactioncited by 87
  8. 2025Learning to Plan & Reason for Evaluation with Thinking-LLM-as-a-Judgecited by 75
  9. 2024Reasoning Aware Self-Consistency: Leveraging Reasoning Paths for Efficient LLM Samplingcited by 63
  10. 2019AlphaStar: An Evolutionary Computation Perspectivecited by 50
  11. 2026DeepPlanning: Benchmarking Long-Horizon Agentic Planning with Verifiable Constraintscited by 43
  12. 2025MCTS-Judge: Test-Time Scaling in LLM-as-a-Judge for Code Correctness Evaluationcited by 32
  13. 2025Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anythingcited by 9
  14. 2025CLEA: Closed-Loop Embodied Agent for Enhancing Task Execution in Dynamic Environmentscited by 6
  15. 2025Refining Positive and Toxic Samples for Dual Safety Self-Alignment of LLMs with Minimal Human Interventionscited by 3
  16. 2026ORION: Option-Regularized Deep Reinforcement Learning for Cooperative Multi-Agent Online Navigationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Dynamic Strategy Adaptation in Multi-Agent Environments with Large Language Models
  2. 2025SC2Arena and StarEvolve: Benchmark and Self-Improvement Framework for LLMs in Complex Decision-Making Tasks
  3. 2026World Models for Policy Refinement in StarCraft II
  4. 2026Beyond Scaling: Assessing Strategic Reasoning and Rapid Decision-Making Capability of LLMs in Zero-sum Environments
  5. 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Models
  6. 2026RTSGameBench: An RTS Benchmark for Strategic Reasoning by Vision-Language Models
  7. 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agents
  8. 2026LLMs Are Not Good Strategists, Yet Memory-Enhanced Agency Boosts Reasoning