AlphaStar: An Evolutionary Computation Perspective
Not on the map. Why?
Abstract (arXiv)
In January 2019, DeepMind revealed AlphaStar to the world-the first artificial intelligence (AI) system to beat a professional player at the game of StarCraft II-representing a milestone in the progress of AI. AlphaStar draws on many areas of AI research, including deep learning, reinforcement learning, game theory, and evolutionary computation (EC). In this paper we analyze AlphaStar primarily through the lens of EC, presenting a new look at the system and relating it to many concepts in the field. We highlight some of its most interesting aspects-the use of Lamarckian evolution, competitive co-evolution, and quality diversity. In doing so, we hope to provide a bridge between the wider EC community and one of the most significant AI systems developed in recent times.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 8; 2022: 12; 2023: 14; 2024: 7; 2025: 5; 2026: 3.
50 papers.
Sort:
By area:
- 2022A Survey on Offline Reinforcement Learning: Taxonomy, Review, and Open Problemscited by 228
- 2022LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Taskscited by 146
- 2021Differentiable Quality Diversitycited by 71
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2023Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questionscited by 30
- 2023LARP: Language-Agent Role Play for Open-World Gamescited by 24
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfindingcited by 20
- 2022Model-based Multi-agent Reinforcement Learning: Recent Progress and Prospectscited by 17
- 2023Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Owncited by 16
- 2023B-Coder: Value-Based Deep Reinforcement Learning for Program Synthesiscited by 16
- 2022Reinforcement Learning from Partial Observation: Linear Function Approximation with Provable Sample Efficiencycited by 15
- 2022TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learningcited by 15
38 more
- 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulationcited by 14
- 2022On the Implicit Bias Towards Minimal Depth of Deep Neural Networkscited by 12
- 2025From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learningcited by 11
- 2023ReLU to the Rescue: Improve Your On-Policy Actor-Critic with Positive Advantagescited by 10
- 2022Reinforcement Learning from Simulation to Real World Autonomous Driving using Digital Twincited by 9
- 2023Information Design in Multi-Agent Reinforcement Learningcited by 9
- 2024Efficient Multi-agent Reinforcement Learning by Planningcited by 9
- 2021Lyapunov Exponents for Diversity in Differentiable Gamescited by 8
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agentscited by 8
- 2022FCMNet: Full Communication Memory Net for Team-Level Cooperation in Multi-Agent Systemscited by 7
- 2023Norm-based Generalization Bounds for Compositionally Sparse Neural Networkscited by 7
- 2026Digital Red Queen: Adversarial Program Evolution in Core War with LLMscited by 7
- 2021Value Activation for Bias Alleviation: Generalized-activated Deep Double Deterministic Policy Gradientscited by 6
- 2022Transfer Dynamics in Emergent Evolutionary Curriculacited by 6
- 2022E-MAPP: Efficient Multi-Agent Reinforcement Learning with Parallel Program Guidancecited by 6
- 2023RePreM: Representation Pre-training with Masked Model for Reinforcement Learningcited by 5
- 2023Exploring the Approximation Capabilities of Multiplicative Neural Networks for Smooth Functionscited by 4
- 2023Gradient-Informed Quality Diversity for the Illumination of Discrete Spacescited by 4
- 2023Transferable Curricula through Difficulty Conditioned Generatorscited by 3
- 2025Towards Neurocognitive-Inspired Intelligence: From AI's Structural Mimicry to Human-Like Functional Cognitioncited by 2
- 2019Multi-task Batch Reinforcement Learning with Metric Learningcited by 1
- 2021Adversary agent reinforcement learning for pursuit-evasioncited by 1
- 2022Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learningcited by 1
- 2023An Intentional Forgetting-Driven Self-Healing Method For Deep Reinforcement Learning Systemscited by 1
- 2024SOAP-RL: Sequential Option Advantage Propagation for Reinforcement Learning in POMDP Environmentscited by 1
- 2024KALE-LM-Chem: Vision and Practice Toward an AI Brain for Chemistrycited by 1
- 2025Program Semantic Inequivalence Game with Large Language Modelscited by 1
- 2025Enhancing Language Agent Strategic Reasoning through Self-Play in Adversarial Gamescited by 1
- 2021Systemic formalisation of Cyber-Physical-Social System (CPSS): A systematic literature reviewcited by 0
- 2021Optimize Neural Fictitious Self-Play in Regret Minimization Thinkingcited by 0
- 2021Using Computational Intelligence for solving the Ornstein-Zernike equationcited by 0
- 2022Deep Learning Training Procedure Augmentationscited by 0
- 2023Evolving Artificial Neural Networks To Imitate Human Behaviour In Shinobi III : Return of the Ninja Mastercited by 0
- 2023Generative Adversarial Neuroevolution for Control Behaviour Imitationcited by 0
- 2024Feint Behaviors and Strategies: Formalization, Implementation and Evaluationcited by 0
- 2024LookALike: Human Mimicry based collaborative decision makingcited by 0
- 2026TreeTensor: Boost AI System on Nested Data with Constrained Tree-Like Tensorcited by 0
- 2026Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarioscited by 0
- 2026Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarios25 Mar 2026
- 2026TreeTensor: Boost AI System on Nested Data with Constrained Tree-Like Tensor9 Feb 2026
- 2026Digital Red Queen: Adversarial Program Evolution in Core War with LLMs6 Jan 2026
- 2025Enhancing Language Agent Strategic Reasoning through Self-Play in Adversarial Games19 Oct 2025
- 2025Towards Neurocognitive-Inspired Intelligence: From AI's Structural Mimicry to Human-Like Functional Cognition9 Oct 2025
- 2025From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learning29 Jul 2025
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agents7 Jun 2025
- 2025Program Semantic Inequivalence Game with Large Language Models2 May 2025
- 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation12 Dec 2024
- 2024KALE-LM-Chem: Vision and Practice Toward an AI Brain for Chemistry27 Sep 2024
- 2024SOAP-RL: Sequential Option Advantage Propagation for Reinforcement Learning in POMDP Environments26 Jul 2024
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfinding20 Jul 2024
38 more
- 2024Efficient Multi-agent Reinforcement Learning by Planning20 May 2024
- 2024LookALike: Human Mimicry based collaborative decision making16 Mar 2024
- 2024Feint Behaviors and Strategies: Formalization, Implementation and Evaluation4 Mar 2024
- 2023LARP: Language-Agent Role Play for Open-World Games24 Dec 2023
- 2023B-Coder: Value-Based Deep Reinforcement Learning for Program Synthesis4 Oct 2023
- 2023Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Own4 Oct 2023
- 2023An Intentional Forgetting-Driven Self-Healing Method For Deep Reinforcement Learning Systems23 Aug 2023
- 2023Transferable Curricula through Difficulty Conditioned Generators22 Jun 2023
- 2023Gradient-Informed Quality Diversity for the Illumination of Discrete Spaces8 Jun 2023
- 2023ReLU to the Rescue: Improve Your On-Policy Actor-Critic with Positive Advantages2 Jun 2023
- 2023Information Design in Multi-Agent Reinforcement Learning8 May 2023
- 2023Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions6 Apr 2023
- 2023Generative Adversarial Neuroevolution for Control Behaviour Imitation3 Apr 2023
- 2023Evolving Artificial Neural Networks To Imitate Human Behaviour In Shinobi III : Return of the Ninja Master3 Apr 2023
- 2023RePreM: Representation Pre-training with Masked Model for Reinforcement Learning3 Mar 2023
- 2023Norm-based Generalization Bounds for Compositionally Sparse Neural Networks28 Jan 2023
- 2023Exploring the Approximation Capabilities of Multiplicative Neural Networks for Smooth Functions11 Jan 2023
- 2022E-MAPP: Efficient Multi-Agent Reinforcement Learning with Parallel Program Guidance5 Dec 2022
- 2022Reinforcement Learning from Simulation to Real World Autonomous Driving using Digital Twin27 Nov 2022
- 2022Deep Learning Training Procedure Augmentations25 Nov 2022
- 2022LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks14 Jun 2022
- 2022Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning11 May 2022
- 2022TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning30 Apr 2022
- 2022Reinforcement Learning from Partial Observation: Linear Function Approximation with Provable Sample Efficiency20 Apr 2022
- 2022Model-based Multi-agent Reinforcement Learning: Recent Progress and Prospects20 Mar 2022
- 2022Transfer Dynamics in Emergent Evolutionary Curricula3 Mar 2022
- 2022A Survey on Offline Reinforcement Learning: Taxonomy, Review, and Open Problems2 Mar 2022
- 2022On the Implicit Bias Towards Minimal Depth of Deep Neural Networks18 Feb 2022
- 2022FCMNet: Full Communication Memory Net for Team-Level Cooperation in Multi-Agent Systems28 Jan 2022
- 2021Lyapunov Exponents for Diversity in Differentiable Games24 Dec 2021
- 2021Value Activation for Bias Alleviation: Generalized-activated Deep Double Deterministic Policy Gradients21 Dec 2021
- 2021Using Computational Intelligence for solving the Ornstein-Zernike equation17 Nov 2021
- 2021Adversary agent reinforcement learning for pursuit-evasion25 Aug 2021
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directions29 Jun 2021
- 2021Differentiable Quality Diversity7 Jun 2021
- 2021Optimize Neural Fictitious Self-Play in Regret Minimization Thinking22 Apr 2021
- 2021Systemic formalisation of Cyber-Physical-Social System (CPSS): A systematic literature review11 Apr 2021
- 2019Multi-task Batch Reinforcement Learning with Metric Learning25 Sep 2019
- 2023LARP: Language-Agent Role Play for Open-World Gamescited by 24
- 2023Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Owncited by 16
- 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulationcited by 14
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agentscited by 8
- 2025Enhancing Language Agent Strategic Reasoning through Self-Play in Adversarial Gamescited by 1
- 2026Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarioscited by 0
- 2026Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarios25 Mar 2026
- 2025Enhancing Language Agent Strategic Reasoning through Self-Play in Adversarial Games19 Oct 2025
- 2025Modeling Earth-Scale Human-Like Societies with One Billion Agents7 Jun 2025
- 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation12 Dec 2024
- 2023LARP: Language-Agent Role Play for Open-World Games24 Dec 2023
- 2023Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Own4 Oct 2023
- 2022LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Taskscited by 146
- 2021Differentiable Quality Diversitycited by 71
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2023Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questionscited by 30
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfindingcited by 20
- 2022Model-based Multi-agent Reinforcement Learning: Recent Progress and Prospectscited by 17
- 2023B-Coder: Value-Based Deep Reinforcement Learning for Program Synthesiscited by 16
- 2022Reinforcement Learning from Partial Observation: Linear Function Approximation with Provable Sample Efficiencycited by 15
- 2022TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learningcited by 15
- 2022On the Implicit Bias Towards Minimal Depth of Deep Neural Networkscited by 12
- 2025From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learningcited by 11
- 2023ReLU to the Rescue: Improve Your On-Policy Actor-Critic with Positive Advantagescited by 10
12 most cited of 40 All 40 (JSON)
- 2026TreeTensor: Boost AI System on Nested Data with Constrained Tree-Like Tensor9 Feb 2026
- 2026Digital Red Queen: Adversarial Program Evolution in Core War with LLMs6 Jan 2026
- 2025Towards Neurocognitive-Inspired Intelligence: From AI's Structural Mimicry to Human-Like Functional Cognition9 Oct 2025
- 2025From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learning29 Jul 2025
- 2025Program Semantic Inequivalence Game with Large Language Models2 May 2025
- 2024KALE-LM-Chem: Vision and Practice Toward an AI Brain for Chemistry27 Sep 2024
- 2024SOAP-RL: Sequential Option Advantage Propagation for Reinforcement Learning in POMDP Environments26 Jul 2024
- 2024POGEMA: A Benchmark Platform for Cooperative Multi-Agent Pathfinding20 Jul 2024
- 2024Efficient Multi-agent Reinforcement Learning by Planning20 May 2024
- 2024LookALike: Human Mimicry based collaborative decision making16 Mar 2024
- 2024Feint Behaviors and Strategies: Formalization, Implementation and Evaluation4 Mar 2024
- 2023B-Coder: Value-Based Deep Reinforcement Learning for Program Synthesis4 Oct 2023
12 newest of 40 All 40 (JSON)