Esports World Model Dataset
New in World models; no direction yet. World models
Abstract (arXiv)
Interactive world models must capture how multiple participants jointly change a shared environment while observing different parts of it. Competitive games make this challenge concrete: players cooperate and compete, while fog of war, team vision and camera placement determine what each can see. Modeling these interactions requires data that connect individual observations and actions to shared state and events. We introduce the Esports World Model Dataset (EWM), a collection of human gameplay spanning StarCraft II, Dota 2 and Counter-Strike 2, with 3,053 games and maps and approximately 4,880 player-view hours, including estimated hours for the ongoing CS2 extension. It includes 4,628 completed StarCraft II views, all ten perspectives for 303 Dota 2 matches, and up to ten views per round in CS2. Across these views, replay-clock alignment connects rendered video with game-native actions, structured state and events from the same match. The three games expose complementary observation conditions: private fog of war, shared team vision and first-person viewpoints. In StarCraft II, player-specific entity records further distinguish live observations from remembered snapshots and link co-observed entities across opposing views. Together with temporal alignment, these records allow researchers to distinguish legitimate information differences from disagreement about shared state. By connecting human decisions, shared dynamics and player-specific information, EWM supports research toward jointly controlled multiplayer world models and interactive environments populated by teammates and opponents learned from human play.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 35 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
32 of 35 references.
References · 32
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2018World Modelscited by 1,513
- 2018Datasheets for Datasetscited by 1,386
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 345
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2024Diffusion Models Are Real-Time Game Enginescited by 296
20 more
- 2017StarCraft II: A New Challenge for Reinforcement Learningcited by 274
- 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 215
- 2021Counter-Strike Deathmatch with Large-Scale Behavioural Cloningcited by 50
- 2024COMBO: Compositional World Models for Embodied Multi-Agent Cooperationcited by 49
- 2026Solaris: Building a Multiplayer Video World Model in Minecraftcited by 47
- 2026NitroGen: An Open Foundation Model for Generalist Gaming Agentscited by 27
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 23
- 2026Multiplayer Interactive World Models with Representation Autoencoderscited by 19
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Playerscited by 15
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 11
- 2023AlphaStar Unplugged: Large-Scale Offline Reinforcement Learningcited by 9
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registerscited by 8
- 2017STARDATA: A StarCraft AI Research Datasetcited by 7
- 2017MSC: A Dataset for Macro-Management in StarCraft IIcited by 7
- 2026EgoCS-400K: An Egocentric Gameplay Dataset for World Modelscited by 5
- 2026Population-Scalable Multi-Agent World Modelingcited by 5
- 2018Forward Modeling for Partial Observation Strategy Games - A StarCraft Defoggercited by 4
- 2025X-Ego: Acquiring Team-Level Tactical Situational Awareness via Cross-Egocentric Contrastive Video Representation Learningcited by 3
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Modelscited by 3
- 2026Computer Vision for MOBA Analytics: A Dataset and Baseline for Visibility Analysis in Dota 2cited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026WorldCast: Distributed Multiplayer World Models
- 2026Account Consistency from Gameplay Traces: Same-Player Verification in Counter-Strike 2
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents
- 2024StarCraftImage: A Dataset For Prototyping Spatial Reasoning Methods For Multi-Agent Environments
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
- 2024SC-Phi2: A Fine-tuned Small Language Model for StarCraft II Macromanagement Tasks
- 2025Matrix-Game: Interactive World Foundation Model
- 2022Dungeons and Data: A Large-Scale NetHack Dataset