Solaris: Building a Multiplayer Video World Model in Minecraft
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Existing action-conditioned video generation models (video world models) are limited to single-agent perspectives, failing to capture the multi-agent interactions of real-world environments. We introduce Solaris, a multiplayer video world model that simulates consistent multi-view observations. To enable this, we develop a multiplayer data system designed for robust, continuous, and automated data collection on video games such as Minecraft. Unlike prior platforms built for single-player settings, our system supports coordinated multi-agent interaction and synchronized videos + actions capture. Using this system, we collect 12.64 million multiplayer frames and propose an evaluation framework for multiplayer movement, memory, grounding, building, and view consistency. We train Solaris using a staged pipeline that progressively transitions from single-player to multiplayer modeling, combining bidirectional, causal, and Self Forcing training. In the final stage, we introduce Checkpointed Self Forcing, a memory-efficient Self Forcing variant that enables a longer-horizon teacher. Results show our architecture and training design outperform existing baselines. Through open-sourcing our system and models, we hope to lay the groundwork for a new generation of multi-agent world models.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 51 of its 67 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
51 of 67 references.
Closest ancestors · 9
Same direction, newest first
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025LoopNav: Benchmarking Spatial Consistency in World Models29 May
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2023Learning Interactive Real-World Simulators9 Oct
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Flow Matching for Generative Modeling6 Oct
Other references · 42
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2016Training Deep Nets with Sublinear Memory Costcited by 825
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
30 more
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
- 2026World Action Models are Zero-shot Policiescited by 411
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2026Causal World Modeling for Robot Controlcited by 289
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2024Navigation World Modelscited by 262
- 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 210
- 2025Unified Video Action Modelcited by 195
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 168
- 2025Training Agents Inside of Scalable World Modelscited by 122
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 117
- 2024Video as the New Language for Real-World Decision Makingcited by 86
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
- 2025WorldGym: World Model as An Environment for Policy Evaluationcited by 61
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 32
- 2025Generative World Modelling for Humanoids: 1X World Model Challenge Technical Reportcited by 8
Built on by
Citing papers per year: 2026: 38.
38 papers.
Sort:
By area:
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 19
- 2026Self Gradient Forcing: Native Long Video Extrapolationcited by 16
- 2026WorldKV: Efficient World Memory with World Retrieval and Compressioncited by 14
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
- 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Modelscited by 10
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Playerscited by 10
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
- 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Modelscited by 9
- 2026ReactiveGWM: Steering NPC in Reactive Game World Modelscited by 9
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Datacited by 8
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
26 more
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 7
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registerscited by 5
- 2026ActionParty: Multi-Subject Action Binding in Generative Video Gamescited by 4
- 2026Nano World Models: A Minimalist Implementation of Future Video Predictioncited by 4
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 4
- 2026Seeing Together: Multi-Robot Cooperative Egocentric Spatial Reasoning with Multimodal Large Language Modelscited by 3
- 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiversecited by 2
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 2
- 2026Population-Scalable Multi-Agent World Modelingcited by 2
- 2026AI for Games in the Foundation Model Eracited by 2
- 2026OptiWorld: Optimal Control for Video World Generation under Physical Constraintscited by 1
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
- 2026Can Video World Models Track Unobserved World States?cited by 1
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Modelscited by 1
- 2026Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubescited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Drivingcited by 0
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardwarecited by 0
- 2026Rollout-Marginal Distillation for Long-Horizon Autoregressive Video Generationcited by 0
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generationcited by 0
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
- 2026WorldCast: Distributed Multiplayer World Modelscited by 0
- 2026WorldCast: Distributed Multiplayer World Models8 Oct 2026
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?8 Oct 2026
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generation7 Oct 2026
- 2026Rollout-Marginal Distillation for Long-Horizon Autoregressive Video Generation29 Sep 2026
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware29 Sep 2026
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models18 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Can Video World Models Track Unobserved World States?31 Aug 2026
- 2026Magpie: Real-Time World Renderer for Interactive Games27 Aug 2026
26 more
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026Population-Scalable Multi-Agent World Modeling9 Aug 2026
- 2026MASS: Multiplayer World Models with Authoritative Shared State6 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers23 Jul 2026
- 2026Self Gradient Forcing: Native Long Video Extrapolation22 Jul 2026
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction14 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory16 Jun 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Model8 Jun 2026
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026OptiWorld: Optimal Control for Video World Generation under Physical Constraints30 May 2026
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players27 May 2026
- 2026WorldKV: Efficient World Memory with World Retrieval and Compression21 May 2026
- 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Models18 May 2026
- 2026Seeing Together: Multi-Robot Cooperative Egocentric Spatial Reasoning with Multimodal Large Language Models18 May 2026
- 2026Nano World Models: A Minimalist Implementation of Future Video Prediction17 May 2026
- 2026ReactiveGWM: Steering NPC in Reactive Game World Models14 May 2026
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiverse11 May 2026
- 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Models9 May 2026
- 2026Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubes22 Apr 2026
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models20 Apr 2026
- 2026ActionParty: Multi-Subject Action Binding in Generative Video Games2 Apr 2026
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 19
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
- 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Modelscited by 10
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Playerscited by 10
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
- 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Modelscited by 9
- 2026ReactiveGWM: Steering NPC in Reactive Game World Modelscited by 9
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Datacited by 8
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 7
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registerscited by 5
12 most cited of 25 All 25 (JSON)
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware29 Sep 2026
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models18 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Can Video World Models Track Unobserved World States?31 Aug 2026
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026Population-Scalable Multi-Agent World Modeling9 Aug 2026
- 2026MASS: Multiplayer World Models with Authoritative Shared State6 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers23 Jul 2026
12 newest of 25 All 25 (JSON)
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiversecited by 2
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 2
- 2026Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubescited by 0
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generationcited by 0
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
- 2026WorldCast: Distributed Multiplayer World Modelscited by 0
- 2026WorldCast: Distributed Multiplayer World Models8 Oct 2026
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?8 Oct 2026
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generation7 Oct 2026
- 2026Magpie: Real-Time World Renderer for Interactive Games27 Aug 2026
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction14 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiverse11 May 2026
- 2026Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubes22 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft
- 2025Matrix-Game: Interactive World Foundation Model
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
- 2026Multiplayer Interactive World Models with Representation Autoencoders
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
- 2026GameWAM: A World Action Model for Video Games