mlsanityData to 7 Oct 2026

Solaris: Building a Multiplayer Video World Model in Minecraft

arXiv 2602.22208 ↗First posted 25 Feb 2026cs.CVcited by 38

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Existing action-conditioned video generation models (video world models) are limited to single-agent perspectives, failing to capture the multi-agent interactions of real-world environments. We introduce Solaris, a multiplayer video world model that simulates consistent multi-view observations. To enable this, we develop a multiplayer data system designed for robust, continuous, and automated data collection on video games such as Minecraft. Unlike prior platforms built for single-player settings, our system supports coordinated multi-agent interaction and synchronized videos + actions capture. Using this system, we collect 12.64 million multiplayer frames and propose an evaluation framework for multiplayer movement, memory, grounding, building, and view consistency. We train Solaris using a staged pipeline that progressively transitions from single-player to multiplayer modeling, combining bidirectional, causal, and Self Forcing training. In the final stage, we introduce Checkpointed Self Forcing, a memory-efficient Self Forcing variant that enables a longer-horizon teacher. Results show our architecture and training design outperform existing baselines. Through open-sourcing our system and models, we hope to lay the groundwork for a new generation of multi-agent world models.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 51 of its 67 references that are in the map. First posted on arXiv 25 Feb 2026.

Builds on

51 of 67 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  2. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  3. 2025LoopNav: Benchmarking Spatial Consistency in World Models29 May
  4. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  6. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  7. 2023Learning Interactive Real-World Simulators9 Oct
  8. 2022Scalable Diffusion Models with Transformers19 Dec
  9. 2022Flow Matching for Generative Modeling6 Oct

Other references · 42

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2023Mastering Diverse Domains through World Modelscited by 1,193
  8. 2020Mastering Atari with Discrete World Modelscited by 990
  9. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  10. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  11. 2016Training Deep Nets with Sublinear Memory Costcited by 825
  12. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
30 more
  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  2. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  3. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  4. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  5. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  6. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  7. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  8. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  9. 2026World Action Models are Zero-shot Policiescited by 411
  10. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  11. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  12. 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
  13. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
  14. 2026Causal World Modeling for Robot Controlcited by 289
  15. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  16. 2025Diffusion Transformers with Representation Autoencoderscited by 275
  17. 2024Navigation World Modelscited by 262
  18. 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 210
  19. 2025Unified Video Action Modelcited by 195
  20. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  21. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
  22. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 168
  23. 2025Training Agents Inside of Scalable World Modelscited by 122
  24. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 117
  25. 2024Video as the New Language for Real-World Decision Makingcited by 86
  26. 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
  27. 2025WorldGym: World Model as An Environment for Policy Evaluationcited by 61
  28. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
  29. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 32
  30. 2025Generative World Modelling for Humanoids: 1X World Model Challenge Technical Reportcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 38.

38 papers.

Sort:

By area:

  1. 2026Infinite Worlds with Versatile Interactionscited by 37
  2. 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 19
  3. 2026Self Gradient Forcing: Native Long Video Extrapolationcited by 16
  4. 2026WorldKV: Efficient World Memory with World Retrieval and Compressioncited by 14
  5. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
  6. 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Modelscited by 10
  7. 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Playerscited by 10
  8. 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
  9. 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Modelscited by 9
  10. 2026ReactiveGWM: Steering NPC in Reactive Game World Modelscited by 9
  11. 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Datacited by 8
  12. 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
26 more
  1. 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 7
  2. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
  3. 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registerscited by 5
  4. 2026ActionParty: Multi-Subject Action Binding in Generative Video Gamescited by 4
  5. 2026Nano World Models: A Minimalist Implementation of Future Video Predictioncited by 4
  6. 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 4
  7. 2026Seeing Together: Multi-Robot Cooperative Egocentric Spatial Reasoning with Multimodal Large Language Modelscited by 3
  8. 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
  9. 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiversecited by 2
  10. 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 2
  11. 2026Population-Scalable Multi-Agent World Modelingcited by 2
  12. 2026AI for Games in the Foundation Model Eracited by 2
  13. 2026OptiWorld: Optimal Control for Video World Generation under Physical Constraintscited by 1
  14. 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
  15. 2026Can Video World Models Track Unobserved World States?cited by 1
  16. 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Modelscited by 1
  17. 2026Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubescited by 0
  18. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  19. 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
  20. 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Drivingcited by 0
  21. 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardwarecited by 0
  22. 2026Rollout-Marginal Distillation for Long-Horizon Autoregressive Video Generationcited by 0
  23. 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generationcited by 0
  24. 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0
  25. 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
  26. 2026WorldCast: Distributed Multiplayer World Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft
  2. 2025Matrix-Game: Interactive World Foundation Model
  3. 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft
  4. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
  5. 2026Multiplayer Interactive World Models with Representation Autoencoders
  6. 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models
  7. 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
  8. 2026GameWAM: A World Action Model for Video Games