Population-Scalable Multi-Agent World Modeling
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
World models have recently achieved impressive progress in visual prediction and interactive generation, but extending them to multi-agent environments introduces a fundamental scalability challenge. Existing methods generally assume a fixed number of agents during training and inference, which ties the model to a pre-determined agent population and limits inference-time scalability. Our key insight is that cross-view consistency should arise from a shared world state whose evolution does not assume a predefined number of agents, while agent-specific observations should be generated by querying this state through a unified rendering interface. Based on this insight, we propose Khora, a scalable multi-agent world model that supports inference-time expansion to arbitrary numbers of agents without retraining. Our framework decouples world-state evolution from visual rendering and introduces a population-agnostic rendering mechanism for incorporating other agent information. This design maintains cross-view consistency through the shared world state rather than through dense interactions among observation streams inside the expensive video generator, enabling approximately linear practical scaling with the number of queried views. Qualitative experiments demonstrate that our approach generalizes to unseen numbers of agents while maintaining visual quality and multi-agent consistency. We further implement a real-time interactive system to demonstrate scalable open-world simulation.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 17 of its 20 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
17 of 20 references.
Closest ancestors · 10
Same direction, newest first
- 2026Multiplayer Interactive World Models with Representation Autoencoders6 Jul
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players27 May
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models20 Apr
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines3 Mar
- 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models20 May
- 2024Genie: Generative Interactive Environments23 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale22 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 7
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
- 2025AdaWorld: Learning Adaptable World Models with Latent Actionscited by 114
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
- 2026Esports World Model Datasetcited by 0
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communicationcited by 0
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agentscited by 0
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents14 Oct 2026
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communication12 Oct 2026
- 2026Esports World Model Dataset12 Oct 2026
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Model
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models
- 2026MASS: Multiplayer World Models with Authoritative Shared State
- 2024COMBO: Compositional World Models for Embodied Multi-Agent Cooperation
- 2026Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap