Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
World models for interactive video generation have largely focused on single-agent settings, where future observations are generated from a single control signal. However, many generated environments require multi-agent interaction: multiple players, robots, or embodied agents act simultaneously within a shared space. Scaling world models to such settings requires a principled multi-agent design: agents should remain independently controllable, permutation-symmetric, and support efficient inference while maintaining consistency across time and perspectives. In this paper, we present our generative multi-agent world model for interactive simulation. It introduces Simplex Rotary Agent Encoding, a parameter-free extension of 3D RoPE that represents agents as vertices of a regular simplex in rotary angle space. This gives each agent a distinct phase while making all agents permutation-equivalent, enabling scalable agent identity without learned per-slot identities or a fixed agent ordering. To avoid dense all-to-all attention across agents, we further propose Sparse Hub Attention, where learnable hub tokens mediate token interaction across agents, reducing cross-agent attention cost from quadratic to linear in the number of agents. For real-time rollout, we distill a full-context diffusion teacher into a causal student that generates temporal blocks sequentially with KV caching, enabling action-responsive generation at 24 FPS. Experiments in multiplayer virtual environments show that our model improves video fidelity, action controllability, and inter-agent consistency over slot-based and dense-attention baselines, while generalizing from two to four players without additional training.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 57 of its 63 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
57 of 63 references.
Closest ancestors · 14
Same direction, newest first
- 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
- 2024Genie: Generative Interactive Environments23 Feb
- 2023Learning Interactive Real-World Simulators9 Oct
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Flow Matching for Generative Modeling6 Oct
2 more
Other references · 43
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Adversarial Diffusion Distillationcited by 759
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
31 more
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2026World Action Models are Zero-shot Policiescited by 465
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2026Causal World Modeling for Robot Controlcited by 321
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2024Navigation World Modelscited by 272
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2025Unified Video Action Modelcited by 205
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 87
- 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 84
- 2024Distilling Diffusion Models into Conditional GANscited by 78
- 2025Embodied AI Agents: Modeling the Worldcited by 61
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 50
- 2025Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesiscited by 41
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2026ReRoPE: Repurposing RoPE for Relative Camera Controlcited by 13
- 2025Generative World Modelling for Humanoids: 1X World Model Challenge Technical Reportcited by 8
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 11
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registerscited by 8
- 2026Population-Scalable Multi-Agent World Modelingcited by 5
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillationcited by 5
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Modelscited by 3
- 2026WorldCast: Distributed Multiplayer World Modelscited by 1
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Drivingcited by 0
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memorycited by 0
- 2026Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Updatecited by 0
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
3 more
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents14 Oct 2026
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communication12 Oct 2026
- 2026Esports World Model Dataset12 Oct 2026
- 2026WorldCast: Distributed Multiplayer World Models8 Oct 2026
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?8 Oct 2026
- 2026Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update4 Oct 2026
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory1 Oct 2026
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models18 Sep 2026
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation13 Aug 2026
3 more
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 11
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registerscited by 8
- 2026Population-Scalable Multi-Agent World Modelingcited by 5
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Modelscited by 3
- 2026WorldCast: Distributed Multiplayer World Modelscited by 1
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Drivingcited by 0
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memorycited by 0
- 2026Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Updatecited by 0
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?cited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
- 2026Esports World Model Datasetcited by 0
12 most cited of 14 All 14 (JSON)
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents14 Oct 2026
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communication12 Oct 2026
- 2026Esports World Model Dataset12 Oct 2026
- 2026WorldCast: Distributed Multiplayer World Models8 Oct 2026
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026MultiWorldBench: Do Independently Controlled Views Describe One Shared World?8 Oct 2026
- 2026Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update4 Oct 2026
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory1 Oct 2026
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models18 Sep 2026
- 2026Population-Scalable Multi-Agent World Modeling9 Aug 2026
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models
- 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Model
- 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data
- 2026Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
- 2024COMBO: Compositional World Models for Embodied Multi-Agent Cooperation
- 2025Transformer World Model for Sample Efficient Multi-Agent Reinforcement Learning