mlsanityData to 14 Oct 2026

Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players

arXiv 2605.28816 ↗First posted 27 May 2026cs.CVcited by 15

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World models for interactive video generation have largely focused on single-agent settings, where future observations are generated from a single control signal. However, many generated environments require multi-agent interaction: multiple players, robots, or embodied agents act simultaneously within a shared space. Scaling world models to such settings requires a principled multi-agent design: agents should remain independently controllable, permutation-symmetric, and support efficient inference while maintaining consistency across time and perspectives. In this paper, we present our generative multi-agent world model for interactive simulation. It introduces Simplex Rotary Agent Encoding, a parameter-free extension of 3D RoPE that represents agents as vertices of a regular simplex in rotary angle space. This gives each agent a distinct phase while making all agents permutation-equivalent, enabling scalable agent identity without learned per-slot identities or a fixed agent ordering. To avoid dense all-to-all attention across agents, we further propose Sparse Hub Attention, where learnable hub tokens mediate token interaction across agents, reducing cross-agent attention cost from quadratic to linear in the number of agents. For real-time rollout, we distill a full-context diffusion teacher into a causal student that generates temporal blocks sequentially with KV caching, enabling action-responsive generation at 24 FPS. Experiments in multiplayer virtual environments show that our model improves video fidelity, action controllability, and inter-agent consistency over slot-based and dense-attention baselines, while generalizing from two to four players without additional training.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 57 of its 63 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

57 of 63 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
  2. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  3. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  4. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  6. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  8. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
  9. 2024Genie: Generative Interactive Environments23 Feb
  10. 2023Learning Interactive Real-World Simulators9 Oct
  11. 2022Scalable Diffusion Models with Transformers19 Dec
  12. 2022Flow Matching for Generative Modeling6 Oct
2 more
  1. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  2. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 43

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  4. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  6. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  7. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  8. 2023Adversarial Diffusion Distillationcited by 759
  9. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  10. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  11. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  12. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
31 more
  1. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  2. 2025Mean Flows for One-step Generative Modelingcited by 561
  3. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
  4. 2026World Action Models are Zero-shot Policiescited by 465
  5. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  6. 2024One Step Diffusion via Shortcut Modelscited by 391
  7. 2026Causal World Modeling for Robot Controlcited by 321
  8. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  9. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  10. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  11. 2024Navigation World Modelscited by 272
  12. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
  13. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  14. 2025Video models are zero-shot learners and reasonerscited by 220
  15. 2025Unified Video Action Modelcited by 205
  16. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  17. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  18. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
  19. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
  20. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
  21. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
  22. 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 87
  23. 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 84
  24. 2024Distilling Diffusion Models into Conditional GANscited by 78
  25. 2025Embodied AI Agents: Modeling the Worldcited by 61
  26. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 50
  27. 2025Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesiscited by 41
  28. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
  29. 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
  30. 2026ReRoPE: Repurposing RoPE for Relative Camera Controlcited by 13
  31. 2025Generative World Modelling for Humanoids: 1X World Model Challenge Technical Reportcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models
  2. 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling
  3. 2026Prisma-World: Camera-Controllable Multi-Agent Video World Model
  4. 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models
  5. 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data
  6. 2026Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
  7. 2024COMBO: Compositional World Models for Embodied Multi-Agent Cooperation
  8. 2025Transformer World Model for Sample Efficient Multi-Agent Reinforcement Learning