mlsanityData to 14 Oct 2026

Prisma-World: Camera-Controllable Multi-Agent Video World Model

arXiv 2606.09507 ↗First posted 8 Jun 2026cs.CVcited by 11

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Video world models have made rapid progress in generating controllable visual experiences, but most of them still simulate the world from a single observer. Extending such models to multiple agents raises a central challenge: if each agent's future state is generated independently, overlapping views may instantiate different versions of the same scene, leading to inconsistent objects, layouts, and appearances across agents. Conventional camera conditioning controls individual trajectories, but it does not explicitly couple the generation of views that should agree under shared scene geometry. We introduce Prisma-World, a camera-controllable multi-agent world model that formulates multi-agent generation as a joint geometry-aware denoising process for cross-view consistency. Prisma-World processes all agent videos within one full-attention sequence, uses a multi-agent RoPE design to distinguish agent identities while preserving synchronized temporal coordinates, and injects relative camera geometry into attention to bias overlapping viewpoints toward shared scene evidence. To further strengthen multi-view consistency and enhance global spatial perception, we augment our framework with an overlap-decaying curriculum training paradigm alongside minimap-conditioned structural guidance. To facilitate the training and evaluation of multi-agent models, we introduce PrismaDataset, a large-scale UE5 dataset with panoramic acquisition across diverse scenes, composable multi-agent view groups with flexible agent counts and complex camera trajectories, and precise camera/action annotations for consistency training and evaluation. Experiments show that a single Prisma-World model can generate high-fidelity multi-agent videos with flexible agent numbers, camera controllability, improved cross-view consistency, and spatial grounding under minimap guidance.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 64 of its 68 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

64 of 68 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models20 Apr
  2. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  3. 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
  4. 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
  5. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  6. 2026Advancing Open-source World Models28 Jan
  7. 2025Unified Camera Positional Encoding for Controlled Video Generation8 Dec
  8. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  9. 2025IC-World: In-Context Generation for Shared World Modeling1 Dec
  10. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  11. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  12. 2025Yume: An Interactive World Generation Model23 Jul
7 more
  1. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling10 Jul
  2. 2025Video World Models with Long-term Spatial Memory5 Jun
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  4. 2024AVID: Adapting Video Diffusion Models to World Models1 Oct
  5. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  6. 2024Pandora: Towards General World Model with Natural Language Actions and Video States12 Jun
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov

Other references · 45

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  4. 2018World Modelscited by 1,513
  5. 2023Mastering Diverse Domains through World Modelscited by 1,253
  6. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  7. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  8. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  9. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  10. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  11. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  12. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
33 more
  1. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  2. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  3. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  4. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  5. 2026Causal World Modeling for Robot Controlcited by 321
  6. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  7. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  8. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  9. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  10. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  11. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
  12. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  13. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  14. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  15. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  16. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
  17. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  18. 2025Cameras as Relative Positional Encodingcited by 105
  19. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
  20. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  21. 2025Aether: Geometric-Aware Unified World Modelingcited by 97
  22. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
  23. 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
  24. 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 79
  25. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
  26. 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 52
  27. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
  28. 2026NitroGen: An Open Foundation Model for Generalist Gaming Agentscited by 27
  29. 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attentioncited by 24
  30. 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
  31. 2025Physical Autoregressive Model for Robotic Manipulation without Action Pretrainingcited by 12
  32. 2025Enhancing Physical Consistency in Lightweight World Modelscited by 5
  33. 2025Captain Safari: A World Engine with Pose-Aligned 3D Memorycited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data
  2. 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling
  3. 2026Cross-View World Models
  4. 2026Population-Scalable Multi-Agent World Modeling
  5. 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players
  6. 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers
  7. 2026Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
  8. 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling