Prisma-World: Camera-Controllable Multi-Agent Video World Model
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Video world models have made rapid progress in generating controllable visual experiences, but most of them still simulate the world from a single observer. Extending such models to multiple agents raises a central challenge: if each agent's future state is generated independently, overlapping views may instantiate different versions of the same scene, leading to inconsistent objects, layouts, and appearances across agents. Conventional camera conditioning controls individual trajectories, but it does not explicitly couple the generation of views that should agree under shared scene geometry. We introduce Prisma-World, a camera-controllable multi-agent world model that formulates multi-agent generation as a joint geometry-aware denoising process for cross-view consistency. Prisma-World processes all agent videos within one full-attention sequence, uses a multi-agent RoPE design to distinguish agent identities while preserving synchronized temporal coordinates, and injects relative camera geometry into attention to bias overlapping viewpoints toward shared scene evidence. To further strengthen multi-view consistency and enhance global spatial perception, we augment our framework with an overlap-decaying curriculum training paradigm alongside minimap-conditioned structural guidance. To facilitate the training and evaluation of multi-agent models, we introduce PrismaDataset, a large-scale UE5 dataset with panoramic acquisition across diverse scenes, composable multi-agent view groups with flexible agent counts and complex camera trajectories, and precise camera/action annotations for consistency training and evaluation. Experiments show that a single Prisma-World model can generate high-fidelity multi-agent videos with flexible agent numbers, camera controllability, improved cross-view consistency, and spatial grounding under minimap guidance.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 64 of its 68 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
64 of 68 references.
Closest ancestors · 19
Same direction, newest first
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models20 Apr
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
- 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
- 2026Advancing Open-source World Models28 Jan
- 2025Unified Camera Positional Encoding for Controlled Video Generation8 Dec
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025IC-World: In-Context Generation for Shared World Modeling1 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
7 more
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling10 Jul
- 2025Video World Models with Long-term Spatial Memory5 Jun
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024AVID: Adapting Video Diffusion Models to World Models1 Oct
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024Pandora: Towards General World Model with Natural Language Actions and Video States12 Jun
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
Other references · 45
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
33 more
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2026Causal World Modeling for Robot Controlcited by 321
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2025Cameras as Relative Positional Encodingcited by 105
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025Aether: Geometric-Aware Unified World Modelingcited by 97
- 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 79
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 52
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
- 2026NitroGen: An Open Foundation Model for Generalist Gaming Agentscited by 27
- 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attentioncited by 24
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
- 2025Physical Autoregressive Model for Robotic Manipulation without Action Pretrainingcited by 12
- 2025Enhancing Physical Consistency in Lightweight World Modelscited by 5
- 2025Captain Safari: A World Engine with Pose-Aligned 3D Memorycited by 5
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 11
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Modelscited by 3
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
- 2026WorldCast: Distributed Multiplayer World Modelscited by 1
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modelingcited by 0
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Drivingcited by 0
- 2026Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Updatecited by 0
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interactioncited by 0
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communicationcited by 0
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agentscited by 0
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents14 Oct 2026
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communication12 Oct 2026
- 2026WorldCast: Distributed Multiplayer World Models8 Oct 2026
- 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction8 Oct 2026
- 2026Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update4 Oct 2026
- 2026CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models18 Sep 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026MASS: Multiplayer World Models with Authoritative Shared State6 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data
- 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modeling
- 2026Cross-View World Models
- 2026Population-Scalable Multi-Agent World Modeling
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players
- 2026Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers
- 2026Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling