Generative World Simulation with DAO and JING
Not on the map. Why?
Abstract (arXiv)
We present a Generative World Simulation framework that couples persistent shared world state with continuous first-person audiovisual generation. The framework integrates DAO, a computable world engine, and JING, an Egocentric Interactive Experience Model, to support sustained interaction for humans and agents. DAO maintains the states of characters, objects, and spaces and their relationships, advancing the world according to interaction rules and world time while preserving the consequences of past actions. From this evolving state, DAO derives observer-specific conditions for JING, which combines these conditions with character, object, and scene references, observation history, and current actions to generate each observer's audiovisual experience. Users can explore environments, manipulate objects, and communicate with characters through viewpoint control and text instructions, with their actions shaping both the shared state and subsequent experiences. By connecting world-state evolution with experience generation in a continuous interaction loop, the framework offers an approach to building interactive worlds that retain their history, evolve through action, and persist beyond any individual observer.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
40 of 47 references.
References · 40
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
28 more
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 97
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2025Sekai: A Video Dataset towards World Explorationcited by 67
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Modelcited by 61
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 39
- 2024SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Textcited by 26
- 2026Hand2World: Autoregressive Egocentric Interaction Generation via Free-Space Hand Gesturescited by 16
- 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generationcited by 16
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
- 2026EgoSim: Egocentric World Simulator for Embodied Interaction Generationcited by 14
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless Worldcited by 14
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 13
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 12
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 11
- 2026Programmable World Modelcited by 10
- 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 6
- 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generationcited by 6
- 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearancecited by 6
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Controlcited by 4
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editingcited by 2
Built on by
Not cited yet.