mlsanityData to 14 Oct 2026

DiVA: Enabling Interactive Digital Life Simulation via Video Models

arXiv 2609.13830 ↗First posted 12 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present DiVA, a deeply interactive digital life simulator pioneering a new paradigm for long-term, open-ended interactive experiences within digital character worlds. DiVA's architecture pairs a Multimodal Large Language Model (MLLM) as a router with a meticulously designed stacked video pipeline for seamless, multi-turn interactions with action and audio response. To maintain continuity and avoid degradation, we model generation as a three-part coupled system: waiting video, action video, and the transitions between them. These transitions are critically handled by our Anchored Video Continuation (AVC) module, which returns the character to stable states to prevent degradation. By encoding information from the preceding action video segment, AVC ensures smooth transitions, significantly reducing camera jitter and inconsistencies common in current video transition methods. This design also enables complex pose changes (e.g., sitting to standing) typically difficult for audio-driven models. These system designs together ensure high-fidelity identity, coherence, and dynamics for extended experiences. To validate our pipeline design, we comprehensively compare our system against alternatives by replacing our core generation module with mainstream long-video, continuation, and interpolation methods. We further analyze the necessity of the three-stage design, anchor-state selection, transition naturalness, spatial grounding, and the quality-latency trade-off, and we expand the comparison to additional long-form audio-driven avatar models. Results confirm DiVA is markedly superior in maintaining long-term visual quality and realism, validating its effectiveness as a sustainable, interactive simulation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 50 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

40 of 50 references.

References · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Qwen Technical Reportcited by 3,344
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  9. 2022A Survey on In-context Learningcited by 721
  10. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  11. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  12. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
28 more
  1. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  2. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  3. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  4. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  5. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  6. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
  7. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  8. 2025Mixture of Contexts for Long Video Generationcited by 95
  9. 2025LongCat-Video Technical Reportcited by 85
  10. 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 72
  11. 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 66
  12. 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
  13. 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 61
  14. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
  15. 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 46
  16. 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generationcited by 44
  17. 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 41
  18. 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Imagescited by 35
  19. 2025EMO2: End-Effector Guided Audio-Driven Avatar Video Generationcited by 33
  20. 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Priorcited by 20
  21. 2022UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialogcited by 19
  22. 2025X-Streamer: Unified Human World Modeling with Audiovisual Interactioncited by 18
  23. 2024Unbounded: A Generative Infinite Game of Character Life Simulationcited by 14
  24. 2021Player-AI Interaction: What Neural Network Games Reveal About AI as Playcited by 8
  25. 2025AnimeGamer: Infinite Anime Life Simulation with Next Game State Predictioncited by 7
  26. 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
  27. 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generationcited by 6
  28. 2026AnyWorld: Factorized Egocentric World Models for Cross-Embodiment Generalizationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CustomX: Unified Character, Action, and Scene Customization in Video World Models
  2. 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
  3. 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
  4. 2025Yan: Foundational Interactive Video Generation
  5. 20264DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation
  6. 2025Pre-Trained Video Generative Models as World Simulators
  7. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
  8. 2026From Zero to Hero: Training-Free Custom Concept Spawning in World Models