mlsanityData to 7 Oct 2026

Video-generation world models and simulators

349 papers7 this weekMedium confidence in this grouping: mostly one topic, with blurry edgesMedium confidence in this grouping: mostly one topic, with blurry edges · About

Keywords: video, generation, interactive, consistency, memory

Key facts. Video-generation world models and simulators: 349 papers on arXiv since 2017 (data through 7 Oct 2026). 158 of its 349 mapped papers (45%) cite “Wan: Open and Advanced Large-Scale Video Generative Models” (2025, arXiv 2503.20314). 120 of its 349 mapped papers (34%) cite “Genie: Generative Interactive Environments” (2024, arXiv 2402.15391). 50 new papers 17 Sep–7 Oct.

What’s new

17 Sep – 7 Oct 2026

50 new papers, 17 Sep – 7 Oct; 7 this week.

  1. This week · 7
  2. STRIKE: Learning Visual State Transitions for Physical World Modeling also fits: Latent predictive world models
  3. Kuration SDK: Addressing the Virtual2Real Gap via Data Curation also fits: Latent predictive world models
  4. SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation
  5. CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching
  6. WorldSonus: Bringing Sound to Worlds
  7. Tracking Is Not Permanence: What Video World Models Keep of a Hidden Object
  8. HLA-WM: Hybrid Linear Attention for Long-Horizon Video World Models
  9. Earlier · 43
  10. Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update
  11. PWM: Personalized World Models with Online Reinforcement Learning
  12. Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
All 50
  1. Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution
  2. World Embedding Benchmark also fits: Latent predictive world models
  3. Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models also fits: Latent predictive world models
  4. SymRegFlow: Symmetry-Regularized Flow Matching for Video World Models
  5. SpectralCache: Accelerating Diffusion-Based World Models via Spectral Feature Caching
  6. Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory
  7. ROWBench: Do Video Models Render What the Program Specifies?
  8. World Observer: Joint Actor-Observer Generation for Persistent World Modeling also fits: World models for navigation
  9. 4Director: Controlling Video World Models with Rigid 3D Geometry
  10. Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models
  11. SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation
  12. Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model
  13. LOCI: Spatial Linear Memory for Streaming World Models
  14. SteerQuant: Steering Quantization Error with Action-Guided Scaling in World-Action Models also fits: Latent predictive world models
  15. Honeycomb: Constant-Size Scene Memory Representation for Video World Models
  16. Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware
  17. World2Motion: Turning Video World Models into 3D Human Motion Generators
  18. LongTake: Learning to Sustain Dynamics in Long-Horizon Video Generation
  19. Audible World Models: Spatially Aware Sound Generation for 3D Worlds
  20. HelixWorld: A Real-time Interactive Audio-Visual World Model
  21. MeteoVerse: Unified Weather-Controllable Video World Model
  22. Foresight at the Event Boundary: Evaluating Physical Prediction in Video World Models also fits: Latent predictive world models
  23. WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon
  24. OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Models
  25. WorldAttention: An Efficient Attention Architecture for Interactive Video World Models
  26. Precise Editing and Flexible Referencing for Interactable Worlds
  27. WorldWeave: Growing Persistent Geometric Worlds for Video Generation
  28. CAST: Reconstruction-Coupled Acceleration of Interactive World Models
  29. ReSync: Re-Aligning the Two Clocks of Asynchronous World-Action Models also fits: Latent predictive world models
  30. From Feed-Forward to Flow: Unifying Reconstruction and Generation Is Easier Than You Think
  31. Cache-Aware Conv3D Lowering Across Embedded World-Model Decoders
  32. StarWM: Self-Supervised Trained Attention Routing for Robust World Models
  33. The Past Frames the Future: Memory for Autoregressive Video Generation
  34. Code Plans, Diffusion Renders: Open-Ended Generative World Modeling
  35. QuantWM: Temporally Consistent 2-Bit KV Cache Quantization for World Models and Video Generation
  36. GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models also fits: World models for language agents
  37. WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
  38. HappyWorld-Bench also fits: World models for language agents
  39. ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models
  40. Astronex-World 1.0: Real-Time Interactive World Model Foundation

Foundations

Most cited by papers here

  1. Wan: Open and Advanced Large-Scale Video Generative Models2025cited by 158 here
  2. Genie: Generative Interactive Environments2024cited by 120 here
  3. Scalable Diffusion Models with Transformers2022cited by 119 here
  4. CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer2024cited by 105 here
  5. Denoising Diffusion Probabilistic Models2020cited by 90 here

Lineage

The papers this direction builds on, oldest first.

Each paper on the line cites the one before.

  1. 2018World Modelscited by 93 here
  2. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 55 here
  3. 2023Mastering Diverse Domains through World Modelscited by 46 here
  4. 2023Learning Interactive Real-World Simulatorscited by 57 here
  5. 2024Genie: Generative Interactive Environmentscited by 120 here
  6. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 71 here
  7. 2024GameGen-X: Interactive Open-world Game Video Generationcited by 56 here
  8. 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 53 here
  9. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 80 here
  10. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 63 here
  11. 2026Advancing Open-source World Modelscited by 62 here
13 more it builds on, not in this chain
  1. 2018Recurrent World Models Facilitate Policy Evolutioncited by 47 here
  2. 2020Denoising Diffusion Probabilistic Modelscited by 90 here
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 86 here
  4. 2022Flow Matching for Generative Modelingcited by 62 here
  5. 2022Scalable Diffusion Models with Transformerscited by 119 here
  6. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 62 here
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 86 here
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 105 here
  9. 2024Diffusion Models Are Real-Time Game Enginescited by 89 here
  10. 2025Cosmos World Foundation Model Platform for Physical AIcited by 83 here
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 158 here
  12. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 60 here
  13. 2025Video World Models with Long-term Spatial Memorycited by 48 here

The 24 most cited of 681.

Browse

30 of 349, ranked 6–35

  1. 6Diffusion Models Are Real-Time Game Engines202489
  2. 7Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets202386
  3. 8Learning Transferable Visual Models From Natural Language Supervision202186
  4. 9Matrix-game 2.0: An open-source real-time and streaming interactive world model202580
  5. 10WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling202563
  6. 11Advancing Open-source World Models202662
  7. 12Flow Matching for Generative Modeling202262
  8. 13WorldMem: Long-term Consistent World Simulation with Memory202560
  9. 14Learning Interactive Real-World Simulators202357
  10. 15GameGen-X: Interactive Open-world Game Video Generation202456
All 30
  1. 16GameFactory: Creating New Games with Generative Interactive Videos202553
  2. 17Video World Models with Long-term Spatial Memory202548
  3. 18Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory202645
  4. 19Yume: An Interactive World Generation Model202545
  5. 20RELIC: Interactive Video World Model with Long-Horizon Memory202544
  6. 21WorldSimBench: Towards Video Generation Models as World Simulators202442
  7. 22MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft202541
  8. 23Score-Based Generative Modeling through Stochastic Differential Equations202038
  9. 24Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model202536
  10. 25Open-Sora: Democratizing Efficient Video Production for All202434
  11. 26VideoGPT: Video Generation using VQ-VAE and Transformers202134
  12. 27An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale202033
  13. 28StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text202431
  14. 29WorldModelBench: Judging Video Generation Models As World Models202526
  15. 30Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory202625
  16. 31Long-Context State-Space Video World Models202522
  17. 32Rolling Forcing: Autoregressive Long Video Diffusion in Real Time202521
  18. 33DreamFusion: Text-to-3D using 2D Diffusion202220
  19. 34SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer202619
  20. 35MAGI-1: Autoregressive Video Generation at Scale202519