mlsanityData to 14 Oct 2026

EvoWorld: Evolving Panoramic World Generation with Explicit 3D Memory

arXiv 2510.01183 ↗First posted 1 Oct 2025cs.CVcited by 20

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Humans possess a remarkable ability to mentally explore and replay 3D environments they have previously experienced. Inspired by this mental process, we present EvoWorld: a world model that bridges panoramic video generation with evolving 3D memory to enable spatially consistent long-horizon exploration. Given a single panoramic image as input, EvoWorld first generates future video frames by leveraging a video generator with fine-grained view control, then evolves the scene's 3D reconstruction using a feedforward plug-and-play transformer, and finally synthesizes futures by conditioning on geometric reprojections from this evolving explicit 3D memory. Unlike prior state-of-the-arts that synthesize videos only, our key insight lies in exploiting this evolving 3D reconstruction as explicit spatial guidance for the video generation process, projecting the reconstructed geometry onto target viewpoints to provide rich spatial cues that significantly enhance both visual realism and geometric consistency. To evaluate long-range exploration capabilities, we introduce the first comprehensive benchmark spanning synthetic outdoor environments, Habitat indoor scenes, and challenging real-world scenarios, with particular emphasis on loop-closure detection and spatial coherence over extended trajectories. Extensive experiments demonstrate that our evolving 3D memory substantially improves visual fidelity and maintains spatial scene coherence compared to existing approaches, representing a significant advance toward long-horizon spatially consistent world modeling.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 64 of its 71 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

64 of 71 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Video World Models with Long-term Spatial Memory5 Jun
  2. 2025Learning 3D Persistent Embodied World Models5 May
  3. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  5. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  8. 2023Learning Interactive Real-World Simulators9 Oct
  9. 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
  10. 2020Denoising Diffusion Probabilistic Models19 Jun
  11. 2017Matterport3D: Learning from RGB-D Data in Indoor Environments18 Sep

Other references · 53

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  9. 2018World Modelscited by 1,513
  10. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  12. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
38 more
  1. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  2. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  3. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  4. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  5. 2018Open3D: A Modern Library for 3D Data Processingcited by 721
  6. 2023ModelScope Text-to-Video Technical Reportcited by 658
  7. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  8. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  9. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  10. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  11. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  12. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  13. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  14. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  15. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  16. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 331
  17. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  18. 2024Navigation World Modelscited by 272
  19. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
  20. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  21. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  22. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  23. 2025History-Guided Video Diffusioncited by 171
  24. 2023Video Language Planningcited by 162
  25. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  26. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
  27. 2021Pathdreamer: A World Model for Indoor Navigationcited by 118
  28. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
  29. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
  30. 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
  31. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
  32. 2024Video as the New Language for Real-World Decision Makingcited by 87
  33. 2024Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulationcited by 53
  34. 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videoscited by 40
  35. 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
  36. 2022Simple and Effective Synthesis of Indoor 3D Scenescited by 33
  37. 2025PanoWan: Lifting Diffusion Video Generation Models to 360deg with Latitude/Longitude-aware Mechanismscited by 23
  38. 2024GenEx: Generating an Explorable Worldcited by 21

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 19.

20 papers.

Sort:

By area:

  1. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
  2. 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoningcited by 7
  3. 2026Evolution of Video Generative Foundationscited by 7
  4. 2026A Mechanistic View on Video Generation as World Models: State and Dynamicscited by 6
  5. 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
  6. 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 6
  7. 2025Captain Safari: A World Engine with Pose-Aligned 3D Memorycited by 5
  8. 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
  9. 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffoldcited by 4
  10. 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
  11. 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Drivingcited by 3
  12. 2026E3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Controlcited by 2
8 more
  1. 2026World in World: Explore the World with World Modelscited by 0
  2. 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
  3. 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
  4. 2026Feedforward Novel View Synthesis for Heterogeneous Camerascited by 0
  5. 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolutioncited by 0
  6. 2026G2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigationcited by 0
  7. 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agentscited by 0
  8. 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion
  2. 2026Genie Sim PanoWorld: An Infinite Indoor 3D World Generation Pipeline via Panoramic Scene Modeling and Simulation
  3. 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling
  4. 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video
  5. 2026PanoWorld: Real-World Panoramic Generation
  6. 2025Matrix-3D: Omnidirectional Explorable 3D World Generation
  7. 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models
  8. 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space