EvoWorld: Evolving Panoramic World Generation with Explicit 3D Memory
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Humans possess a remarkable ability to mentally explore and replay 3D environments they have previously experienced. Inspired by this mental process, we present EvoWorld: a world model that bridges panoramic video generation with evolving 3D memory to enable spatially consistent long-horizon exploration. Given a single panoramic image as input, EvoWorld first generates future video frames by leveraging a video generator with fine-grained view control, then evolves the scene's 3D reconstruction using a feedforward plug-and-play transformer, and finally synthesizes futures by conditioning on geometric reprojections from this evolving explicit 3D memory. Unlike prior state-of-the-arts that synthesize videos only, our key insight lies in exploiting this evolving 3D reconstruction as explicit spatial guidance for the video generation process, projecting the reconstructed geometry onto target viewpoints to provide rich spatial cues that significantly enhance both visual realism and geometric consistency. To evaluate long-range exploration capabilities, we introduce the first comprehensive benchmark spanning synthetic outdoor environments, Habitat indoor scenes, and challenging real-world scenarios, with particular emphasis on loop-closure detection and spatial coherence over extended trajectories. Extensive experiments demonstrate that our evolving 3D memory substantially improves visual fidelity and maintains spatial scene coherence compared to existing approaches, representing a significant advance toward long-horizon spatially consistent world modeling.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 64 of its 71 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
64 of 71 references.
Closest ancestors · 11
Same direction, newest first
- 2025Video World Models with Long-term Spatial Memory5 Jun
- 2025Learning 3D Persistent Embodied World Models5 May
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023Learning Interactive Real-World Simulators9 Oct
- 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
- 2020Denoising Diffusion Probabilistic Models19 Jun
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environments18 Sep
Other references · 53
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024GPT-4o System Cardcited by 4,588
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2018World Modelscited by 1,513
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
38 more
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 331
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
- 2024Navigation World Modelscited by 272
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2025History-Guided Video Diffusioncited by 171
- 2023Video Language Planningcited by 162
- 2023WonderJourney: Going from Anywhere to Everywherecited by 158
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
- 2021Pathdreamer: A World Model for Indoor Navigationcited by 118
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
- 2024Video as the New Language for Real-World Decision Makingcited by 87
- 2024Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulationcited by 53
- 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videoscited by 40
- 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
- 2022Simple and Effective Synthesis of Indoor 3D Scenescited by 33
- 2025PanoWan: Lifting Diffusion Video Generation Models to 360deg with Latitude/Longitude-aware Mechanismscited by 23
- 2024GenEx: Generating an Explorable Worldcited by 21
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 19.
20 papers.
Sort:
By area:
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
- 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoningcited by 7
- 2026Evolution of Video Generative Foundationscited by 7
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamicscited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 6
- 2025Captain Safari: A World Engine with Pose-Aligned 3D Memorycited by 5
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffoldcited by 4
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Drivingcited by 3
- 2026E3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Controlcited by 2
8 more
- 2026World in World: Explore the World with World Modelscited by 0
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
- 2026Feedforward Novel View Synthesis for Heterogeneous Camerascited by 0
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolutioncited by 0
- 2026G2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigationcited by 0
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agentscited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generationcited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation14 Oct 2026
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents14 Oct 2026
- 2026G2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigation12 Oct 2026
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution2 Oct 2026
- 2026Feedforward Novel View Synthesis for Heterogeneous Cameras2 Oct 2026
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Models29 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026AlayaWorld: Long-Horizon and Playable Video World Generation7 Jul 2026
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold11 Jun 2026
- 2026E3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control25 May 2026
- 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Driving21 May 2026
8 more
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics22 Jan 2026
- 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning19 Jan 2026
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control8 Jan 2026
- 2025Captain Safari: A World Engine with Pose-Aligned 3D Memory28 Nov 2025
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
- 2026Evolution of Video Generative Foundationscited by 7
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamicscited by 6
- 2026AlayaWorld: Long-Horizon and Playable Video World Generationcited by 6
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffoldcited by 4
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026World in World: Explore the World with World Modelscited by 0
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolutioncited by 0
- 2026G2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents14 Oct 2026
- 2026G2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigation12 Oct 2026
- 2026Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution2 Oct 2026
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Models29 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026AlayaWorld: Long-Horizon and Playable Video World Generation7 Jul 2026
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold11 Jun 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics22 Jan 2026
12 newest of 13 All 13 (JSON)
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2025Captain Safari: A World Engine with Pose-Aligned 3D Memorycited by 5
- 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Drivingcited by 3
- 2026E3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Controlcited by 2
- 2026Feedforward Novel View Synthesis for Heterogeneous Camerascited by 0
- 2026Feedforward Novel View Synthesis for Heterogeneous Cameras2 Oct 2026
- 2026E3C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control25 May 2026
- 2026Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Driving21 May 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2025Captain Safari: A World Engine with Pose-Aligned 3D Memory28 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion
- 2026Genie Sim PanoWorld: An Infinite Indoor 3D World Generation Pipeline via Panoramic Scene Modeling and Simulation
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video
- 2026PanoWorld: Real-World Panoramic Generation
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generation
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space