Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences
Not on the map. Why?
Abstract (arXiv)
A single panorama captures the full visual sphere from one camera center, yet confines users to looking around in place without enabling true scene exploration. Converting a single panorama into a persistent, renderable 3D representation for free-viewpoint navigation has attracted growing interest; existing methods either adopt iterative per-view completion that propagates inpainting results to update the underlying geometry, leading to progressive error accumulation and cumbersome multi-step pipelines, or leverage the temporal consistency priors of video generation models, yet the continuous-trajectory constraint intrinsic to such models limits their flexibility in covering scenes from multiple directions simultaneously. We present Pano2World, which takes a single indoor panorama as input and directly outputs a persistent, explorable 3D Gaussian scene. Given the source panorama, Pano2World first reconstructs a coarse 3D Gaussian proxy and renders it at adaptively sampled nearby poses to obtain geometrically aligned guidance panoramas; a panoramic diffusion model then jointly denoises all target views via View-Aware Attention Routing, where each target view simultaneously receives geometric constraints from its corresponding guidance panorama and global semantic guidance from the source panorama, naturally enforcing cross-view consistency. To avoid the information loss incurred by decoding the multi-view hidden features formed during joint denoising back to the pixel domain via VAE, we introduce Latent Feature Adapter, a geometry-aware bridge module that directly distills these hidden features into a scene latent, subsequently decoded into the final 3D Gaussian scene. Experiments demonstrate that Pano2World significantly outperforms existing methods on the multi-position panoramic novel-view synthesis benchmark.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
26 of 30 references.
References · 26
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2025Video World Models with Long-term Spatial Memorycited by 124
- 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 36
14 more
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 34
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
- 2024PanoFree: Tuning-Free Holistic Multi-view Image Generation with Cross-view Self-Guidancecited by 18
- 2024Pano2Room: Novel View Synthesis from a Single Indoor Panoramacited by 16
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
- 2024Taming Stable Diffusion for Text to 360deg Panorama Image Generationcited by 12
- 2025ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encodingcited by 10
- 2026AnchoredDream: Zero-Shot 360deg Indoor Scene Generation from a Single View via Geometric Groundingcited by 5
- 2026ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Modelscited by 5
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenescited by 4
- 2025AttentionGS: Towards Initialization-Free 3D Gaussian Splatting via Structural Attentioncited by 3
- 2026PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesiscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Genie Sim PanoWorld: An Infinite Indoor 3D World Generation Pipeline via Panoramic Scene Modeling and Simulation
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion
- 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space
- 2026SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation