Stepper: Stepwise Immersive Scene Generation with Multiview Panoramas
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
The synthesis of immersive 3D scenes from text is rapidly maturing, driven by novel video generative models and feed-forward 3D reconstruction, with vast potential in AR/VR and world modeling. While panoramic images have proven effective for scene initialization, existing approaches suffer from a trade-off between visual fidelity and explorability: autoregressive expansion suffers from context drift, while panoramic video generation is limited to low resolution. We present Stepper, a unified framework for text-driven immersive 3D scene synthesis that circumvents these limitations via stepwise panoramic scene expansion. Stepper leverages a novel multi-view 360deg diffusion model that enables consistent, high-resolution expansion, coupled with a geometry reconstruction pipeline that enforces geometric coherence. Trained on a new large-scale, multi-view panorama dataset, Stepper achieves state-of-the-art fidelity and structural consistency, outperforming prior approaches, thereby setting a new standard for immersive scene generation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 62 of its 66 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
62 of 66 references.
Closest ancestors · 4
Same direction, newest first
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Models22 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 58
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
38 more
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2023WonderJourney: Going from Anywhere to Everywherecited by 157
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
- 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 54
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 50
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
- 2023360-Degree Panorama Generation from Few Unregistered NFoV Imagescited by 42
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenes
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models
- 2026Genie Sim PanoWorld: An Infinite Indoor 3D World Generation Pipeline via Panoramic Scene Modeling and Simulation
- 2025A Survey on Text-Driven 360-Degree Panorama Generation
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion
- 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Video
- 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion
- 2026PSGS: Text-driven Panorama Sliding Scene Generation via Gaussian Splatting