mlsanityData to 7 Oct 2026

Stepper: Stepwise Immersive Scene Generation with Multiview Panoramas

arXiv 2603.28980 ↗First posted 30 Mar 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

The synthesis of immersive 3D scenes from text is rapidly maturing, driven by novel video generative models and feed-forward 3D reconstruction, with vast potential in AR/VR and world modeling. While panoramic images have proven effective for scene initialization, existing approaches suffer from a trade-off between visual fidelity and explorability: autoregressive expansion suffers from context drift, while panoramic video generation is limited to low resolution. We present Stepper, a unified framework for text-driven immersive 3D scene synthesis that circumvents these limitations via stepwise panoramic scene expansion. Stepper leverages a novel multi-view 360deg diffusion model that enables consistent, high-resolution expansion, coupled with a geometry reconstruction pipeline that enforces geometric coherence. Trained on a new large-scale, multi-view panorama dataset, Stepper achieves state-of-the-art fidelity and structural consistency, outperforming prior approaches, thereby setting a new standard for immersive scene generation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 62 of its 66 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

62 of 66 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  3. 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Models22 Nov
  4. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 58

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  12. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
38 more
  1. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  3. 2024Depth Anything V2cited by 1,385
  4. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  5. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  6. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  7. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  10. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  11. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  12. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  13. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  14. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  15. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
  16. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  17. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  18. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  19. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  20. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  21. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  22. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
  23. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  24. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  25. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  26. 2025Video models are zero-shot learners and reasonerscited by 208
  27. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
  28. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
  29. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  30. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  31. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  32. 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
  33. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
  34. 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 54
  35. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  36. 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 50
  37. 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
  38. 2023360-Degree Panorama Generation from Few Unregistered NFoV Imagescited by 42

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenes
  2. 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models
  3. 2026Genie Sim PanoWorld: An Infinite Indoor 3D World Generation Pipeline via Panoramic Scene Modeling and Simulation
  4. 2025A Survey on Text-Driven 360-Degree Panorama Generation
  5. 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion
  6. 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Video
  7. 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion
  8. 2026PSGS: Text-driven Panorama Sliding Scene Generation via Gaussian Splatting