Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Diffusion models provide powerful priors for 2D image completion, but these priors are learned on bounded planar images and do not transfer directly to 360^circ panoramas. Perspective observations and spherical panoramas differ in both projective geometry and topology: viewpoint-dependent distortion complicates spatial correspondence, while Equirectangular Projection (ERP) panoramas exhibit intrinsic S1 periodicity that standard Euclidean architectures do not preserve. We present Gimbal360, a unified framework that adapts planar diffusion priors to spherical panoramic completion by standardizing these geometric and topological structures. Our Canonical Viewing Space expresses projective distortion as a fixed function of latitude, providing a consistent interface between perspective inputs and spherical panoramas. To map unposed in-the-wild images into this space, Differentiable Projective Canonicalization projects a dense correspondence field onto a 3-DoF rigid projection manifold without requiring camera parameters at inference. We further introduce Topologically Equivariant Generation, which enforces latent shift equivariance to preserve continuity across the periodic ERP boundary. Together, these designs allow diffusion to operate in a representation whose geometry and topology are explicitly aligned with the spherical domain. We also introduce Horizon360, a curated large-scale dataset of gravity-aligned panoramic environments. Extensive experiments show that Gimbal360 achieves state-of-the-art visual fidelity and seam continuity in 360^circ scene completion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 43 of its 59 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
43 of 59 references.
Closest ancestors · 8
Same direction, newest first
- 2025TanDiT: Tangent-Plane Diffusion Transformer for High-Quality 360deg Panorama Generation26 Jun
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generation28 Jan
- 2024SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Model15 Mar
- 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Model12 Jan
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Models22 Nov
- 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusion6 Jul
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions8 Jun
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Generative Adversarial Networkscited by 5,627
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2015Spatial Transformer Networkscited by 1,429
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2018Demystifying MMD GANscited by 1,293
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
23 more
- 2019Pluralistic Image Completioncited by 162
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
- 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 108
- 2020HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Featurescited by 105
- 2018LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Imagecited by 95
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 89
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
- 2022Perspective Fields for Single Image Camera Calibrationcited by 75
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 52
- 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 40
- 2022LGT-Net: Indoor Panoramic Room Layout Estimation with Geometry-Aware Transformer Networkcited by 29
- 2024Imagine360: Immersive 360 Video Generation from Perspective Anchorcited by 29
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
- 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
- 2024PanoFree: Tuning-Free Holistic Multi-view Image Generation with Cross-view Self-Guidancecited by 18
- 2025AnyCalib: On-Manifold Learning for Model-Agnostic Single-View Camera Calibrationcited by 18
- 2022Cylin-Painting: Seamless 360textdegree Panoramic Image Outpainting and Beyondcited by 12
- 2025DreamCube: 3D Panorama Generation via Multi-plane Synchronizationcited by 12
- 2025Panorama Generation From NFoV Image Done Rightcited by 11
- 2024Geometry Fidelity for Spherical Imagescited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
- 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360deg
- 2026PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splatting
- 2025GeoComplete: Geometry-Aware Diffusion for Reference-Driven Image Completion
- 2026Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences