mlsanityData to 14 Oct 2026

PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splatting

arXiv 2605.14135 ↗First posted 13 May 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present PanoPlane, an approach for high-fidelity sparse-view indoor novel view synthesis that reconstructs closed room geometry via panoramic scene completion. Unlike perspective-based methods that generate training views from limited fields of view, PanoPlane leverages 360circ panoramic completion to condition the generative process on the full spatial layout. We propose Layout Anchored Attention Steering, a training-free mechanism that steers attention within the diffusion model's internal representation toward scene's detected planar surfaces at inference time. By directing each unobserved region's attention toward geometrically consistent observed content, our method replaces unconstrained hallucination with grounded surface extrapolation. The resulting panoramic completions provide supervision for 3D Gaussian Splatting, enabling accurate novel-view synthesis across unobserved regions from as few as three input views. Experiments on Replica, ScanNet++, and Matterport3D demonstrate state-of-the-art novel view synthesis quality across 3, 6, and 9 input views, achieving up to +17.8% improvement in PSNR over the current state-of-the-art baseline without any training or fine-tuning of the diffusion model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 58 of its 64 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

58 of 64 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior14 Oct
  2. 2025RI3D: Few-Shot Gaussian Splatting With Repair and Inpainting Diffusion Priors13 Mar
  3. 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs7 Mar
  4. 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidance17 Dec
  5. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec
  6. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model29 Aug
  7. 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusion6 Jul
  8. 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction24 May

Other references · 50

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2023Segment Anythingcited by 8,234
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  10. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  11. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  12. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
38 more
  1. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  2. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  3. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  4. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  5. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  6. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
  7. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  8. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  9. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  10. 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
  11. 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 154
  12. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
  13. 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidancecited by 113
  14. 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 108
  15. 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
  16. 2024FreGS: 3D Gaussian Splatting with Progressive Frequency Regularizationcited by 105
  17. 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 70
  18. 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
  19. 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
  20. 2024GaussNav: Gaussian Splatting for Visual Navigationcited by 49
  21. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
  22. 2019Learning to Reconstruct 3D Manhattan Wireframes from a Single Imagecited by 35
  23. 2024ActiveGS: Active Scene Reconstruction Using Gaussian Splattingcited by 35
  24. 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
  25. 2024MAtCha Gaussians: Atlas of Charts for High-Quality Geometry and Photorealism From Sparse Viewscited by 21
  26. 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Trainingcited by 18
  27. 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 16
  28. 2025Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splattingcited by 14
  29. 2025IGL-Nav: Incremental 3D Gaussian Localization for Image-goal Navigationcited by 11
  30. 2025D2GS: Depth-and-Density Guided Gaussian Splatting for Stable and Accurate Sparse-View Reconstructioncited by 11
  31. 2025CoMapGS: Covisibility Map-based Gaussian Splatting for Sparse Novel View Synthesiscited by 10
  32. 2025AD-GS: Alternating Densification for Sparse-Input 3D Gaussian Splattingcited by 8
  33. 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
  34. 2026Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformerscited by 6
  35. 2025GSplatVNM: Point-of-View Synthesis for Visual Navigation Models Using Gaussian Splattingcited by 5
  36. 2025OracleGS: Grounding Generative Priors for Sparse-View Gaussian Splattingcited by 5
  37. 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
  38. 2025FreeControl: Efficient, Training-Free Structural Control via One-Step Attention Extractioncited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Models
  2. 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion
  3. 2026Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences
  4. 2025ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Views
  5. 2026Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence
  6. 2026Sparse View Distractor-Free Gaussian Splatting
  7. 2026Difix3D-W: Distractor-Free Few-Shot 3D Gaussian Splatting in the Wild
  8. 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion