AuraFusion360: Augmented Unseen Region Alignment for Reference-based 360deg Unbounded Scene Inpainting
Not on the map. Why?
Abstract (arXiv)
Three-dimensional scene inpainting is crucial for applications from virtual reality to architectural visualization, yet existing methods struggle with view consistency and geometric accuracy in 360deg unbounded scenes. We present AuraFusion360, a novel reference-based method that enables high-quality object removal and hole filling in 3D scenes represented by Gaussian Splatting. Our approach introduces (1) depth-aware unseen mask generation for accurate occlusion identification, (2) Adaptive Guided Depth Diffusion, a zero-shot method for accurate initial point placement without requiring additional training, and (3) SDEdit-based detail enhancement for multi-view coherence. We also introduce 360-USID, the first comprehensive dataset for 360deg unbounded scene inpainting with ground truth. Extensive experiments demonstrate that AuraFusion360 significantly outperforms existing methods, achieving superior perceptual quality while maintaining geometric accuracy across dramatic viewpoint changes.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 62 of its 72 references that are in the map. First posted on arXiv 7 Feb 2025.
Builds on
62 of 72 references.
References · 62
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
38 more
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2020Neural Sparse Voxel Fieldscited by 959
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2023Robust Dynamic Radiance Fieldscited by 194
- 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 174
- 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
- 2023Progressively Optimized Local Radiance Fields for Robust View Synthesiscited by 103
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
- 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 59
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
- 2022NeRF-In: Free-Form NeRF Inpainting with RGB-D Priorscited by 43
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2025: 9; 2026: 12.
21 papers.
Sort:
By area:
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
- 2025InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Modelcited by 10
- 2025LightsOut: Diffusion-based Outpainting for Enhanced Lens Flare Removalcited by 9
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstructioncited by 9
- 2025Inpaint360GS: Efficient Object-Aware 3D Inpainting via Gaussian Splatting for 360deg Scenescited by 8
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2025GS-RoadPatching: Inpainting Gaussians via 3D Searching and Placing for Driving Scenescited by 5
- 2026OpenVoxel: Training-Free Grouping and Captioning Voxels for Open-Vocabulary 3D Scene Understandingcited by 5
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splattingcited by 2
9 more
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
- 2025DeclutterNeRF: Generative-Free 3D Scene Recovery for Occlusion Removalcited by 1
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Spacecited by 1
- 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Spacecited by 1
- 20263D-GIMP: When 3D Gaussian Inpainting Meets PatchMatchcited by 1
- 2026CSGaussian: Progressive Rate-Distortion Compression and Segmentation for 3D Gaussian Splattingcited by 0
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setupscited by 0
- 2026CoIn: Comprehensive 2D-3D Inpainting with Gaussian Splatting Guidancecited by 0
- 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priorscited by 0
- 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priors29 Sep 2026
- 20263D-GIMP: When 3D Gaussian Inpainting Meets PatchMatch22 Jul 2026
- 2026CoIn: Comprehensive 2D-3D Inpainting with Gaussian Splatting Guidance25 Jun 2026
- 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space11 Jun 2026
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Space1 May 2026
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking1 Apr 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2026CSGaussian: Progressive Rate-Distortion Compression and Segmentation for 3D Gaussian Splatting19 Jan 2026
- 2026OpenVoxel: Training-Free Grouping and Captioning Voxels for Open-Vocabulary 3D Scene Understanding14 Jan 2026
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstruction2 Jan 2026
9 more
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025
- 2025Inpaint360GS: Efficient Object-Aware 3D Inpainting via Gaussian Splatting for 360deg Scenes9 Nov 2025
- 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery17 Oct 2025
- 2025LightsOut: Diffusion-based Outpainting for Enhanced Lens Flare Removal17 Oct 2025
- 2025GS-RoadPatching: Inpainting Gaussians via 3D Searching and Placing for Driving Scenes24 Sep 2025
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting15 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model12 Jun 2025
- 2025DeclutterNeRF: Generative-Free 3D Scene Recovery for Occlusion Removal7 Apr 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
- 2025InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Modelcited by 10
- 2025LightsOut: Diffusion-based Outpainting for Enhanced Lens Flare Removalcited by 9
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstructioncited by 9
- 2025Inpaint360GS: Efficient Object-Aware 3D Inpainting via Gaussian Splatting for 360deg Scenescited by 8
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2025GS-RoadPatching: Inpainting Gaussians via 3D Searching and Placing for Driving Scenescited by 5
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splattingcited by 2
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
- 2025DeclutterNeRF: Generative-Free 3D Scene Recovery for Occlusion Removalcited by 1
12 most cited of 18 All 18 (JSON)
- 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priors29 Sep 2026
- 2026CoIn: Comprehensive 2D-3D Inpainting with Gaussian Splatting Guidance25 Jun 2026
- 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space11 Jun 2026
- 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Space1 May 2026
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking1 Apr 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2026CSGaussian: Progressive Rate-Distortion Compression and Segmentation for 3D Gaussian Splatting19 Jan 2026
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstruction2 Jan 2026
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025
- 2025Inpaint360GS: Efficient Object-Aware 3D Inpainting via Gaussian Splatting for 360deg Scenes9 Nov 2025
- 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery17 Oct 2025
12 newest of 18 All 18 (JSON)