mlsanityData to 14 Oct 2026

AuraFusion360: Augmented Unseen Region Alignment for Reference-based 360deg Unbounded Scene Inpainting

arXiv 2502.05176 ↗First posted 7 Feb 2025cs.CVcited by 21

Not on the map. Why?

Abstract (arXiv)

Three-dimensional scene inpainting is crucial for applications from virtual reality to architectural visualization, yet existing methods struggle with view consistency and geometric accuracy in 360deg unbounded scenes. We present AuraFusion360, a novel reference-based method that enables high-quality object removal and hole filling in 3D scenes represented by Gaussian Splatting. Our approach introduces (1) depth-aware unseen mask generation for accurate occlusion identification, (2) Adaptive Guided Depth Diffusion, a zero-shot method for accurate initial point placement without requiring additional training, and (3) SDEdit-based detail enhancement for multi-view coherence. We also introduce 360-USID, the first comprehensive dataset for 360deg unbounded scene inpainting with ground truth. Extensive experiments demonstrate that AuraFusion360 significantly outperforms existing methods, achieving superior perceptual quality while maintaining geometric accuracy across dramatic viewpoint changes.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 62 of its 72 references that are in the map. First posted on arXiv 7 Feb 2025.

Builds on

62 of 72 references.

References · 62

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  10. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  11. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
38 more
  1. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  2. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  3. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  4. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  5. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  6. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  7. 2020Neural Sparse Voxel Fieldscited by 959
  8. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  9. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  10. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  11. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  12. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  13. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  14. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  15. 2018Generative Image Inpainting with Contextual Attentioncited by 580
  16. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
  17. 2017Convolutional Sequence to Sequence Learningcited by 552
  18. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  19. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  20. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  21. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  22. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  23. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  24. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  25. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  26. 2023Robust Dynamic Radiance Fieldscited by 194
  27. 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
  28. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 174
  29. 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
  30. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  31. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  32. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
  33. 2023Progressively Optimized Local Radiance Fields for Robust View Synthesiscited by 103
  34. 2022Removing Objects From Neural Radiance Fieldscited by 66
  35. 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
  36. 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 59
  37. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
  38. 2022NeRF-In: Free-Form NeRF Inpainting with RGB-D Priorscited by 43

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 12.

21 papers.

Sort:

By area:

  1. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  2. 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
  3. 2025InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Modelcited by 10
  4. 2025LightsOut: Diffusion-based Outpainting for Enhanced Lens Flare Removalcited by 9
  5. 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstructioncited by 9
  6. 2025Inpaint360GS: Efficient Object-Aware 3D Inpainting via Gaussian Splatting for 360deg Scenescited by 8
  7. 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
  8. 2025GS-RoadPatching: Inpainting Gaussians via 3D Searching and Placing for Driving Scenescited by 5
  9. 2026OpenVoxel: Training-Free Grouping and Captioning Voxels for Open-Vocabulary 3D Scene Understandingcited by 5
  10. 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
  11. 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusioncited by 4
  12. 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splattingcited by 2
9 more
  1. 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
  2. 2025DeclutterNeRF: Generative-Free 3D Scene Recovery for Occlusion Removalcited by 1
  3. 2026GOR-IS: 3D Gaussian Object Removal in the Intrinsic Spacecited by 1
  4. 2026JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Spacecited by 1
  5. 20263D-GIMP: When 3D Gaussian Inpainting Meets PatchMatchcited by 1
  6. 2026CSGaussian: Progressive Rate-Distortion Compression and Segmentation for 3D Gaussian Splattingcited by 0
  7. 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setupscited by 0
  8. 2026CoIn: Comprehensive 2D-3D Inpainting with Gaussian Splatting Guidancecited by 0
  9. 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priorscited by 0