Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fields
Not on the map. Why?
Abstract (arXiv)
We propose Point'n Move, a method that achieves interactive scene object manipulation with exposed region inpainting. Interactivity here further comes from intuitive object selection and real-time editing. To achieve this, we adopt Gaussian Splatting Radiance Field as the scene representation and fully leverage its explicit nature and speed advantage. Its explicit representation formulation allows us to devise a 2D prompt points to 3D mask dual-stage self-prompting segmentation algorithm, perform mask refinement and merging, minimize change as well as provide good initialization for scene inpainting and perform editing in real-time without per-editing training, all leads to superior quality and performance. We test our method by performing editing on both forward-facing and 360 scenes. We also compare our method against existing scene object removal methods, showing superior quality despite being more capable and having a speed advantage.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 28 Nov 2023.
Builds on
19 of 26 references.
References · 19
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
- 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
- 2021Editing Conditional Radiance Fieldscited by 222
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2022Deforming Radiance Fields with Cagescited by 78
7 more
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
- 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudscited by 41
- 2023Reference-guided Controllable Inpainting of Neural Radiance Fieldscited by 40
- 2023Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitivescited by 38
- 2023OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fieldscited by 34
- 2023PAPR: Proximity Attention Point Renderingcited by 16
Built on by
Citing papers per year: 2024: 16; 2025: 10; 2026: 1.
27 papers.
Sort:
By area:
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 20243D Gaussian as a New Era: A Surveycited by 104
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
- 2024Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editingcited by 47
- 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAMcited by 42
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024DepthLab: From Partial to Completecited by 27
- 2024Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Renderingcited by 19
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
15 more
- 2024Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusioncited by 17
- 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
- 2025iSegMan: Interactive Segment-and-Manipulate 3D Gaussianscited by 11
- 2024View-consistent Object Removal in Radiance Fieldscited by 7
- 2024FruitNinja: 3D Object Interior Texture Generation with Gaussian Splattingcited by 5
- 2025DARB-Splatting: Generalizing Splatting with Decaying Anisotropic Radial Basis Functionscited by 5
- 2024Bootstraping Clustering of Gaussians for View-consistent 3D Scene Understandingcited by 4
- 2025From 2D to 3D Cognition: A Brief Survey of General World Modelscited by 4
- 2025High-fidelity 3D Gaussian Inpainting: preserving multi-view consistency and photorealistic detailscited by 3
- 2025Align 3D Representation and Text Embedding for 3D Content Personalizationcited by 2
- 2024Reconstructing Satellites in 3D from Amateur Telescope Imagescited by 1
- 2025Gaussian Set Surface Reconstruction through Per-Gaussian Optimizationcited by 1
- 2025MGStream: Motion-aware 3D Gaussian for Streamable Dynamic Scene Reconstructioncited by 0
- 2025RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpaintingcited by 0
- 2026ObjectSplat: Improving Mesh Fidelity and Interactivity for 3D Scenes via Object-Level Mesh Splattingcited by 0
- 2026ObjectSplat: Improving Mesh Fidelity and Interactivity for 3D Scenes via Object-Level Mesh Splatting31 Aug 2026
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025Align 3D Representation and Text Embedding for 3D Content Personalization23 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025Gaussian Set Surface Reconstruction through Per-Gaussian Optimization25 Jul 2025
- 2025High-fidelity 3D Gaussian Inpainting: preserving multi-view consistency and photorealistic details24 Jul 2025
- 2025RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpainting11 Jul 2025
- 2025From 2D to 3D Cognition: A Brief Survey of General World Models25 Jun 2025
- 2025MGStream: Motion-aware 3D Gaussian for Streamable Dynamic Scene Reconstruction20 May 2025
- 2025iSegMan: Interactive Segment-and-Manipulate 3D Gaussians17 May 2025
- 2025DARB-Splatting: Generalizing Splatting with Decaying Anisotropic Radial Basis Functions21 Jan 2025
- 2024DepthLab: From Partial to Complete24 Dec 2024
15 more
- 2024Bootstraping Clustering of Gaussians for View-consistent 3D Scene Understanding29 Nov 2024
- 2024FruitNinja: 3D Object Interior Texture Generation with Gaussian Splatting18 Nov 2024
- 2024View-consistent Object Removal in Radiance Fields4 Aug 2024
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities24 Jul 2024
- 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation6 Jun 2024
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review6 May 2024
- 2024Reconstructing Satellites in 3D from Amateur Telescope Images29 Apr 2024
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior17 Apr 2024
- 2024Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion6 Apr 2024
- 2024Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering21 Mar 2024
- 2024Recent Advances in 3D Gaussian Splatting17 Mar 2024
- 2024Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing15 Mar 2024
- 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAM12 Mar 2024
- 20243D Gaussian as a New Era: A Survey11 Feb 2024
- 2024A Survey on 3D Gaussian Splatting8 Jan 2024
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 20243D Gaussian as a New Era: A Surveycited by 104
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2024Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editingcited by 47
- 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAMcited by 42
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024DepthLab: From Partial to Completecited by 27
- 2024Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Renderingcited by 19
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusioncited by 17
12 most cited of 25 All 25 (JSON)
- 2026ObjectSplat: Improving Mesh Fidelity and Interactivity for 3D Scenes via Object-Level Mesh Splatting31 Aug 2026
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025Align 3D Representation and Text Embedding for 3D Content Personalization23 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025Gaussian Set Surface Reconstruction through Per-Gaussian Optimization25 Jul 2025
- 2025High-fidelity 3D Gaussian Inpainting: preserving multi-view consistency and photorealistic details24 Jul 2025
- 2025RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpainting11 Jul 2025
- 2025MGStream: Motion-aware 3D Gaussian for Streamable Dynamic Scene Reconstruction20 May 2025
- 2025iSegMan: Interactive Segment-and-Manipulate 3D Gaussians17 May 2025
- 2025DARB-Splatting: Generalizing Splatting with Decaying Anisotropic Radial Basis Functions21 Jan 2025
- 2024DepthLab: From Partial to Complete24 Dec 2024
- 2024Bootstraping Clustering of Gaussians for View-consistent 3D Scene Understanding29 Nov 2024
12 newest of 25 All 25 (JSON)