Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospects
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has attracted significant attention for its potential to revolutionize 3D representation, rendering, and interaction. Despite the rapid growth of 3DGS research, its direct application to Extended Reality (XR) remains underexplored. Although many studies recognize the potential of 3DGS for XR, few have explicitly focused on or demonstrated its effectiveness within XR environments. In this paper, we aim to synthesize innovations in 3DGS that show specific potential for advancing XR research and development. We conduct a comprehensive review of publicly available 3DGS papers, with a focus on those referencing XR-related concepts. Additionally, we perform an in-depth analysis of innovations explicitly relevant to XR and propose a taxonomy to highlight their significance. Building on these insights, we propose several prospective XR research areas where 3DGS can make promising contributions, yet remain rarely touched. By investigating the intersection of 3DGS and XR, this paper provides a roadmap to push the boundaries of XR using cutting-edge 3DGS techniques.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 85 of its 96 references that are in the map. First posted on arXiv 9 Dec 2024.
Builds on
85 of 96 references.
References · 85
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
38 more
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 239
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 192
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 130
- 2023Relightable Gaussian Codec Avatarscited by 127
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2024StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Renderingcited by 111
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 109
- 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 108
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 20243D Gaussian as a New Era: A Surveycited by 104
- 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 83
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 82
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 11; 2026: 5.
17 papers.
Sort:
By area:
- 2025CCL-LGS: Contrastive Codebook Learning for 3D Language Gaussian Splattingcited by 12
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Predictioncited by 7
- 2025GaussTrap: Stealthy Poisoning Attacks on 3D Gaussian Splatting for Targeted Scene Confusioncited by 6
- 2025Creating Virtual Environments with 3D Gaussian Splatting: A Comparative Studycited by 3
- 2025Trade-offs in Image Generation: How Do Different Dimensions Interact?cited by 3
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splattingcited by 3
- 2025ClipGS: Clippable Gaussian Splatting for Interactive Cinematic Visualization of Volumetric Medical Datacited by 2
- 2025GS-Verse: Mesh-based Gaussian Splatting for Physics-aware Interaction in Virtual Realitycited by 2
- 2025Edge Collaborative Gaussian Splatting with Integrated Rendering and Communicationcited by 2
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2024MS2Mesh-XR: Multi-modal Sketch-to-Mesh Generation in XR Environmentscited by 1
- 2025Interpretable Single-View 3D Gaussian Splatting using Unsupervised Hierarchical Disentangled Representation Learningcited by 1
5 more
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
- 2026QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrievalcited by 1
- 2025Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Frameworkcited by 0
- 2026Indoor Asset Detection in Large Scale 360deg Drone-Captured Imagery via 3D Gaussian Splattingcited by 0
- 2026From Splats to Silicon: Rethinking Computational Efficiency of 3DGScited by 0
- 2026From Splats to Silicon: Rethinking Computational Efficiency of 3DGS5 Sep 2026
- 2026QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval18 Jun 2026
- 2026Indoor Asset Detection in Large Scale 360deg Drone-Captured Imagery via 3D Gaussian Splatting7 Apr 2026
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction3 Apr 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2025Edge Collaborative Gaussian Splatting with Integrated Rendering and Communication26 Oct 2025
- 2025GS-Verse: Mesh-based Gaussian Splatting for Physics-aware Interaction in Virtual Reality13 Oct 2025
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations28 Sep 2025
- 2025Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Framework21 Aug 2025
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splatting18 Aug 2025
- 2025Trade-offs in Image Generation: How Do Different Dimensions Interact?29 Jul 2025
- 2025ClipGS: Clippable Gaussian Splatting for Interactive Cinematic Visualization of Volumetric Medical Data9 Jul 2025
5 more
- 2025CCL-LGS: Contrastive Codebook Learning for 3D Language Gaussian Splatting26 May 2025
- 2025GaussTrap: Stealthy Poisoning Attacks on 3D Gaussian Splatting for Targeted Scene Confusion29 Apr 2025
- 2025Interpretable Single-View 3D Gaussian Splatting using Unsupervised Hierarchical Disentangled Representation Learning5 Apr 2025
- 2025Creating Virtual Environments with 3D Gaussian Splatting: A Comparative Study16 Jan 2025
- 2024MS2Mesh-XR: Multi-modal Sketch-to-Mesh Generation in XR Environments12 Dec 2024
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Predictioncited by 7
- 2025Creating Virtual Environments with 3D Gaussian Splatting: A Comparative Studycited by 3
- 2025Trade-offs in Image Generation: How Do Different Dimensions Interact?cited by 3
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splattingcited by 3
- 2025ClipGS: Clippable Gaussian Splatting for Interactive Cinematic Visualization of Volumetric Medical Datacited by 2
- 2025GS-Verse: Mesh-based Gaussian Splatting for Physics-aware Interaction in Virtual Realitycited by 2
- 2025Edge Collaborative Gaussian Splatting with Integrated Rendering and Communicationcited by 2
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2024MS2Mesh-XR: Multi-modal Sketch-to-Mesh Generation in XR Environmentscited by 1
- 2025Interpretable Single-View 3D Gaussian Splatting using Unsupervised Hierarchical Disentangled Representation Learningcited by 1
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
- 2026QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrievalcited by 1
12 most cited of 15 All 15 (JSON)
- 2026From Splats to Silicon: Rethinking Computational Efficiency of 3DGS5 Sep 2026
- 2026QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval18 Jun 2026
- 2026Indoor Asset Detection in Large Scale 360deg Drone-Captured Imagery via 3D Gaussian Splatting7 Apr 2026
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction3 Apr 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2025Edge Collaborative Gaussian Splatting with Integrated Rendering and Communication26 Oct 2025
- 2025GS-Verse: Mesh-based Gaussian Splatting for Physics-aware Interaction in Virtual Reality13 Oct 2025
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations28 Sep 2025
- 2025Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Framework21 Aug 2025
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splatting18 Aug 2025
- 2025Trade-offs in Image Generation: How Do Different Dimensions Interact?29 Jul 2025
- 2025ClipGS: Clippable Gaussian Splatting for Interactive Cinematic Visualization of Volumetric Medical Data9 Jul 2025
12 newest of 15 All 15 (JSON)