SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding. Current Language Gaussian Splatting line of work fall into three main groups: (i) per-scene optimization-based, (ii) per-scene optimization-free, and (iii) generalizable approach. However, most of them are evaluated only on rendered 2D views of a handful of scenes and viewpoints close to the training views, limiting ability and insight into holistic 3D understanding. To address this gap, we propose the first large-scale benchmark that systematically assesses these three groups of methods directly in 3D space, evaluating on 1060 scenes across three indoor datasets and one outdoor dataset. Benchmark results demonstrate a clear advantage of the generalizable paradigm, particularly in relaxing the scene-specific limitation, enabling fast feed-forward inference on novel scenes, and achieving superior segmentation performance. We further introduce GaussianWorld-49K a carefully curated 3DGS dataset comprising around 49K diverse indoor and outdoor scenes obtained from multiple sources, with which we demonstrate the generalizable approach could harness strong data priors. Our codes, benchmark, and datasets are released at https://scenesplatpp.gaussianworld.ai/.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 71 of its 86 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
71 of 86 references.
References · 71
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
38 more
- 2020Point Transformercited by 1,462
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023LERF: Language Embedded Radiance Fieldscited by 538
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
- 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 243
- 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 205
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 186
- 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 176
- 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
- 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 111
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 95
- 2023RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understandingcited by 93
- 2023Language Embedded Radiance Fields for Zero-Shot Task-Oriented Graspingcited by 91
- 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understandingcited by 86
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 8.
14 papers.
Sort:
By area:
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarkscited by 31
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025GaussianVLM: Scene-centric 3D Vision-Language Models using Language-aligned Gaussian Splats for Embodied Reasoning and Beyondcited by 12
- 2025Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encodingcited by 8
- 2026GaussianGPT: Towards Autoregressive 3D Gaussian Scene Generationcited by 4
- 2026E3VS-Bench: A Benchmark for Viewpoint-Dependent Active Perception in 3D Gaussian Splatting Scenescited by 3
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-trainingcited by 2
- 2026FF3R: Feedforward Feature 3D Reconstruction from Unconstrained viewscited by 2
- 2026Visually-grounded Humanoid Agentscited by 1
- 2025A Study of the Framework and Real-World Applications of Language Embedding for 3D Scene Understandingcited by 0
- 2026FullCircle: Effortless 3D Reconstruction from Casual 360^circ Capturescited by 0
- 2026E3DGS: Unified Geometric-Photometric Equivariance for 3D Gaussian Splatting via Color-as-Geometry Embeddingcited by 0
- 2026GraphWrit3R: End-to-End 3D Scene Graph Writing25 Sep 2026
- 2026GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting18 Aug 2026
- 2026E3DGS: Unified Geometric-Photometric Equivariance for 3D Gaussian Splatting via Color-as-Geometry Embedding17 Jul 2026
- 2026E3VS-Bench: A Benchmark for Viewpoint-Dependent Active Perception in 3D Gaussian Splatting Scenes20 Apr 2026
- 2026FF3R: Feedforward Feature 3D Reconstruction from Unconstrained views10 Apr 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026GaussianGPT: Towards Autoregressive 3D Gaussian Scene Generation27 Mar 2026
- 2026FullCircle: Effortless 3D Reconstruction from Casual 360^circ Captures23 Mar 2026
- 2025Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encoding19 Dec 2025
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks29 Oct 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-training12 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encodingcited by 8
- 2026E3VS-Bench: A Benchmark for Viewpoint-Dependent Active Perception in 3D Gaussian Splatting Scenescited by 3
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-trainingcited by 2
- 2026FF3R: Feedforward Feature 3D Reconstruction from Unconstrained viewscited by 2
- 2026Visually-grounded Humanoid Agentscited by 1
- 2025A Study of the Framework and Real-World Applications of Language Embedding for 3D Scene Understandingcited by 0
- 2026FullCircle: Effortless 3D Reconstruction from Casual 360^circ Capturescited by 0
- 2026E3DGS: Unified Geometric-Photometric Equivariance for 3D Gaussian Splatting via Color-as-Geometry Embeddingcited by 0
- 2026GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splattingcited by 0
- 2026GraphWrit3R: End-to-End 3D Scene Graph Writingcited by 0
- 2026GraphWrit3R: End-to-End 3D Scene Graph Writing25 Sep 2026
- 2026GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting18 Aug 2026
- 2026E3DGS: Unified Geometric-Photometric Equivariance for 3D Gaussian Splatting via Color-as-Geometry Embedding17 Jul 2026
- 2026E3VS-Bench: A Benchmark for Viewpoint-Dependent Active Perception in 3D Gaussian Splatting Scenes20 Apr 2026
- 2026FF3R: Feedforward Feature 3D Reconstruction from Unconstrained views10 Apr 2026
- 2026Visually-grounded Humanoid Agents9 Apr 2026
- 2026FullCircle: Effortless 3D Reconstruction from Casual 360^circ Captures23 Mar 2026
- 2025Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encoding19 Dec 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-training12 Aug 2025
- 2025A Study of the Framework and Real-World Applications of Language Embedding for 3D Scene Understanding7 Aug 2025