mlsanityData to 7 Oct 2026

SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting

arXiv 2506.08710 ↗First posted 10 Jun 2025cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding. Current Language Gaussian Splatting line of work fall into three main groups: (i) per-scene optimization-based, (ii) per-scene optimization-free, and (iii) generalizable approach. However, most of them are evaluated only on rendered 2D views of a handful of scenes and viewpoints close to the training views, limiting ability and insight into holistic 3D understanding. To address this gap, we propose the first large-scale benchmark that systematically assesses these three groups of methods directly in 3D space, evaluating on 1060 scenes across three indoor datasets and one outdoor dataset. Benchmark results demonstrate a clear advantage of the generalizable paradigm, particularly in relaxing the scene-specific limitation, enabling fast feed-forward inference on novel scenes, and achieving superior segmentation performance. We further introduce GaussianWorld-49K a carefully curated 3DGS dataset comprising around 49K diverse indoor and outdoor scenes obtained from multiple sources, with which we demonstrate the generalizable approach could harness strong data priors. Our codes, benchmark, and datasets are released at https://scenesplatpp.gaussianworld.ai/.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 71 of its 86 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

71 of 86 references.

References · 71

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2023Segment Anythingcited by 8,158
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  8. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  11. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  12. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
38 more
  1. 2020Point Transformercited by 1,462
  2. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  3. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  4. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  5. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  6. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  7. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  8. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  9. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  10. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  11. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  12. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  13. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  14. 2023LERF: Language Embedded Radiance Fieldscited by 538
  15. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  16. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
  17. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  18. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  19. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  20. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  21. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
  22. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  23. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
  24. 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 243
  25. 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
  26. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 205
  27. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
  28. 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 186
  29. 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 176
  30. 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
  31. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  32. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
  33. 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 111
  34. 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
  35. 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 95
  36. 2023RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understandingcited by 93
  37. 2023Language Embedded Radiance Fields for Zero-Shot Task-Oriented Graspingcited by 91
  38. 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understandingcited by 86

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 8.

14 papers.

Sort:

By area: