mlsanityData to 7 Oct 2026

GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors

arXiv 2604.11401 ↗First posted 13 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent semantic 3D Gaussian Splatting (3DGS) methods primarily rely on 2D foundation models, often yielding ambiguous boundaries and limited support for structured urban semantics. While city models such as CityGML encode hierarchically organized semantics together with building geometry, these labels cannot be directly mapped to Gaussian primitives. We present GS4City, a hierarchical semantic Gaussian Splatting method that incorporates city-model priors for urban scene understanding. GS4City derives reliable image-aligned masks from Level of Detail (LoD) 3 CityGML models via two-pass raycasting, explicitly using parent-child relations to validate and recover fine-grained facade elements. It then fuses these geometry-grounded masks with foundation-model predictions to establish scene-consistent instance correspondences, and learns a compact identity encoding for each Gaussian under joint 2D identity supervision and 3D spatial regularization. Experiments on the TUM2TWIN and Gold Coast datasets show that GS4City effectively incorporates structured building semantics into Gaussian scene representations, outperforming existing 2D-driven semantic 3DGS baselines, including LangSplat and Gaga, by up to 15.8 IoU points in coarse building segmentation and 14.2 mIoU points in fine-grained semantic segmentation. By bridging structured city models and photorealistic Gaussian scene representations, GS4City enables semantically queryable and structure-aware urban reconstruction. Code is available at https://github.com/Jinyzzz/GS4City.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 41 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

32 of 41 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Segment Anythingcited by 8,158
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  5. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  6. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  7. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
  8. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
  9. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  10. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 205
  11. 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 190
  12. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
20 more
  1. 2023Segment Any 3D Gaussianscited by 158
  2. 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 141
  3. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
  4. 2024GARField: Group Anything with Radiance Fieldscited by 108
  5. 20243D Gaussian as a New Era: A Surveycited by 102
  6. 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
  7. 2024Gaga: Group Any Gaussians via 3D-aware Memory Bankcited by 40
  8. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 40
  9. 2025Lifting by Gaussians: A Simple, Fast and Flexible Method for 3D Instance Segmentationcited by 23
  10. 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 19
  11. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  12. 2023Scan2LoD3: Reconstructing semantic 3D building models at LoD3 using ray casting and Bayesian networkscited by 16
  13. 2025SemanticSplat: Feed-Forward 3D Scene Understanding with Language-Aware Gaussian Fieldscited by 13
  14. 2024HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenescited by 11
  15. 2019CityJSON: a compact and easy-to-use encoding of the CityGML data modelcited by 8
  16. 2025Texture2LoD3: Enabling LoD3 Building Reconstruction With Panoramic Imagescited by 7
  17. 2025TUM2TWIN: Introducing the Large-Scale Multimodal Urban Digital Twin Benchmark Datasetcited by 5
  18. 2025CityGo: Lightweight Urban Modeling and Rendering with Proxy Buildings and Residual Gaussianscited by 5
  19. 2025GS4Buildings: Prior-Guided Gaussian Splatting for 3D Building Reconstructioncited by 5
  20. 2025CDGS: Confidence-Aware Depth Regularization for 3D Gaussian Splattingcited by 3

Built on by

Not cited yet.