mlsanityData to 14 Oct 2026

From Flight to Insight: Semantic 3D Reconstruction for Aerial Inspection via Gaussian Splatting and Language-Guided Segmentation

arXiv 2505.17402 ↗First posted 23 May 2025cs.GR cs.CV eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

High-fidelity 3D reconstruction is critical for aerial inspection tasks such as infrastructure monitoring, structural assessment, and environmental surveying. While traditional photogrammetry techniques enable geometric modeling, they lack semantic interpretability, limiting their effectiveness for automated inspection workflows. Recent advances in neural rendering and 3D Gaussian Splatting (3DGS) offer efficient, photorealistic reconstructions but similarly lack scene-level understanding. In this work, we present a UAV-based pipeline that extends Feature-3DGS for language-guided 3D segmentation. We leverage LSeg-based feature fields with CLIP embeddings to generate heatmaps in response to language prompts. These are thresholded to produce rough segmentations, and the highest-scoring point is then used as a prompt to SAM or SAM2 for refined 2D segmentation on novel view renderings. Our results highlight the strengths and limitations of various feature field backbones (CLIP-LSeg, SAM, SAM2) in capturing meaningful structure in large-scale outdoor environments. We demonstrate that this hybrid approach enables flexible, language-driven interaction with photorealistic 3D reconstructions, opening new possibilities for semantic aerial inspection and scene understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

18 of 23 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  8. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  10. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  11. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  12. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
6 more
  1. 2022Language-driven Semantic Segmentationcited by 717
  2. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  3. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  4. 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 139
  5. 20243DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splattingcited by 88
  6. 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 50

Built on by

Not cited yet.