mlsanityData to 13 Oct 2026

Understanding Temporal Semantic Stability in Open-Vocabulary UAV Perception through Metric 3D Fusion

arXiv 2608.28665 ↗First posted 23 Aug 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent open-vocabulary segmentation models have advanced semantic perception for UAVs, but predictions from moving aerial platforms can remain temporally inconsistent across repeated observations of the same physical scene. We investigate temporal semantic stability by associating frame-wise predictions with persistent world-space locations through metric 3D fusion. We introduce a voxel-level evaluation framework that jointly characterises final semantic agreement, Semantic Belief Drift (SBD), Observation Persistence (OP), and semantic uncertainty. Experiments on UAVid-3D reveal substantial frame-wise semantic flicker and show that high aggregate world-space agreement can overstate temporal stability when locations have limited repeated-observation support. Persistence-stratified analysis shows that recurrent voxels expose greater semantic disagreement, while belief drift decreases as additional evidence accumulates. This behaviour is observed across two segmentation backbones and remains consistent under variations in voxel resolution, geometric association, and temporal sampling density. Conditions that reduce world-space recurrence can increase apparent aggregate stability, demonstrating that semantic consistency must be interpreted together with observation support. Our findings highlight observation persistence as an essential conditioning variable for evaluating long-horizon semantic reliability.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 11 of its 18 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

11 of 18 references.

References · 11

  1. 2023Segment Anythingcited by 8,195
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,930
  3. 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 277
  4. 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 202
  5. 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 183
  6. 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
  7. 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
  8. 2019Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagationcited by 125
  9. 2019PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Thingscited by 98
  10. 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
  11. 2022Vision-aided UAV navigation and dynamic obstacle avoidance using gradient-based B-spline trajectory optimizationcited by 7

Built on by

Not cited yet.