VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps
Not on the map. Why?
Abstract (arXiv)
Semantic 3D maps are increasingly constructed automatically for aerial robotics by integrating learned semantic predictions into 3D representations. While this avoids costly manual 3D annotation, errors in the perception and mapping pipeline can persist in the resulting map, reducing its reliability for downstream autonomous tasks. Existing 3D semantic map refinement methods either rely on the original observations, treat occupancy as part of the prediction problem, or apply non-learned local regularization to completed maps. Instead, we study post-hoc semantic correction, asking whether semantic accuracy can be recovered directly from the completed map while keeping its geometry and occupancy fixed. We introduce method, a graph-based model that corrects voxel labels based on local geometry and neighboring semantic information. To obtain training pairs, we corrupt contiguous regions of annotated OccuFly maps according to class confusions observed in upstream maps. We evaluate method on completed OccuFly maps generated from predictions of four independently trained 2D segmentation models. method consistently improves mIoU by 4.23--5.00 percentage points, with gains broadly distributed across the evaluated semantic classes and particularly strong improvements for tree, roof, and wall. Results on an independently reconstructed out-of-distribution aerial scene further suggest that the learned correction can transfer beyond the environments seen during training.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 4 Sep 2026.
Builds on
38 of 54 references.
References · 38
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Graph Attention Networkscited by 8,923
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2021How Attentive are Graph Attention Networks?cited by 835
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
26 more
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 640
- 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 385
- 2018Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noisecited by 216
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 184
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 135
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 53
- 2022SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Cloudscited by 50
- 2023VDD: Varied Drone Dataset for Semantic Segmentationcited by 40
- 2019Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mappingcited by 35
- 2025UAVScenes: A Multi-Modal Dataset for UAVscited by 27
- 2020Semantic Segmentation on Swiss3DCities: A Benchmark Study on Aerial Photogrammetric 3D Pointcloud Datasetcited by 22
- 2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
- 2023Learning to Segment from Noisy Annotations: A Spatial Correction Approachcited by 17
- 2018Recurrent-OctoMap: Learning State-based Map Refinement for Long-Term Semantic Mapping with 3D-Lidar Datacited by 16
- 2021Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopycited by 12
- 2024Offboard Occupancy Refinement with Hybrid Propagation for Autonomous Drivingcited by 12
- 2023ConvBKI: Real-Time Probabilistic Semantic Mapping Network with Quantifiable Uncertaintycited by 11
- 2022Active Metric-Semantic Mapping by Multiple Aerial Robotscited by 7
- 2022Robust Point Cloud Segmentation with Noisy Annotationscited by 6
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inferencecited by 6
- 2025OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspectivecited by 5
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Modulecited by 3
- 2018UAVid: A Semantic Segmentation Dataset for UAV Imagerycited by 2
- 2022P2Net: A Post-Processing Network for Refining Semantic Segmentation of LiDAR Point Cloud based on Consistency of Consecutive Framescited by 2
- 2025A Bayesian Approach to Segmentation with Noisy Labels via Spatially Correlated Distributionscited by 1
- 2026SOCC-ICP: Semantics-Assisted Odometry based on Occupancy Grids and ICPcited by 1
Built on by
Not cited yet.