SplatLabel: Pseudo-Labelling through 4D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
While 2D Vision Foundation Models offer a pathway to automate 3D semantic pseudo-labelling, translating these priors into robust 3D representations typically requires complex heuristics or multi-model ensembles. We introduce SplatLabel, an automated pipeline that leverages a 4D Gaussian representation to extract LiDAR segmentation with predictive confidence, as well as semantic occupancy grids at arbitrary voxel resolutions. At its core, SplatLabel handles dynamic environments through an explicit temporal manifold that models the trajectories and lifespans of individual 3D primitives. This allows the system to accurately track moving actors and strictly define when objects appear and disappear, completely eliminating the need for pre-annotated 3D bounding boxes. To robustly support this dynamic tracking, the representation is grounded by structural and semantic priors: we guide scene geometry in unobserved regions by integrating 360-degree LiDAR via virtual depth maps, and rather than relying on domain-specific prompt engineering, we directly distill continuous soft probabilities from 2D models to inherently resolve semantic ambiguities over time and space. Finally, to accurately reflect the real-world trade-off between precision and recall, we reframe pseudo-label evaluation as a selective classification task using a generalized risk-recall metric. Experiments on SemanticKITTI demonstrate that SplatLabel consistently outperforms state-of-the-art baselines across multiple recall levels, establishing a highly robust framework for both 3D LiDAR segmentation and occupancy prediction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 37 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
33 of 37 references.
References · 33
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
21 more
- 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 217
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 69
- 2018The promises and pitfalls of Stochastic Gradient Langevin Dynamicscited by 56
- 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
- 20243D Gaussian Splatting in Robotics: A Surveycited by 45
- 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systemscited by 37
- 2025CoDa-4DGS: Dynamic Gaussian Splatting with Context and Deformation Awareness for Autonomous Drivingcited by 25
- 2023OVO: Open-Vocabulary Occupancycited by 24
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splattingcited by 14
- 2025RaGS: Unleashing 3D Gaussian Splatting from 4D Radar and Monocular Cues for 3D Object Detectioncited by 9
- 2024LiHi-GS: LiDAR-Supervised Gaussian Splatting for Highway Driving Scene Reconstructioncited by 8
- 2025LeAP: Consistent multi-domain 3D labeling using Foundation Modelscited by 8
- 2025Splat-LOAM: Gaussian Splatting LiDAR Odometry and Mappingcited by 4
- 2025GaussianFusionOcc: A Seamless Sensor Fusion Approach for 3D Occupancy Prediction Using 3D Gaussianscited by 3
- 2026GaussianCaR: Gaussian Splatting for Efficient Camera-Radar Fusioncited by 2
- 2026UniLiPs: Unified LiDAR Pseudo-Labeling with Geometry-Grounded Dynamic Scene Decompositioncited by 1
Built on by
Not cited yet.