Unsupervised Online 3D Instance Segmentation with Synthetic Sequences and Dynamic Loss
Not on the map. Why?
Abstract (arXiv)
Unsupervised online 3D instance segmentation is a fundamental yet challenging task, as it requires maintaining consistent object identities across LiDAR scans without relying on annotated training data. Existing methods, such as UNIT, have made progress in this direction but remain constrained by limited training diversity, rigid temporal sampling, and heavy dependence on noisy pseudo-labels. We propose a new framework that enriches the training distribution through synthetic point cloud sequence generation, enabling greater diversity without relying on manual labels or simulation engines. To better capture temporal dynamics, our method incorporates a flexible sampling strategy that leverages both adjacent and non-adjacent frames, allowing the model to learn from long-range dependencies as well as short-term variations. In addition, a dynamic-weighting loss emphasizes confident and informative samples, guiding the network toward more robust representations. Through extensive experiments on SemanticKITTI, nuScenes, and PandaSet, our method consistently outperforms UNIT and other unsupervised baselines, achieving higher segmentation accuracy and more robust temporal associations. The code will be publicly available at github.com/Eaphan/SFT3D.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 46 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
33 of 46 references.
References · 33
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 20183D-SIS: 3D Semantic Instance Segmentation of RGB-D Scanscited by 217
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 190
- 2017SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentationcited by 169
- 2020LiDARsim: Realistic LiDAR Simulation by Leveraging the Real Worldcited by 137
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 125
- 2022LaserMix for Semi-Supervised LiDAR Semantic Segmentationcited by 93
21 more
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 93
- 2020DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolutioncited by 75
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
- 20214D Panoptic LiDAR Segmentationcited by 65
- 2022Patchwork++: Fast and Robust Ground Segmentation Solving Partial Under-Segmentation Using 3D Point Cloudcited by 47
- 2023VideoCutLER: Surprisingly Simple Unsupervised Video Instance Segmentationcited by 37
- 2023UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenescited by 31
- 2021Patchwork: Concentric Zone-based Region-wise Ground Segmentation with Ground Likelihood Estimation Using a 3D LiDAR Sensorcited by 29
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2023Towards Unsupervised Object Detection From LiDAR Point Cloudscited by 23
- 2024LISO: Lidar-only Self-Supervised 3D Object Detectioncited by 22
- 2024Rethinking Few-shot 3D Point Cloud Semantic Segmentationcited by 18
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Modelcited by 17
- 2024SeMoLi: What Moves Together Belongs Togethercited by 13
- 2022PointMCD: Boosting Deep Point Cloud Encoders via Multi-view Cross-modal Distillation for 3D Shape Recognitioncited by 10
- 2022Leveraging Single-View Images for Unsupervised 3D Point Cloud Completioncited by 8
- 2023Spatial-Temporal Graph Enhanced DETR Towards Multi-Frame 3D Object Detectioncited by 8
- 2023Learning from Mistakes: Self-Regularizing Hierarchical Representations in Point Cloud Semantic Segmentationcited by 5
- 2024UNIT: Unsupervised Online Instance Segmentation through Timecited by 5
- 2024AutoInst: Automatic Instance-Based Segmentation of LiDAR 3D Scanscited by 3
- 2024D-Aug: Enhancing Data Augmentation for Dynamic LiDAR Scenescited by 1
Built on by
Not cited yet.