SEGCloud: Semantic Segmentation of 3D Point Clouds
Not on the map. Why?
Abstract (arXiv)
3D semantic scene labeling is fundamental to agents operating in the real world. In particular, labeling raw 3D point sets from sensors provides fine-grained semantics. Recent works leverage the capabilities of Neural Networks (NNs), but are limited to coarse voxel predictions and do not explicitly enforce global consistency. We present SEGCloud, an end-to-end framework to obtain 3D point-level segmentation that combines the advantages of NNs, trilinear interpolation(TI) and fully connected Conditional Random Fields (FC-CRF). Coarse voxel predictions from a 3D Fully Convolutional NN are transferred back to the raw 3D points via trilinear interpolation. Then the FC-CRF enforces global consistency and provides fine-grained semantics on the points. We implement the latter as a differentiable Recurrent NN to allow joint optimization. We evaluate the framework on two indoor and two outdoor 3D datasets (NYU V2, S3DIS, KITTI, Semantic3D.net), and show performance comparable or superior to the state-of-the-art on all datasets.
Key facts. Cited by 178 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 55; 2022: 43; 2023: 38; 2024: 20; 2025: 14; 2026: 8.
178 papers.
Sort:
By area:
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 166
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 133
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 126
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
38 more
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2021Fast Point Transformercited by 103
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
- 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
- 2023RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Drivingcited by 76
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2021SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Cloudscited by 64
- 2021Weakly Supervised Learning of Rigid 3D Scene Flowcited by 60
- 2021Adaptive Graph Convolution for Point Cloud Analysiscited by 60
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022Contrastive Boundary Learning for Point Cloud Segmentationcited by 56
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 52
- 2021Learning Semantic Segmentation of Large-Scale Point Clouds with Random Samplingcited by 51
- 2022SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Cloudscited by 49
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
- 2021PVT: Point-Voxel Transformer for Point Cloud Learningcited by 42
- 2023Instance Neural Radiance Fieldcited by 39
- 2021Lite-HDSeg: LiDAR Semantic Segmentation Using Lite Harmonic Dense Convolutionscited by 37
- 2021HCRF-Flow: Scene Flow from Point Clouds with Continuous High-order CRFs and Position-aware Flow Embeddingcited by 36
- 2023SAM-guided Graph Cut for 3D Instance Segmentationcited by 35
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applicationscited by 32
- 2021Deep Learning Based 3D Segmentation: A Surveycited by 30
- 2022Weakly Supervised Semantic Segmentation for Large-Scale Point Cloudcited by 27
- 2021LiDAR-based Recurrent 3D Semantic Segmentation with Temporal Memory Alignmentcited by 26
- 20223D Segmentation of Humans in Point Clouds with Synthetic Datacited by 24
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Surveycited by 24
- 2023Clustering based Point Cloud Representation Learning for 3D Analysiscited by 23
- 2021Omni-supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoningcited by 22
- 2023Hierarchical Point-based Active Learning for Semi-supervised Point Cloud Semantic Segmentationcited by 21
- 2022PVNAS: 3D Neural Architecture Search with Point-Voxel Convolutioncited by 16
- 2022Beyond single receptive field: A receptive field fusion-and-stratification network for airborne laser scanning point cloud classificationcited by 16
- 2022PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognitioncited by 16
- 2023ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understandingcited by 16
- 2024KPConvX: Modernizing Kernel Point Convolution with Kernel Attentioncited by 16
- 2021Point Cloud Learning with Transformercited by 15
50 most cited of 178 All 178 (JSON)
- 2026Stream3Dv2: Geometric-Semantic Fusion Enhanced Streaming Zero-Shot 3D Scene Understanding21 Aug 2026
- 2026Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition4 Aug 2026
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation24 Jun 2026
- 2026GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence6 Jun 2026
- 2026RelFlexformer: Efficient Attention 3D-Transformers for Integrable Relative Positional Encodings11 May 2026
- 2026From Spherical to Gaussian: A Comparative Analysis of Point Cloud Cropping Strategies in Large-Scale 3D Environments3 May 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026RGB-Pointmap Pretraining for Unified 3D Scene Understanding2 Apr 2026
- 2025SemanticBridge - A Dataset for 3D Semantic Segmentation of Bridges and Domain Gap Analysis17 Dec 2025
- 2025Certified L2-Norm Robustness of 3D Point Cloud Recognition in the Frequency Domain10 Nov 2025
- 2025Unlocking 3D Affordance Segmentation with 2D Semantic Knowledge9 Oct 2025
- 2025Point-Plane Projections for Accurate LiDAR Semantic Segmentation in Small Data Scenarios13 Sep 2025
38 more
- 2025Towards scalable organ level 3D plant segmentation: Bridging the data algorithm computing gap8 Sep 2025
- 2025LabelGS: Label-Aware 3D Gaussian Splatting for 3D Scene Segmentation27 Aug 2025
- 2025A Comprehensive Survey for Real-World Industrial Defect Detection: Challenges, Approaches, and Prospects15 Jul 2025
- 2025Fine-Grained Spatially Varying Material Selection in Images10 Jun 2025
- 2025BAGNet: A Boundary-Aware Graph Attention Network for 3D Point Cloud Semantic Segmentation31 May 2025
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation28 May 2025
- 2025DG-MVP: 3D Domain Generalization via Multiple Views of Point Clouds for Classification16 Apr 2025
- 2025Sonata: Self-Supervised Learning of Reliable Point Representations20 Mar 2025
- 2025Fourier Decomposition for Explicit Representation of 3D Point Cloud Attributes13 Mar 2025
- 2025Ground Awareness in Deep Learning for Large Outdoor Point Cloud Segmentation30 Jan 2025
- 2024PVP: Polar Representation Boost for 3D Semantic Occupancy Prediction10 Dec 2024
- 2024FIction: 4D Future Interaction Prediction from Video1 Dec 2024
- 2024SIESEF-FusionNet: Spatial Inter-correlation Enhancement and Spatially-Embedded Feature Fusion Network for LiDAR Point Cloud Semantic Segmentation11 Nov 2024
- 2024Deep Learning for 3D Point Cloud Enhancement: A Survey30 Oct 2024
- 2024Exploiting Local Features and Range Images for Small Data Real-Time Point Cloud Semantic Segmentation14 Oct 2024
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning10 Oct 2024
- 2024Improving Adversarial Robustness for 3D Point Cloud Recognition at Test-Time through Purified Self-Training23 Sep 2024
- 2024Towards Modality-agnostic Label-efficient Segmentation with Entropy-Regularized Distribution Alignment29 Aug 2024
- 2024TeFF: Tracking-enhanced Forgetting-free Few-shot 3D LiDAR Semantic Segmentation28 Aug 2024
- 2024On-the-fly Point Feature Representation for Point Clouds Analysis31 Jul 2024
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models18 Jul 2024
- 2024Global Attention-Guided Dual-Domain Point Cloud Feature Learning for Classification and Segmentation12 Jul 2024
- 2024PointViG: A Lightweight GNN-based Model for Efficient Point Cloud Analysis1 Jul 2024
- 2024Enhancing Generalizability of Representation Learning for Data-Efficient 3D Scene Understanding17 Jun 2024
- 2024KPConvX: Modernizing Kernel Point Convolution with Kernel Attention21 May 2024
- 2024OpenDlign: Open-World Point Cloud Understanding with Depth-Aligned Images25 Apr 2024
- 2024PureForest: A Large-Scale Aerial Lidar and Aerial Imagery Dataset for Tree Species Classification in Monospecific Forests18 Apr 2024
- 2024Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling21 Mar 2024
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Survey20 Feb 2024
- 2024A Framework for Building Point Cloud Cleaning, Plane Detection and Semantic Segmentation1 Feb 2024
- 2023ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understanding18 Dec 2023
- 2023Point Transformer V3: Simpler, Faster, Stronger15 Dec 2023
- 2023SAM-guided Graph Cut for 3D Instance Segmentation13 Dec 2023
- 2023GRJointNET: Synergistic Completion and Part Segmentation on 3D Incomplete Point Clouds23 Nov 2023
- 2023Test-Time Augmentation for 3D Point Cloud Classification and Segmentation22 Nov 2023
- 2023Segmentation of Drone Collision Hazards in Airborne RADAR Point Clouds Using PointNet6 Nov 2023
- 2023PointHR: Exploring High-Resolution Architectures for 3D Point Cloud Segmentation11 Oct 2023
- 2023APNet: Urban-level Scene Segmentation of Aerial Images and Point Clouds29 Sep 2023
50 newest of 178 All 178 (JSON)
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 166
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 133
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 126
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
12 most cited of 175 All 175 (JSON)
- 2026Stream3Dv2: Geometric-Semantic Fusion Enhanced Streaming Zero-Shot 3D Scene Understanding21 Aug 2026
- 2026Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition4 Aug 2026
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation24 Jun 2026
- 2026GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence6 Jun 2026
- 2026RelFlexformer: Efficient Attention 3D-Transformers for Integrable Relative Positional Encodings11 May 2026
- 2026From Spherical to Gaussian: A Comparative Analysis of Point Cloud Cropping Strategies in Large-Scale 3D Environments3 May 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026RGB-Pointmap Pretraining for Unified 3D Scene Understanding2 Apr 2026
- 2025SemanticBridge - A Dataset for 3D Semantic Segmentation of Bridges and Domain Gap Analysis17 Dec 2025
- 2025Certified L2-Norm Robustness of 3D Point Cloud Recognition in the Frequency Domain10 Nov 2025
- 2025Unlocking 3D Affordance Segmentation with 2D Semantic Knowledge9 Oct 2025
- 2025Point-Plane Projections for Accurate LiDAR Semantic Segmentation in Small Data Scenarios13 Sep 2025
12 newest of 175 All 175 (JSON)