GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloud
Not on the map. Why?
Abstract (arXiv)
We introduce a novel 3D object proposal approach named Generative Shape Proposal Network (GSPN) for instance segmentation in point cloud data. Instead of treating object proposal as a direct bounding box regression problem, we take an analysis-by-synthesis strategy and generate proposals by reconstructing shapes from noisy observations in a scene. We incorporate GSPN into a novel 3D instance segmentation framework named Region-based PointNet (R-PointNet) which allows flexible proposal refinement and instance segmentation generation. We achieve state-of-the-art performance on several 3D instance segmentation tasks. The success of GSPN largely comes from its emphasis on geometric understandings during object proposal, which greatly reducing proposals with low objectness.
Key facts. Cited by 145 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 37; 2023: 34; 2024: 20; 2025: 17; 2026: 9.
145 papers.
Sort:
By area:
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 197
- 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 176
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 126
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 123
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 117
38 more
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 115
- 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
- 2023RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understandingcited by 93
- 2021EfficientLPS: Efficient LiDAR Panoptic Segmentationcited by 76
- 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 75
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2021Panoptic 3D Scene Reconstruction From a Single RGB Imagecited by 70
- 2021Back-tracing Representative Points for Voting-based 3D Object Detection in Point Cloudscited by 67
- 2023Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labelscited by 64
- 2021Pri3D: Can 3D Priors Help 2D Representation Learning?cited by 61
- 2021Weakly Supervised Learning of Rigid 3D Scene Flowcited by 60
- 2022CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Cloudscited by 58
- 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understandingcited by 54
- 2023ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolutioncited by 52
- 2023NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detectioncited by 51
- 2023Mask-Attention-Free Transformer for 3D Instance Segmentationcited by 45
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
- 2023Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understandingcited by 38
- 2021RandomRooms: Unsupervised Pre-training from Synthetic Shapes and Randomized Layouts for 3D Object Detectioncited by 37
- 2021GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Networkcited by 37
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 20223D Instances as 1D Kernelscited by 36
- 2023AGILE3D: Attention Guided Interactive Multi-object 3D Segmentationcited by 33
- 20213D Spatial Recognition without Spatially Labeled 3Dcited by 31
- 2022Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Cloudscited by 31
- 2023Top-Down Beats Bottom-Up in 3D Instance Segmentationcited by 31
- 2023UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenescited by 31
- 2021Deep Learning Based 3D Segmentation: A Surveycited by 30
- 2024Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentationcited by 30
- 2022Divide and Conquer: 3D Point Cloud Instance Segmentation With Point-Wise Binarizationcited by 26
- 2022GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimationcited by 24
- 2023UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentationcited by 24
- 2023Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representationcited by 23
- 2022CSDN: Cross-modal Shape-transfer Dual-refinement Network for Point Cloud Completioncited by 22
- 2023BUOL: A Bottom-Up Framework with Occupancy-aware Lifting for Panoptic 3D Scene Reconstruction From A Single Imagecited by 20
- 2024UniDet3D: Multi-dataset Indoor 3D Object Detectioncited by 20
- 2021ICM-3D: Instantiated Category Modeling for 3D Instance Segmentationcited by 18
- 2023EFEM: Equivariant Neural Field Expectation Maximization for 3D Object Segmentation Without Scene Supervisioncited by 18
50 most cited of 145 All 145 (JSON)
- 2026ZVeC: A Zero-Shot Framework for Instance-Level Vehicle Extraction and Generative Point Cloud Completion21 Sep 2026
- 2026SegmentAnyTreeV2: Scaling Transformer-Based Tree Instance Segmentation Across Sensors, Platforms, and Forests6 Jun 2026
- 2026FoundObj: Self-supervised Foundation Models as Rewards for Label-free 3D Object Segmentation26 May 2026
- 2026EvObj: Learning Evolving Object-centric Representations for 3D Instance Segmentation without Scene Supervision13 May 2026
- 2026MV3DIS: Multi-View Mask Matching via 3D Guides for Zero-Shot 3D Instance Segmentation10 Apr 2026
- 2026TreeGaussian: Tree-Guided Cascaded Contrastive Learning for Hierarchical Consistent 3D Gaussian Scene Segmentation and Understanding31 Mar 2026
- 2026SegVGGT: Joint 3D Reconstruction and Instance Segmentation from Multi-View Images20 Mar 2026
- 2026LaSSM: Efficient Semantic-Spatial Query Decoding via Local Aggregation and State Space Models for 3D Instance Segmentation11 Feb 2026
- 2026PatchAlign3D: Local Feature Alignment for Dense 3D Shape Understanding5 Jan 2026
- 2025SOFTooth: Semantics-Enhanced Order-Aware Fusion for Tooth Instance Segmentation29 Dec 2025
- 2025Class-agnostic 3D Segmentation by Granularity-Consistent Automatic 2D Mask Tracking2 Nov 2025
- 2025BEEP3D: Box-Supervised End-to-End Pseudo-Mask Generation for 3D Instance Segmentation14 Oct 2025
38 more
- 2025PinPoint3D: Fine-Grained 3D Part Segmentation from a Few Clicks30 Sep 2025
- 2025OVSeg3R: Learn Open-vocabulary Instance Segmentation from 2D via 3D Reconstruction28 Sep 2025
- 2025SegDINO3D: 3D Instance Segmentation Empowered by Both Image-Level and Object-Level 2D Features19 Sep 2025
- 2025Towards scalable organ level 3D plant segmentation: Bridging the data algorithm computing gap8 Sep 2025
- 2025Details Matter for Indoor Open-vocabulary 3D Instance Segmentation30 Jul 2025
- 2025All in One: Visual-Description-Guided Unified Point Cloud Segmentation7 Jul 2025
- 2025Part Segmentation and Motion Estimation for Articulated Objects with Dynamic 3D Gaussians28 Jun 2025
- 2025Relation3D: Enhancing Relation Modeling for Point Cloud Instance Segmentation22 Jun 2025
- 2025ForestFormer3D: A Unified Framework for End-to-End Segmentation of Forest LiDAR 3D Point Clouds20 Jun 2025
- 2025Sketchy Bounding-box Supervision for 3D Instance Segmentation22 May 2025
- 2025GrabS: Generative Embodied Agent for 3D Object Segmentation without Scene Supervision16 Apr 2025
- 2025Easy3D: A Simple Yet Effective Method for 3D Interactive Segmentation15 Apr 2025
- 2025CLIMB-3D: Continual Learning for Imbalanced 3D Instance Segmentation24 Feb 2025
- 2025Beyond the Final Layer: Hierarchical Query Fusion Transformer with Agent-Interpolation Initialization for 3D Instance Segmentation6 Feb 2025
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understanding5 Dec 2024
- 20243D Part Segmentation via Geometric Aggregation of 2D Visual Features5 Dec 2024
- 2024Point Cloud Unsupervised Pre-training via 3D Gaussian Splatting27 Nov 2024
- 2024CompetitorFormer: Competitor Transformer for 3D Instance Segmentation21 Nov 2024
- 2024ProtoSeg: A Prototype-Based Point Cloud Instance Segmentation Method3 Oct 2024
- 2024Instance Segmentation of Reinforced Concrete Bridges with Synthetic Point Clouds24 Sep 2024
- 2024UniDet3D: Multi-dataset Indoor 3D Object Detection6 Sep 2024
- 2024Zero-Shot Dual-Path Integration Framework for Open-Vocabulary 3D Instance Segmentation16 Aug 2024
- 2024SGIFormer: Semantic-guided and Geometric-enhanced Interleaving Transformer for 3D Instance Segmentation16 Jul 2024
- 2024Joint prototype and coefficient prediction for 3D instance segmentation9 Jul 2024
- 2024A Unified Framework for 3D Scene Understanding3 Jul 2024
- 2024Instance Consistency Regularization for Semi-Supervised 3D Instance Segmentation24 Jun 2024
- 20243D Instance Segmentation Using Deep Learning on RGB-D Indoor Data19 Jun 2024
- 2024Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation4 Jun 2024
- 2024Segment Any 3D Object with Language2 Apr 2024
- 2024BSNet: Box-Supervised Simulation-assisted Mean Teacher for 3D Instance Segmentation22 Mar 2024
- 2024Aerial Lifting: Neural Urban Semantic and Building Instance Lifting from Aerial Imagery18 Mar 2024
- 2024Memory-based Adapters for Online 3D Scene Perception11 Mar 2024
- 2024Advancements in Point Cloud-Based 3D Defect Detection and Classification for Industrial Systems: A Comprehensive Survey20 Feb 2024
- 2024PartSTAD: 2D-to-3D Part Segmentation Task Adaptation11 Jan 2024
- 2023Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labels28 Dec 2023
- 2023Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representation18 Dec 2023
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance17 Dec 2023
- 2023EipFormer: Emphasizing Instance Positions in 3D Instance Segmentation9 Dec 2023
50 newest of 145 All 145 (JSON)
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 197
- 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 176
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 126
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 123
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 117
12 most cited of 142 All 142 (JSON)
- 2026ZVeC: A Zero-Shot Framework for Instance-Level Vehicle Extraction and Generative Point Cloud Completion21 Sep 2026
- 2026SegmentAnyTreeV2: Scaling Transformer-Based Tree Instance Segmentation Across Sensors, Platforms, and Forests6 Jun 2026
- 2026FoundObj: Self-supervised Foundation Models as Rewards for Label-free 3D Object Segmentation26 May 2026
- 2026EvObj: Learning Evolving Object-centric Representations for 3D Instance Segmentation without Scene Supervision13 May 2026
- 2026MV3DIS: Multi-View Mask Matching via 3D Guides for Zero-Shot 3D Instance Segmentation10 Apr 2026
- 2026TreeGaussian: Tree-Guided Cascaded Contrastive Learning for Hierarchical Consistent 3D Gaussian Scene Segmentation and Understanding31 Mar 2026
- 2026SegVGGT: Joint 3D Reconstruction and Instance Segmentation from Multi-View Images20 Mar 2026
- 2026LaSSM: Efficient Semantic-Spatial Query Decoding via Local Aggregation and State Space Models for 3D Instance Segmentation11 Feb 2026
- 2026PatchAlign3D: Local Feature Alignment for Dense 3D Shape Understanding5 Jan 2026
- 2025SOFTooth: Semantics-Enhanced Order-Aware Fusion for Tooth Instance Segmentation29 Dec 2025
- 2025Class-agnostic 3D Segmentation by Granularity-Consistent Automatic 2D Mask Tracking2 Nov 2025
- 2025BEEP3D: Box-Supervised End-to-End Pseudo-Mask Generation for 3D Instance Segmentation14 Oct 2025
12 newest of 142 All 142 (JSON)