EipFormer: Emphasizing Instance Positions in 3D Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
3D instance segmentation plays a crucial role in comprehending 3D scenes. Despite recent advancements in this field, existing approaches exhibit certain limitations. These methods often rely on fixed instance positions obtained from sampled representative points in vast 3D point clouds, using center prediction or farthest point sampling. However, these selected positions may deviate from actual instance centers, posing challenges in precisely grouping instances. Moreover, the common practice of grouping candidate instances from a single type of coordinates introduces difficulties in identifying neighboring instances or incorporating edge points. To tackle these issues, we present a novel Transformer-based architecture, EipFormer, which comprises progressive aggregation and dual position embedding. The progressive aggregation mechanism leverages instance positions to refine instance proposals. It enhances the initial instance positions through weighted farthest point sampling and further refines the instance positions and proposals using aggregation averaging and center matching. Additionally, dual position embedding superposes the original and centralized position embeddings, thereby enhancing the model performance in distinguishing adjacent instances. Extensive experiments on popular datasets demonstrate that EipFormer achieves superior or comparable performance compared to state-of-the-art approaches.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 9 Dec 2023.
Builds on
46 of 62 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
34 more
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 20183D-SIS: 3D Semantic Instance Segmentation of RGB-D Scanscited by 217
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
- 2020OccuSeg: Occupancy-aware 3D Instance Segmentationcited by 177
- 2017SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentationcited by 169
- 2019Learning Object Bounding Boxes for 3D Instance Segmentation on Point Cloudscited by 156
- 2018GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloudcited by 146
- 20203D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentationcited by 141
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 127
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
- 2021Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networkscited by 99
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2019Associatively Segmenting Instances and Semantics in Point Cloudscited by 86
- 2020Unseen Object Instance Segmentation for Robotic Environmentscited by 85
- 2018Learning to predict crisp boundariescited by 82
- 20193D Instance Segmentation via Multi-Task Metric Learningcited by 80
- 2019Multi-view PointNet for 3D Scene Understandingcited by 76
- 2021PRA-Net: Point Relation-Aware Network for 3D Point Cloud Analysiscited by 58
- 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understandingcited by 54
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 53
- 2023ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolutioncited by 53
- 20223D Instances as 1D Kernelscited by 36
- 2020Learning Gaussian Instance Segmentation in Point Cloudscited by 33
- 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
- 2019JSNet: Joint Instance and Semantic Segmentation of 3D Point Cloudscited by 27
- 2022Divide and Conquer: 3D Point Cloud Instance Segmentation With Point-Wise Binarizationcited by 26
- 2023Prototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentationcited by 26
- 2022PointInst3D: Segmenting 3D Instances by Pointscited by 16
- 2021Point Cloud Instance Segmentation with Semi-supervised Bounding-Box Miningcited by 15
- 20213D Instance Segmentation of MVS Buildingscited by 12
Built on by
Citing papers per year: 2024: 1.
1 paper.