mlsanityData to 14 Oct 2026

EipFormer: Emphasizing Instance Positions in 3D Instance Segmentation

arXiv 2312.05602 ↗First posted 9 Dec 2023cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

3D instance segmentation plays a crucial role in comprehending 3D scenes. Despite recent advancements in this field, existing approaches exhibit certain limitations. These methods often rely on fixed instance positions obtained from sampled representative points in vast 3D point clouds, using center prediction or farthest point sampling. However, these selected positions may deviate from actual instance centers, posing challenges in precisely grouping instances. Moreover, the common practice of grouping candidate instances from a single type of coordinates introduces difficulties in identifying neighboring instances or incorporating edge points. To tackle these issues, we present a novel Transformer-based architecture, EipFormer, which comprises progressive aggregation and dual position embedding. The progressive aggregation mechanism leverages instance positions to refine instance proposals. It enhances the initial instance positions through weighted farthest point sampling and further refines the instance positions and proposals using aggregation averaging and center matching. Additionally, dual position embedding superposes the original and centralized position embeddings, thereby enhancing the model performance in distinguishing adjacent instances. Extensive experiments on popular datasets demonstrate that EipFormer achieves superior or comparable performance compared to state-of-the-art approaches.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 9 Dec 2023.

Builds on

46 of 62 references.

References · 46

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  6. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  7. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  8. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  9. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  10. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  11. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
  12. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
34 more
  1. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
  2. 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
  3. 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
  4. 20183D-SIS: 3D Semantic Instance Segmentation of RGB-D Scanscited by 217
  5. 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
  6. 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
  7. 2020OccuSeg: Occupancy-aware 3D Instance Segmentationcited by 177
  8. 2017SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentationcited by 169
  9. 2019Learning Object Bounding Boxes for 3D Instance Segmentation on Point Cloudscited by 156
  10. 2018GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloudcited by 146
  11. 20203D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentationcited by 141
  12. 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 127
  13. 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
  14. 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
  15. 2021Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networkscited by 99
  16. 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
  17. 2019Associatively Segmenting Instances and Semantics in Point Cloudscited by 86
  18. 2020Unseen Object Instance Segmentation for Robotic Environmentscited by 85
  19. 2018Learning to predict crisp boundariescited by 82
  20. 20193D Instance Segmentation via Multi-Task Metric Learningcited by 80
  21. 2019Multi-view PointNet for 3D Scene Understandingcited by 76
  22. 2021PRA-Net: Point Relation-Aware Network for 3D Point Cloud Analysiscited by 58
  23. 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understandingcited by 54
  24. 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 53
  25. 2023ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolutioncited by 53
  26. 20223D Instances as 1D Kernelscited by 36
  27. 2020Learning Gaussian Instance Segmentation in Point Cloudscited by 33
  28. 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
  29. 2019JSNet: Joint Instance and Semantic Segmentation of 3D Point Cloudscited by 27
  30. 2022Divide and Conquer: 3D Point Cloud Instance Segmentation With Point-Wise Binarizationcited by 26
  31. 2023Prototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentationcited by 26
  32. 2022PointInst3D: Segmenting 3D Instances by Pointscited by 16
  33. 2021Point Cloud Instance Segmentation with Semi-supervised Bounding-Box Miningcited by 15
  34. 20213D Instance Segmentation of MVS Buildingscited by 12

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.