3D Point Cloud Network Pruning: When Some Weights Do not Matter
Not on the map. Why?
Abstract (arXiv)
A point cloud is a crucial geometric data structure utilized in numerous applications. The adoption of deep neural networks referred to as Point Cloud Neural Networks (PC- NNs), for processing 3D point clouds, has significantly advanced fields that rely on 3D geometric data to enhance the efficiency of tasks. Expanding the size of both neural network models and 3D point clouds introduces significant challenges in minimizing computational and memory requirements. This is essential for meeting the demanding requirements of real-world applications, which prioritize minimal energy consumption and low latency. Therefore, investigating redundancy in PCNNs is crucial yet challenging due to their sensitivity to parameters. Additionally, traditional pruning methods face difficulties as these networks rely heavily on weights and points. Nonetheless, our research reveals a promising phenomenon that could refine standard PCNN pruning techniques. Our findings suggest that preserving only the top p% of the highest magnitude weights is crucial for accuracy preservation. For example, pruning 99% of the weights from the PointNet model still results in accuracy close to the base level. Specifically, in the ModelNet40 dataset, where the base accuracy with the PointNet model was 87. 5%, preserving only 1% of the weights still achieves an accuracy of 86.8%. Codes are available in: https://github.com/apurba-nsu-rnd-lab/PCNN_Pruning
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 47 of its 69 references that are in the map. First posted on arXiv 26 Aug 2024.
Builds on
47 of 69 references.
References · 47
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 627
- 2020What is the State of Neural Network Pruning?cited by 578
- 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
35 more
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 461
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 340
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2019Deconstructing Lottery Tickets: Zeros, Signs, and the Supermaskcited by 206
- 2020Proving the Lottery Ticket Hypothesis: Pruning is All You Needcited by 200
- 2019Quantization Networkscited by 151
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2019DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processingcited by 104
- 2019One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizerscited by 102
- 2020The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Modelscited by 91
- 2018Channel Gating Neural Networkscited by 80
- 2021Only Train Once: A One-Shot Neural Network Training And Pruning Frameworkcited by 70
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2019Learned Point Cloud Geometry Compressioncited by 58
- 2022Advancing Model Pruning via Bi-level Optimizationcited by 55
- 2021How Well Do Sparse Imagenet Models Transfer?cited by 50
- 2021Playing Lottery Tickets with Vision and Languagecited by 45
- 2016Structured Prediction of 3D Human Pose with Deep Neural Networkscited by 43
- 2020Rotation-Invariant Local-to-Global Representation Learning for 3D Point Cloudcited by 38
- 2020The Lottery Ticket Hypothesis for Object Recognitioncited by 34
- 2023Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysiscited by 34
- 2021Distilling Holistic Knowledge with Graph Neural Networkscited by 26
- 2023Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Modelcited by 25
- 2019Mitigating the Hubness Problem for Zero-Shot Learning of 3D Objectscited by 24
- 2021The Elastic Lottery Ticket Hypothesiscited by 23
- 20223DAC: Learning Attribute Compression for Point Cloudscited by 22
- 2022RIC-CNN: Rotation-Invariant Coordinate Convolutional Neural Networkcited by 20
- 2023Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Modelscited by 20
- 2023Can Unstructured Pruning Reduce the Depth in Deep Neural Networks?cited by 20
- 2023CP3: Channel Pruning Plug-in for Point-based Networkscited by 10
- 2022Studying the impact of magnitude pruning on contrastive learning methodscited by 6
- 2022COLT: Cyclic Overlapping Lottery Tickets for Faster Pruning of Convolutional Neural Networkscited by 3
- 2022Deep neural networks for fast acquisition of aortic 3D pressure and velocity flow fieldscited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.