Parameter-efficient Prompt Learning for 3D Point Cloud Understanding
Not on the map. Why?
Abstract (arXiv)
This paper presents a parameter-efficient prompt tuning method, named PPT, to adapt a large multi-modal model for 3D point cloud understanding. Existing strategies are quite expensive in computation and storage, and depend on time-consuming prompt engineering. We address the problems from three aspects. Firstly, a PromptLearner module is devised to replace hand-crafted prompts with learnable contexts to automate the prompt tuning process. Then, we lock the pre-trained backbone instead of adopting the full fine-tuning paradigm to substantially improve the parameter efficiency. Finally, a lightweight PointAdapter module is arranged near target tasks to enhance prompt tuning for 3D point cloud understanding. Comprehensive experiments are conducted to demonstrate the superior parameter and data efficiency of the proposed method.Meanwhile, we obtain new records on 4 public datasets and multiple 3D tasks, i.e., point cloud recognition, few-shot learning, and part segmentation. The implementation is available at https://github.com/auniquesun/PPT.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 64 of its 70 references that are in the map. First posted on arXiv 24 Feb 2024.
Builds on
64 of 70 references.
References · 64
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
38 more
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2022Visual Prompt Tuningcited by 1,681
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2019How Can We Know What Language Models Know?cited by 959
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2020PCT: Point cloud transformercited by 732
- 2021GPT Understands, Toocited by 716
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
- 2022MaPLe: Multi-modal Prompt Learningcited by 687
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 657
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 436
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 379
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2022Scaling Language-Image Pre-training via Maskingcited by 317
- 2020Exploring Self-attention for Image Recognitioncited by 313
- 2021Factual Probing Is [MASK]: Learning vs. Learning to Recallcited by 291
- 2023Self-regulating Prompts: Foundational Model Adaptation without Forgettingcited by 272
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
- 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
- 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 239
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 202
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
- 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 6; 2026: 7.
16 papers.
Sort:
By area:
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
- 2024Positional Prompt Tuning for Efficient 3D Representation Learningcited by 15
- 2025PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adaptercited by 9
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysiscited by 6
- 2025MoST: Efficient Monarch Sparse Tuning for 3D Representation Learningcited by 6
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentationcited by 4
- 2026PointTPA: Dynamic Network Parameter Adaptation for 3D Scene Understandingcited by 2
- 2025MS-DGCNN++: Multi-Scale Dynamic Graph Convolution with Scale-Dependent Normalization for Robust LiDAR Tree Species Classificationcited by 1
- 2025Resilient Multimodal Industrial Surface Defect Detection with Uncertain Sensors Availabilitycited by 1
- 2026SLNet: A Super-Lightweight Geometry-Adaptive Network for 3D Point Cloud Recognitioncited by 1
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understandingcited by 0
- 2026LIDARLearn: A Unified Deep Learning Library for 3D Point Cloud Classification, Segmentation, and Self-Supervised Representation Learningcited by 0
4 more
- 2026P3T: Prototypical Point-level Prompt Tuning with Enhanced Generalization for 3D Vision-Language Modelscited by 0
- 2026Domain Generalizable Adaptation of 3D Vision-Language Models via Regularized Fine-Tuningcited by 0
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classificationcited by 0
- 2026PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learningcited by 0
- 2026PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learning3 Aug 2026
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classification22 Jul 2026
- 2026Domain Generalizable Adaptation of 3D Vision-Language Models via Regularized Fine-Tuning16 Jun 2026
- 2026P3T: Prototypical Point-level Prompt Tuning with Enhanced Generalization for 3D Vision-Language Models17 Apr 2026
- 2026LIDARLearn: A Unified Deep Learning Library for 3D Point Cloud Classification, Segmentation, and Self-Supervised Representation Learning12 Apr 2026
- 2026PointTPA: Dynamic Network Parameter Adaptation for 3D Scene Understanding6 Apr 2026
- 2026SLNet: A Super-Lightweight Geometry-Adaptive Network for 3D Point Cloud Recognition8 Mar 2026
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understanding15 Nov 2025
- 2025Resilient Multimodal Industrial Surface Defect Detection with Uncertain Sensors Availability3 Sep 2025
- 2025MS-DGCNN++: Multi-Scale Dynamic Graph Convolution with Scale-Dependent Normalization for Robust LiDAR Tree Species Classification16 Jul 2025
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation28 May 2025
- 2025PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter27 May 2025
4 more
- 2025MoST: Efficient Monarch Sparse Tuning for 3D Representation Learning24 Mar 2025
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysis27 Oct 2024
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning10 Oct 2024
- 2024Positional Prompt Tuning for Efficient 3D Representation Learning21 Aug 2024
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
- 2024Positional Prompt Tuning for Efficient 3D Representation Learningcited by 15
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysiscited by 6
- 2025MoST: Efficient Monarch Sparse Tuning for 3D Representation Learningcited by 6
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentationcited by 4
- 2026PointTPA: Dynamic Network Parameter Adaptation for 3D Scene Understandingcited by 2
- 2025MS-DGCNN++: Multi-Scale Dynamic Graph Convolution with Scale-Dependent Normalization for Robust LiDAR Tree Species Classificationcited by 1
- 2025Resilient Multimodal Industrial Surface Defect Detection with Uncertain Sensors Availabilitycited by 1
- 2026SLNet: A Super-Lightweight Geometry-Adaptive Network for 3D Point Cloud Recognitioncited by 1
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understandingcited by 0
- 2026LIDARLearn: A Unified Deep Learning Library for 3D Point Cloud Classification, Segmentation, and Self-Supervised Representation Learningcited by 0
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classificationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learning3 Aug 2026
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classification22 Jul 2026
- 2026LIDARLearn: A Unified Deep Learning Library for 3D Point Cloud Classification, Segmentation, and Self-Supervised Representation Learning12 Apr 2026
- 2026PointTPA: Dynamic Network Parameter Adaptation for 3D Scene Understanding6 Apr 2026
- 2026SLNet: A Super-Lightweight Geometry-Adaptive Network for 3D Point Cloud Recognition8 Mar 2026
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understanding15 Nov 2025
- 2025Resilient Multimodal Industrial Surface Defect Detection with Uncertain Sensors Availability3 Sep 2025
- 2025MS-DGCNN++: Multi-Scale Dynamic Graph Convolution with Scale-Dependent Normalization for Robust LiDAR Tree Species Classification16 Jul 2025
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation28 May 2025
- 2025MoST: Efficient Monarch Sparse Tuning for 3D Representation Learning24 Mar 2025
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysis27 Oct 2024
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning10 Oct 2024
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Multimodal Robust Prompt Distillation for 3D Point Cloud Models
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformation
- 2026PointRFT: Explicit Reinforcement Fine-tuning for Point Cloud Few-shot Learning
- 2026PointLLM-R: Enhancing 3D Point Cloud Reasoning via Chain-of-Thought
- 2026CLIPoint3D: Language-Grounded Few-Shot Unsupervised 3D Point Cloud Domain Adaptation
- 20223D Point Cloud Pre-training with Knowledge Distillation from 2D Images
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models
- 2022APSNet: Attention Based Point Cloud Sampling