GAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Model
Not on the map. Why?
Abstract (arXiv)
Pre-trained 3D vision models have gained significant attention for their promising performance on point cloud data. However, fully fine-tuning these models for downstream tasks is computationally expensive and storage-intensive. Existing parameter-efficient fine-tuning (PEFT) approaches, which focus primarily on input token prompting, struggle to achieve competitive performance due to their limited ability to capture the geometric information inherent in point clouds. To address this challenge, we propose a novel Geometry-Aware Point Cloud Prompt (GAPrompt) that leverages geometric cues to enhance the adaptability of 3D vision models. First, we introduce a Point Prompt that serves as an auxiliary input alongside the original point cloud, explicitly guiding the model to capture fine-grained geometric details. Additionally, we present a Point Shift Prompter designed to extract global shape information from the point cloud, enabling instance-specific geometric adjustments at the input level. Moreover, our proposed Prompt Propagation mechanism incorporates the shape information into the model's feature extraction process, further strengthening its ability to capture essential geometric characteristics. Extensive experiments demonstrate that GAPrompt significantly outperforms state-of-the-art PEFT methods and achieves competitive results compared to full fine-tuning on various benchmarks, while utilizing only 2.19% of trainable parameters. Our code is available at https://github.com/zhoujiahuan1991/ICML2025-GAPrompt.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 7 May 2025.
Builds on
34 of 42 references.
References · 34
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2022Visual Prompt Tuningcited by 1,681
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
- 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 872
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 719
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
22 more
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 460
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 294
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
- 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 164
- 2022CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-trainingcited by 160
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 137
- 2022FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformercited by 133
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
- 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
- 2023Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Modelscited by 68
- 2024Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysiscited by 53
- 2023Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Modelscited by 42
- 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
- 2024CAPrompt: Cyclic Prompt Aggregation for Pre-Trained Model Based Class Incremental Learningcited by 9
Built on by
Citing papers per year: 2025: 4; 2026: 9.
13 papers.
Sort:
By area:
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Surveycited by 21
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Modelscited by 6
- 2026Tri-Efficient Transfer Learning for Point Cloud Videoscited by 6
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentationcited by 4
- 2025UPP: Unified Point-Level Prompting for Robust Point Cloud Analysiscited by 0
- 2025CKDA: Cross-modality Knowledge Disentanglement and Alignment for Visible-Infrared Lifelong Person Re-identificationcited by 0
- 2026Fast 3D Foundation Model Initialized Gaussian Splattingcited by 0
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understandingcited by 0
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classificationcited by 0
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
- 2026Position Anchor Tuning: Towards Efficient Adaptation of Pre-Trained Point Cloud Transformerscited by 0
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Modelcited by 0
- 2026Refine Then Fusion: Training-Free 3D Point Cloud Adaptation with Priority Refinement and Multi-Modal Knowledge Fusion18 Sep 2026
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model17 Sep 2026
- 2026Position Anchor Tuning: Towards Efficient Adaptation of Pre-Trained Point Cloud Transformers16 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classification22 Jul 2026
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understanding21 Jul 2026
- 2026Fast 3D Foundation Model Initialized Gaussian Splatting3 Jul 2026
- 2026Tri-Efficient Transfer Learning for Point Cloud Videos23 Jun 2026
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models5 May 2026
- 2025CKDA: Cross-modality Knowledge Disentanglement and Alignment for Visible-Infrared Lifelong Person Re-identification19 Nov 2025
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Survey15 Oct 2025
- 2025UPP: Unified Point-Level Prompting for Robust Point Cloud Analysis25 Jul 2025
1 more
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Surveycited by 21
- 2026Tri-Efficient Transfer Learning for Point Cloud Videoscited by 6
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentationcited by 4
- 2025UPP: Unified Point-Level Prompting for Robust Point Cloud Analysiscited by 0
- 2025CKDA: Cross-modality Knowledge Disentanglement and Alignment for Visible-Infrared Lifelong Person Re-identificationcited by 0
- 2026Fast 3D Foundation Model Initialized Gaussian Splattingcited by 0
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understandingcited by 0
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classificationcited by 0
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
- 2026Position Anchor Tuning: Towards Efficient Adaptation of Pre-Trained Point Cloud Transformerscited by 0
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Modelcited by 0
- 2026Refine Then Fusion: Training-Free 3D Point Cloud Adaptation with Priority Refinement and Multi-Modal Knowledge Fusioncited by 0
- 2026Refine Then Fusion: Training-Free 3D Point Cloud Adaptation with Priority Refinement and Multi-Modal Knowledge Fusion18 Sep 2026
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model17 Sep 2026
- 2026Position Anchor Tuning: Towards Efficient Adaptation of Pre-Trained Point Cloud Transformers16 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026Point-Selection Fine-Tuning Framework for Robust Point Cloud Classification22 Jul 2026
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understanding21 Jul 2026
- 2026Fast 3D Foundation Model Initialized Gaussian Splatting3 Jul 2026
- 2026Tri-Efficient Transfer Learning for Point Cloud Videos23 Jun 2026
- 2025CKDA: Cross-modality Knowledge Disentanglement and Alignment for Visible-Infrared Lifelong Person Re-identification19 Nov 2025
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Survey15 Oct 2025
- 2025UPP: Unified Point-Level Prompting for Robust Point Cloud Analysis25 Jul 2025
- 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation28 May 2025