mlsanityData to 14 Oct 2026

GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model

arXiv 2609.19716 ↗First posted 17 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Pre-trained 3D vision models have substantially advanced point cloud analysis, yet adapting them to downstream tasks via full fine-tuning is computationally expensive and storage-intensive. Parameter-Efficient Fine-Tuning (PEFT) offers a promising alternative by reducing both adaptation cost and storage burden. However, existing prompting-based approaches ignore the intrinsic geometric structures of point clouds, thereby limiting their adaptation capability. This limitation stems from their inability to encode both fine-grained geometric cues and coarse-grained structural semantics, as well as failing to propagate such information effectively through the model hierarchy. To address these challenges, we propose GAPrompt++, a multi-granular geometry-aware prompting method that provides richer geometric guidance for efficient 3D task adaptation. Specifically, we introduce a Point Shift Prompter that extracts multi-granular geometric features across different scales, enabling instance-specific geometric adjustments during adaptation. Next, a Keypoint Prompter adaptively generates point-level prompts to highlight local geometric saliency and fine-grained structural details. Furthermore, a Prompt Propagation mechanism injects these multi-granular geometric cues throughout the feature extraction hierarchy, strengthening the ability to capture essential geometric characteristics. Extensive experiments show that GAPrompt++ achieves state-of-the-art performance among prompting-based PEFT methods and even surpasses full fine-tuning across diverse benchmarks, while requiring less than 2% trainable parameters. In addition, to address the saturation of existing evaluation datasets, we construct two more challenging benchmarks derived from 3D Gaussian Splatting and Multi-View Stereo reconstruction, offering diverse and realistic point cloud scenarios to promote future research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 82 of its 92 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

82 of 92 references.

References · 82

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  8. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  9. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  10. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  11. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  12. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
38 more
  1. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2022Visual Prompt Tuningcited by 1,681
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  8. 2025DINOv3cited by 1,414
  9. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  10. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  11. 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 872
  12. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  13. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  14. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 719
  15. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  16. 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
  17. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  18. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
  19. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
  20. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
  21. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
  22. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  23. 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 379
  24. 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
  25. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  26. 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 294
  27. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
  28. 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
  29. 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
  30. 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 164
  31. 2022CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-trainingcited by 160
  32. 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
  33. 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 144
  34. 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 137
  35. 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
  36. 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
  37. 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
  38. 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 110

50 most cited of 82 All 82 (JSON)

Built on by

Not cited yet.