mlsanityData to 7 Oct 2026

PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter

arXiv 2505.20941 ↗First posted 27 May 2025cs.CVcited by 9

On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing

Abstract (arXiv)

Applying pre-trained models to assist point cloud understanding has recently become a mainstream paradigm in 3D perception. However, existing application strategies are straightforward, utilizing only the final output of the pre-trained model for various task heads. It neglects the rich complementary information in the intermediate layer, thereby failing to fully unlock the potential of pre-trained models. To overcome this limitation, we propose an orthogonal solution: Point Mamba Adapter (PMA), which constructs an ordered feature sequence from all layers of the pre-trained model and leverages Mamba to fuse all complementary semantics, thereby promoting comprehensive point cloud understanding. Constructing this ordered sequence is non-trivial due to the inherent isotropy of 3D space. Therefore, we further propose a geometry-constrained gate prompt generator (G2PG) shared across different layers, which applies shared geometric constraints to the output gates of the Mamba and dynamically optimizes the spatial order, thus enabling more effective integration of multi-layer information. Extensive experiments conducted on challenging point cloud datasets across various tasks demonstrate that our PMA elevates the capability for point cloud understanding to a new level by fusing diverse complementary intermediate features. Code is available at https://github.com/zyh16143998882/PMA.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 55 of its 64 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

55 of 64 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling27 May
  2. 2024Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model23 Apr

Other references · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  6. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  9. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  10. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  11. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  12. 2022Visual Prompt Tuningcited by 1,674
38 more
  1. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  2. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  3. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  4. 2024VMamba: Visual State Space Modelcited by 955
  5. 2022Simplified State Space Layers for Sequence Modelingcited by 776
  6. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  7. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
  8. 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 657
  9. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  10. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
  11. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  12. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  13. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  14. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
  15. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
  16. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  17. 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 376
  18. 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classificationcited by 355
  19. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
  20. 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
  21. 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
  22. 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
  23. 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 179
  24. 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
  25. 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
  26. 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
  27. 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
  28. 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
  29. 2024Demystify Mamba in Vision: A Linear Attention Perspectivecited by 101
  30. 2024MambaIRv2: Attentive State Space Restorationcited by 90
  31. 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Promptingcited by 74
  32. 2023Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Modelscited by 67
  33. 2024Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysiscited by 52
  34. 2023Point Cloud Pre-training with Diffusion Modelscited by 47
  35. 2023Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancycited by 44
  36. 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
  37. 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
  38. 2024Parameter-efficient Prompt Learning for 3D Point Cloud Understandingcited by 16

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Point Cloud Mamba: Point Cloud Learning via State Space Model
  2. 2025PointLAMA: Latent Attention meets Mamba for Efficient Point Cloud Pretraining
  3. 2024Exploring contextual modeling with linear complexity for point cloud segmentation
  4. 2025DM3D: Dynamic Mamba via Offset-Guided Feature Resampling for Point Cloud Understanding
  5. 2024PointMamba: A Simple State Space Model for Point Cloud Analysis
  6. 2025MambaTron: Efficient Cross-Modal Point Cloud Enhancement using Aggregate Selective State Space Modeling
  7. 2024PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis
  8. 2025DAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion