PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter
On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing
Abstract (arXiv)
Applying pre-trained models to assist point cloud understanding has recently become a mainstream paradigm in 3D perception. However, existing application strategies are straightforward, utilizing only the final output of the pre-trained model for various task heads. It neglects the rich complementary information in the intermediate layer, thereby failing to fully unlock the potential of pre-trained models. To overcome this limitation, we propose an orthogonal solution: Point Mamba Adapter (PMA), which constructs an ordered feature sequence from all layers of the pre-trained model and leverages Mamba to fuse all complementary semantics, thereby promoting comprehensive point cloud understanding. Constructing this ordered sequence is non-trivial due to the inherent isotropy of 3D space. Therefore, we further propose a geometry-constrained gate prompt generator (G2PG) shared across different layers, which applies shared geometric constraints to the output gates of the Mamba and dynamically optimizes the spatial order, thus enabling more effective integration of multi-layer information. Extensive experiments conducted on challenging point cloud datasets across various tasks demonstrate that our PMA elevates the capability for point cloud understanding to a new level by fusing diverse complementary intermediate features. Code is available at https://github.com/zyh16143998882/PMA.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 55 of its 64 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
55 of 64 references.
Closest ancestors · 2
Same direction, newest first
- 2024LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling27 May
- 2024Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model23 Apr
Other references · 53
- 2017Attention Is All You Needcited by 59,932
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2022Visual Prompt Tuningcited by 1,674
38 more
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2024VMamba: Visual State Space Modelcited by 955
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
- 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 657
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 376
- 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classificationcited by 355
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
- 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
- 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 179
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
- 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
- 2024Demystify Mamba in Vision: A Linear Attention Perspectivecited by 101
- 2024MambaIRv2: Attentive State Space Restorationcited by 90
- 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Promptingcited by 74
- 2023Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Modelscited by 67
- 2024Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysiscited by 52
- 2023Point Cloud Pre-training with Diffusion Modelscited by 47
- 2023Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancycited by 44
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
- 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
- 2024Parameter-efficient Prompt Learning for 3D Point Cloud Understandingcited by 16
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Modelscited by 6
- 2026Tri-Efficient Transfer Learning for Point Cloud Videoscited by 5
- 2025CloudMamba: Grouped Selective State Spaces for Point Cloud Analysiscited by 3
- 2026PointTPA: Dynamic Network Parameter Adaptation for 3D Scene Understandingcited by 2
- 2026TowerDataset: A Heterogeneous Benchmark for Transmission Corridor Segmentation with a Global-Local Fusion Frameworkcited by 0
- 2026Aerial-ground LiDAR place recognition with patch-level self-supervised learning and expanded reciprocal re-rankingcited by 0
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understandingcited by 0
- 2026Position Anchor Tuning: Towards Efficient Adaptation of Pre-Trained Point Cloud Transformerscited by 0
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Modelcited by 0
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model17 Sep 2026
- 2026Position Anchor Tuning: Towards Efficient Adaptation of Pre-Trained Point Cloud Transformers16 Sep 2026
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understanding21 Jul 2026
- 2026Tri-Efficient Transfer Learning for Point Cloud Videos23 Jun 2026
- 2026Aerial-ground LiDAR place recognition with patch-level self-supervised learning and expanded reciprocal re-ranking17 Jun 2026
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models5 May 2026
- 2026TowerDataset: A Heterogeneous Benchmark for Transmission Corridor Segmentation with a Global-Local Fusion Framework18 Apr 2026
- 2026PointTPA: Dynamic Network Parameter Adaptation for 3D Scene Understanding6 Apr 2026
- 2025CloudMamba: Grouped Selective State Spaces for Point Cloud Analysis11 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Model
- 2025PointLAMA: Latent Attention meets Mamba for Efficient Point Cloud Pretraining
- 2024Exploring contextual modeling with linear complexity for point cloud segmentation
- 2025DM3D: Dynamic Mamba via Offset-Guided Feature Resampling for Point Cloud Understanding
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysis
- 2025MambaTron: Efficient Cross-Modal Point Cloud Enhancement using Aggregate Selective State Space Modeling
- 2024PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis
- 2025DAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion