Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models
On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing
Abstract (arXiv)
Pre-trained 3D point cloud foundation models (PFMs) have demonstrated strong transferability across diverse downstream tasks. However, full fine-tuning these models is computationally expensive and storage-intensive. Parameter-efficient fine-tuning (PEFT) offers a promising alternative, but existing PEFT approaches are primarily designed for Transformer-based backbones and rely on token-level prompting or feature transformation. Mamba-based backbones introduce a granularity mismatch between token-level adaptation and state-level sequence dynamics. Consequently, straightforward transfer of existing PEFT approaches to frozen Mamba backbones leads to substantial accuracy degradation and unstable optimization. To address this issue, we propose Mantis, the first Mamba-native PEFT framework for 3D PFMs. Specifically, a State-Aware Adapter (SAA) is introduced to inject lightweight task-conditioned control signals into selective state-space updates, enabling state-level adaptation while keeping the pre-trained backbone frozen. Moreover, different valid point cloud serializations are regularized by Dual-Serialization Consistency Distillation (DSCD), thereby reducing serialization-induced instability. Extensive experiments across multiple benchmarks demonstrate that Mantis achieves competitive performance while training less than 5% of the backbone parameters.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 52 of its 66 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
52 of 66 references.
Closest ancestors · 9
Same direction, newest first
- 2025CloudMamba: Grouped Selective State Spaces for Point Cloud Analysis11 Nov
- 2025HydraMamba: Multi-Head State Space Model for Global Point Cloud Learning26 Jul
- 2025StruMamba3D: Exploring Structural Mamba for Self-supervised Point Cloud Representation Learning26 Jun
- 2025ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding27 May
- 2025PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter27 May
- 2025Spectral Informed Mamba for Robust Point Cloud Processing6 Mar
- 2024Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model23 Apr
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Model1 Mar
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysis16 Feb
Other references · 43
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2022Visual Prompt Tuningcited by 1,674
- 2020Point Transformercited by 1,462
31 more
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
- 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2023Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Modelscited by 67
- 2023Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-trainingcited by 52
- 2024Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysiscited by 52
- 2023Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancycited by 44
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
- 2023Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Modelscited by 42
- 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
- 2026PointCoT: A Multi-modal Benchmark for Explicit 3D Geometric Reasoningcited by 19
- 2026Align then Adapt: Rethinking Parameter-Efficient Transfer Learning in 4D Perceptioncited by 17
- 2025PointLoRA: Low-Rank Adaptation with Token Selection for Point Cloud Learningcited by 13
- 2025GAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Modelcited by 13
- 2025PointDico: Contrastive 3D Representation Learning Guided by Diffusion Modelscited by 11
- 2026PointRFT: Explicit Reinforcement Fine-tuning for Point Cloud Few-shot Learningcited by 10
- 2025MoST: Efficient Monarch Sparse Tuning for 3D Representation Learningcited by 6
- 2024Parameter Efficient Mamba Tuning via Projector-targeted Diagonal-centric Linear Transformationcited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Tri-Efficient Transfer Learning for Point Cloud Videoscited by 5
- 2026GaussFusion: Towards Multimodal 3D Gaussian Pretrainingcited by 2
- 2026Parameter-Efficient Fine-Tuning for Spiking Point Cloud Modelscited by 2
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstructioncited by 0
- 2026Motion-Saliency Complementary Masked Modeling for Point Cloud Video Understandingcited by 0
- 2026Partition-Invariant Tuning for 3D Scene Understandingcited by 0
- 2026Partition-Invariant Tuning for 3D Scene Understanding11 Sep 2026
- 2026Motion-Saliency Complementary Masked Modeling for Point Cloud Video Understanding31 Aug 2026
- 2026Parameter-Efficient Fine-Tuning for Spiking Point Cloud Models31 Jul 2026
- 2026GaussFusion: Towards Multimodal 3D Gaussian Pretraining7 Jul 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026Tri-Efficient Transfer Learning for Point Cloud Videos23 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025DM3D: Dynamic Mamba via Offset-Guided Feature Resampling for Point Cloud Understanding
- 2025DAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion
- 2025TFDM: Time-Variant Frequency-Based Point Cloud Diffusion with Mamba
- 2025PointLAMA: Latent Attention meets Mamba for Efficient Point Cloud Pretraining
- 2024NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMs
- 2025MambaTron: Efficient Cross-Modal Point Cloud Enhancement using Aggregate Selective State Space Modeling
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding
- 2024Parameter-efficient Prompt Learning for 3D Point Cloud Understanding