SM3D: Mitigating Spectral Bias and Semantic Dilution in Point Cloud State Space Models
Not on the map. Why?
Abstract (arXiv)
Point clouds are a fundamental 3D data representation that underpins various computer vision tasks. Recently, Mamba has demonstrated strong potential for 3D point cloud understanding. However, existing approaches primarily focus on point serialization, overlooking a more fundamental limitation: State Space Models (SSMs) inherently exhibit a spectral low-pass bias arising from their recursive formulation. In serialized point clouds, this bias is particularly detrimental, as it suppresses high-frequency geometric structures and progressively dilutes semantic discriminability across deep layers. To address these limitations, we propose SM3D, a spectral-aware framework designed to jointly preserve geometric fidelity and semantic consistency. First, a Geometric Spectral Compensator (GSC) is introduced to counteract the low-pass bias by explicitly injecting graph-guided high-frequency components through local Laplacian analysis, thereby restoring structural sensitivity. Second, we design a Semantic Coherence Refiner (SCR) to rectify semantic drift through frequency-aware channel recalibration. To balance theoretical precision and computational efficiency, SCR is instantiated via two pathways: an exact Laplacian eigendecomposition (SCR-L) and a linear-complexity Chebyshev polynomial approximation (SCR-C). Extensive experiments demonstrate that SM3D achieves state-of-the-art performance, including 96.0% accuracy on ModelNet40 and 86.5% mIoU on ShapeNetPart, validating its effectiveness in mitigating spectral low-pass bias and semantic dilution (Code: https://github.com/L1277471578/SM3D).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 16 May 2025.
Builds on
41 of 54 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
29 more
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 413
- 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
- 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 113
- 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
- 2023FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformercited by 73
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Modelcited by 66
- 2024Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Modelcited by 57
- 2021PatchFormer: An Efficient Point Transformer with Patch Attentioncited by 43
- 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
- 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
- 2023Self-positioning Point-based Transformer for Point Cloud Understandingcited by 40
- 2023Attention-based Point Cloud Edge Samplingcited by 37
- 2024PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysiscited by 26
- 2023Point Cloud Classification Using Content-based Transformer via Clustering in Feature Spacecited by 19
- 2019Spectral-GANs for High-Resolution 3D Point-cloud Generationcited by 17
- 2025Spectral Informed Mamba for Robust Point Cloud Processingcited by 10
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
- 2023PointWavelet: Learning in Spectral Domain for 3D Point Cloud Analysiscited by 7
- 2024Deep Learning-based Point Cloud Registration for Augmented Reality-guided Surgerycited by 6
- 2024Sequential Order-Robust Mamba for Time Series Forecastingcited by 5
- 2024XYScanNet: A State Space Model for Single Image Deblurringcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20243DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering
- 2023Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understanding
- 2025StruMamba3D: Exploring Structural Mamba for Self-supervised Point Cloud Representation Learning
- 2025Sonata: Self-Supervised Learning of Reliable Point Representations
- 2025DM3D: Dynamic Mamba via Offset-Guided Feature Resampling for Point Cloud Understanding
- 2024Pamba: Enhancing Global Interaction in Point Clouds via State Space Model
- 2024Exploring contextual modeling with linear complexity for point cloud segmentation
- 2025ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding