mlsanityData to 14 Oct 2026

SM3D: Mitigating Spectral Bias and Semantic Dilution in Point Cloud State Space Models

arXiv 2505.11099 ↗First posted 16 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Point clouds are a fundamental 3D data representation that underpins various computer vision tasks. Recently, Mamba has demonstrated strong potential for 3D point cloud understanding. However, existing approaches primarily focus on point serialization, overlooking a more fundamental limitation: State Space Models (SSMs) inherently exhibit a spectral low-pass bias arising from their recursive formulation. In serialized point clouds, this bias is particularly detrimental, as it suppresses high-frequency geometric structures and progressively dilutes semantic discriminability across deep layers. To address these limitations, we propose SM3D, a spectral-aware framework designed to jointly preserve geometric fidelity and semantic consistency. First, a Geometric Spectral Compensator (GSC) is introduced to counteract the low-pass bias by explicitly injecting graph-guided high-frequency components through local Laplacian analysis, thereby restoring structural sensitivity. Second, we design a Semantic Coherence Refiner (SCR) to rectify semantic drift through frequency-aware channel recalibration. To balance theoretical precision and computational efficiency, SCR is instantiated via two pathways: an exact Laplacian eigendecomposition (SCR-L) and a linear-complexity Chebyshev polynomial approximation (SCR-C). Extensive experiments demonstrate that SM3D achieves state-of-the-art performance, including 96.0% accuracy on ModelNet40 and 86.5% mIoU on ShapeNetPart, validating its effectiveness in mitigating spectral low-pass bias and semantic dilution (Code: https://github.com/L1277471578/SM3D).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

41 of 54 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  7. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  8. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  9. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
  10. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  11. 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
  12. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
29 more
  1. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
  2. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
  3. 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 413
  4. 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
  5. 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
  6. 2020Unsupervised Point Cloud Pre-Training via Occlusion Completioncited by 186
  7. 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
  8. 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
  9. 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
  10. 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
  11. 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 113
  12. 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
  13. 2023FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformercited by 73
  14. 2024Point Cloud Mamba: Point Cloud Learning via State Space Modelcited by 66
  15. 2024Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Modelcited by 57
  16. 2021PatchFormer: An Efficient Point Transformer with Patch Attentioncited by 43
  17. 2024Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learningcited by 43
  18. 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
  19. 2023Self-positioning Point-based Transformer for Point Cloud Understandingcited by 40
  20. 2023Attention-based Point Cloud Edge Samplingcited by 37
  21. 2024PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysiscited by 26
  22. 2023Point Cloud Classification Using Content-based Transformer via Clustering in Feature Spacecited by 19
  23. 2019Spectral-GANs for High-Resolution 3D Point-cloud Generationcited by 17
  24. 2025Spectral Informed Mamba for Robust Point Cloud Processingcited by 10
  25. 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
  26. 2023PointWavelet: Learning in Spectral Domain for 3D Point Cloud Analysiscited by 7
  27. 2024Deep Learning-based Point Cloud Registration for Augmented Reality-guided Surgerycited by 6
  28. 2024Sequential Order-Robust Mamba for Time Series Forecastingcited by 5
  29. 2024XYScanNet: A State Space Model for Single Image Deblurringcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 20243DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering
  2. 2023Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understanding
  3. 2025StruMamba3D: Exploring Structural Mamba for Self-supervised Point Cloud Representation Learning
  4. 2025Sonata: Self-Supervised Learning of Reliable Point Representations
  5. 2025DM3D: Dynamic Mamba via Offset-Guided Feature Resampling for Point Cloud Understanding
  6. 2024Pamba: Enhancing Global Interaction in Point Clouds via State Space Model
  7. 2024Exploring contextual modeling with linear complexity for point cloud segmentation
  8. 2025ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding