Surface Vision Mamba: Leveraging Bidirectional State Space Model for Efficient Spherical Manifold Representation
On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones
Abstract (arXiv)
Attention-based methods have demonstrated exceptional performance in modelling long-range dependencies on spherical cortical surfaces, surpassing traditional Geometric Deep Learning (GDL) models. However, their extensive inference time and high memory demands pose challenges for application to large datasets with limited computing resources. Inspired by the state space model in computer vision, we introduce the attention-free Vision Mamba (Vim) to spherical surfaces, presenting a domain-agnostic architecture for analyzing data on spherical manifolds. Our method achieves surface patching by representing spherical data as a sequence of triangular patches derived from a subdivided icosphere. The proposed Surface Vision Mamba (SiM) is evaluated on multiple neurodevelopmental phenotype regression tasks using cortical surface metrics from neonatal brains. Experimental results demonstrate that SiM outperforms both attention- and GDL-based methods, delivering 4.8 times faster inference and achieving 91.7% lower memory consumption compared to the Surface Vision Transformer (SiT) under the Ico-4 grid partitioning. Sensitivity analysis further underscores the potential of SiM to identify subtle cognitive developmental patterns. The code is available at https://github.com/Rongzhao-He/surface-vision-mamba.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 29 of its 38 references that are in the map. First posted on arXiv 24 Jan 2025.
Builds on
29 of 38 references.
Closest ancestors · 4
Same direction, newest first
- 2024Autoregressive Pretraining with Mamba in Vision11 Jun
- 2024Demystify Mamba in Vision: A Linear Attention Perspective26 May
- 2024MambaOut: Do We Really Need Mamba for Vision?13 May
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model17 Jan
Other references · 25
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
13 more
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2024VMamba: Visual State Space Modelcited by 969
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2018Spherical CNNscited by 456
- 2022Vision GNN: An Image is Worth Graph of Nodescited by 186
- 2019Blockwise Self-Attention for Long Document Understandingcited by 159
- 2023Agent Attention: On the Integration of Softmax and Linear Attentioncited by 90
- 2023HyperAttention: Long-context Attention in Near-Linear Timecited by 85
- 2019Spherical U-Net on Cortical Surfaces: Methods and Applicationscited by 34
- 2022Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysiscited by 25
- 2020Geometric Deep Learning for Post-Menstrual Age Prediction based on the Neonatal White Matter Cortical Surfacecited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Visual Attention Exploration in Vision-Based Mamba Models
- 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion
- 2024A Survey on Visual Mamba
- 2025Mamba-Adaptor: State Space Model Adaptor for Visual Recognition
- 2025MambaH-Fit: Rethinking Hyper-surface Fitting-based Point Cloud Normal Estimation via State Space Modelling
- 2026NeuroMamba: Multi-Perspective Feature Interaction with Visual Mamba for Neuron Segmentation
- 2025X-VMamba: Explainable Vision Mamba
- 2024Vision Mamba: Cutting-Edge Classification of Alzheimer's Disease with 3D MRI Scans