mlsanityData to 14 Oct 2026

A Survey on Visual Mamba

arXiv 2404.15956 ↗First posted 24 Apr 2024cs.CVcited by 50

On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones

Abstract (arXiv)

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic complexity with image size and increasing computational demands, the researchers are now exploring how to adapt Mamba for computer vision tasks. This paper is the first comprehensive survey aiming to provide an in-depth analysis of Mamba models in the field of computer vision. It begins by exploring the foundational concepts contributing to Mamba's success, including the state space model framework, selection mechanisms, and hardware-aware design. Next, we review these vision mamba models by categorizing them into foundational ones and enhancing them with techniques such as convolution, recurrence, and attention to improve their sophistication. We further delve into the widespread applications of Mamba in vision tasks, which include their use as a backbone in various levels of vision processing. This encompasses general visual tasks, Medical visual tasks (e.g., 2D / 3D segmentation, classification, and image registration, etc.), and Remote Sensing visual tasks. We specially introduce general visual tasks from two levels: High/Mid-level vision (e.g., Object detection, Segmentation, Video classification, etc.) and Low-level vision (e.g., Image super-resolution, Image restoration, Visual generation, etc.). We hope this endeavor will spark additional interest within the community to address current challenges and further apply Mamba models in computer vision.

Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 88 of its 101 references that are in the map. First posted on arXiv 24 Apr 2024.

Builds on

88 of 101 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation5 Apr
  2. 2024ReMamber: Referring Image Segmentation with Mamba Twister26 Mar
  3. 2024PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition26 Mar
  4. 2024SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series22 Mar
  5. 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference21 Mar
  6. 2024VL-Mamba: Exploring State Space Models for Multimodal Learning20 Mar
  7. 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba15 Mar
  8. 2024LocalMamba: Visual State Space Model with Windowed Selective Scan14 Mar
  9. 2024Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with Deep Residual Learning24 Feb
  10. 2024Pan-Mamba: Effective pan-sharpening with State Space Model19 Feb
  11. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model17 Jan

Other references · 77

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  7. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  8. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  9. 2024VMamba: Visual State Space Modelcited by 969
  10. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  11. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
  12. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
38 more
  1. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
  2. 2024Jamba: A Hybrid Transformer-Mamba Language Modelcited by 401
  3. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  4. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  5. 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
  6. 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 287
  7. 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
  8. 2016A Decomposable Attention Model for Natural Language Inferencecited by 215
  9. 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
  10. 2017Searching for Activation Functionscited by 169
  11. 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
  12. 2024Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentationcited by 133
  13. 2021CKConv: Continuous Kernel Convolution For Sequential Datacited by 120
  14. 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 120
  15. 2021An Attention Free Transformercited by 112
  16. 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
  17. 2024Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understandingcited by 108
  18. 2022Long Movie Clip Classification with State-Space Video Modelscited by 106
  19. 2024RSMamba: Remote Sensing Image Classification with State Space Modelcited by 95
  20. 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
  21. 2024MedMamba: Vision Mamba for Medical Image Classificationcited by 88
  22. 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 88
  23. 2024Mamba-ND: Selective State Space Modeling for Multi-Dimensional Datacited by 84
  24. 2024RS-Mamba for Large Remote Sensing Image Dense Predictioncited by 81
  25. 2024State Space Models for Event Camerascited by 75
  26. 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategycited by 73
  27. 2024MoE-Mamba: Efficient Selective State Space Models with Mixture of Expertscited by 60
  28. 2024MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detectioncited by 60
  29. 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
  30. 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
  31. 2018Can recurrent neural networks warp time?cited by 55
  32. 2024LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentationcited by 54
  33. 2024Vivim: a Video Vision Mamba for Medical Video Segmentationcited by 52
  34. 2024MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Modelscited by 46
  35. 2024nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with State Space Modelcited by 45
  36. 2024Scalable Diffusion Models with State Space Backbonecited by 45
  37. 2024UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentationcited by 45
  38. 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 23; 2025: 21; 2026: 6.

50 papers.

Sort:

By area:

  1. 2024MambaOut: Do We Really Need Mamba for Vision?cited by 143
  2. 2024Vision Mamba: A Comprehensive Survey and Taxonomycited by 54
  3. 2024A Survey of Mambacited by 39
  4. 2024Matten: Video Generation with Mamba-Attentioncited by 24
  5. 2024Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Studycited by 24
  6. 2024Serp-Mamba: Advancing High-Resolution Retinal Vessel Segmentation with Selective State-Space Modelcited by 20
  7. 2024Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classificationcited by 18
  8. 2024LLEMamba: Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Networkcited by 14
  9. 2024IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Modelcited by 13
  10. 2024Scalable Visual State Space Model with Fractal Scanningcited by 11
  11. 2024Snakes and Ladders: Two Steps Up for VideoMambacited by 10
  12. 2024Multi-head Spatial-Spectral Mamba for Hyperspectral Image Classificationcited by 10
38 more
  1. 2025Advancing Intelligent Sequence Modeling: Evolution, Trade-offs, and Applications of State-Space Architectures from S4 to Mambacited by 9
  2. 2025Learning Phase Distortion with Selective State Space Models for Video Turbulence Mitigationcited by 9
  3. 2025A Survey on Mamba Architecture for Vision Applicationscited by 8
  4. 2025Block-Biased Mamba for Long-Range Sequence Processingcited by 8
  5. 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamicscited by 7
  6. 2025TransMamba: A Sequence-Level Hybrid Transformer-Mamba Language Modelcited by 7
  7. 2024MambaST: A Plug-and-Play Cross-Spectral Spatial-Temporal Fuser for Efficient Pedestrian Detectioncited by 6
  8. 2024A Survey of RWKVcited by 6
  9. 2025Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlookcited by 6
  10. 2024UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Imagescited by 5
  11. 2024TRecViT: A Recurrent Video Transformercited by 5
  12. 2024CAMS: Convolution and Attention-Free Mamba-based Cardiac Image Segmentationcited by 4
  13. 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Trackingcited by 4
  14. 2025Mamba-CNN: A Hybrid Architecture for Efficient and Accurate Facial Beauty Predictioncited by 4
  15. 2025HiFi-Mamba: Dual-Stream W-Laplacian Enhanced Mamba for High-Fidelity MRI Reconstructioncited by 3
  16. 2025EDMB: Edge Detector with Mambacited by 2
  17. 2025MambaFlow: A Mamba-Centric Architecture for End-to-End Optical Flow Estimationcited by 2
  18. 2025MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsycited by 2
  19. 2025Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Trackingcited by 2
  20. 2024EDCSSM: Edge Detection with Convolutional State Space Modelcited by 1
  21. 2024MamKPD: A Simple Mamba Baseline for Real-Time 2D Keypoint Detectioncited by 1
  22. 2025DRDT3: Diffusion-Refined Decision Test-Time Training Modelcited by 1
  23. 2025BS-Mamba for Black-Soil Area Detection On the Qinghai-Tibetan Plateaucited by 1
  24. 2025Mamba-Based Ensemble learning for White Blood Cell Classificationcited by 1
  25. 2025Deep Learning for Crack Detection: A Review of Learning Paradigms, Generalizability, and Datasetscited by 1
  26. 2025PerfMamba: Performance Analysis and Pruning of Selective State Space Modelscited by 1
  27. 2026Partial Ring Scan: Revisiting Scan Order in Vision State Space Modelscited by 1
  28. 2024Taming Mambas for Voxel Level 3D Medical Image Segmentationcited by 0
  29. 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentationcited by 0
  30. 2025Medical Image Segmentation Using Advanced Unet: VMSE-Unet and VM-Unet CBAM+cited by 0
  31. 2025MVNet: Hyperspectral Remote Sensing Image Classification Based on Hybrid Mamba-Transformer Vision Backbone Architecturecited by 0
  32. 2025HSNet: Heterogeneous Subgraph Network for Single Image Super-resolutioncited by 0
  33. 2025MambaEye: A Size-Agnostic Visual Encoder with Causal Sequential Processingcited by 0
  34. 2026Fluxamba: Topology-Aware Anisotropic State Space Models for Geological Lineament Segmentation in Multi-Source Remote Sensingcited by 0
  35. 2026DMS2F-HAD: A Dual-branch Mamba-based Spatial-Spectral Fusion Network for Hyperspectral Anomaly Detectioncited by 0
  36. 2026Beyond ZOH: Advanced Discretization Strategies for Vision Mambacited by 0
  37. 2026U2Mamba: A Two-level Nested U-structure Mamba for Salient Object Detectioncited by 0
  38. 2026State Space Models Meet Remote Sensing: A Surveycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Visual Mamba: A Survey and New Outlooks
  2. 2024Mamba in Vision: A Comprehensive Survey of Techniques and Applications
  3. 2024Demystify Mamba in Vision: A Linear Attention Perspective
  4. 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model
  5. 2024Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis
  6. 2026SF-Mamba: Rethinking State Space Model for Vision
  7. 2026MFil-Mamba: Multi-Filter Scanning for Spatial Redundancy-Aware Visual State Space Models
  8. 2025Fast Vision Mamba: Pooling Spatial Dimensions for Accelerated Processing