mlsanityData to 14 Oct 2026

VMamba: Visual State Space Model

arXiv 2401.10166 ↗First posted 18 Jan 2024cs.CVcited by 969

Not on the map. Why?

Cited by 522 in State-space sequence models (S4, Mamba), but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Designing computationally efficient network architectures remains an ongoing necessity in computer vision. In this paper, we adapt Mamba, a state-space language model, into VMamba, a vision backbone with linear time complexity. At the core of VMamba is a stack of Visual State-Space (VSS) blocks with the 2D Selective Scan (SS2D) module. By traversing along four scanning routes, SS2D bridges the gap between the ordered nature of 1D selective scan and the non-sequential structure of 2D vision data, which facilitates the collection of contextual information from various sources and perspectives. Based on the VSS blocks, we develop a family of VMamba architectures and accelerate them through a succession of architectural and implementation enhancements. Extensive experiments demonstrate VMamba's promising performance across diverse visual perception tasks, highlighting its superior input scaling efficiency compared to existing benchmark models. Source code is available at https://github.com/MzeroMiko/VMamba.

Key facts. Cited by 969 papers in the map (data through 14 Oct 2026). Builds on 69 of its 91 references that are in the map. First posted on arXiv 18 Jan 2024.

Builds on

69 of 91 references.

References · 69

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  7. 2017Mask R-CNNcited by 7,277
  8. 2016Densely Connected Convolutional Networkscited by 6,720
  9. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  10. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  11. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  12. 2014Going Deeper with Convolutionscited by 4,241
38 more
  1. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  3. 2022A ConvNet for the 2020scited by 3,579
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  5. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  7. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  8. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  9. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  10. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  11. 2020GLU Variants Improve Transformercited by 1,804
  12. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
  13. 2017Deformable Convolutional Networkscited by 1,488
  14. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  15. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  16. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  17. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  18. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  19. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
  20. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  21. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  22. 2020Designing Network Design Spacescited by 960
  23. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  24. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  25. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  26. 2020Efficient Transformers: A Surveycited by 790
  27. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  28. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
  29. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
  30. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
  31. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  32. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  33. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
  34. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
  35. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 527
  36. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
  37. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
  38. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 336; 2025: 349; 2026: 284.

969 papers.

Sort:

By area:

  1. 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 425
  2. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  3. 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
  4. 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
  5. 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 287
  6. 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
  7. 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
  8. 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
  9. 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
  10. 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 179
  11. 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
  12. 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
38 more
  1. 2024MambaOut: Do We Really Need Mamba for Vision?cited by 143
  2. 2024PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognitioncited by 141
  3. 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spacescited by 134
  4. 2024Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentationcited by 133
  5. 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 120
  6. 2024MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detectioncited by 113
  7. 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 112
  8. 2024Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understandingcited by 108
  9. 2024Demystify Mamba in Vision: A Linear Attention Perspectivecited by 102
  10. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 102
  11. 2024Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architecturescited by 98
  12. 2024RSMamba: Remote Sensing Image Classification with State Space Modelcited by 95
  13. 2024VL-Mamba: Exploring State Space Models for Multimodal Learningcited by 93
  14. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
  15. 2024The Hidden Attention of Mamba Modelscited by 91
  16. 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
  17. 2024MedMamba: Vision Mamba for Medical Image Classificationcited by 88
  18. 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 86
  19. 2024Mamba-ND: Selective State Space Modeling for Multi-Dimensional Datacited by 84
  20. 2024ZigMa: A DiT-style Zigzag Mamba Diffusion Modelcited by 84
  21. 2024SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time seriescited by 82
  22. 2024RS-Mamba for Large Remote Sensing Image Dense Predictioncited by 81
  23. 2024FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mambacited by 81
  24. 2024Pan-Mamba: Effective pan-sharpening with State Space Modelcited by 73
  25. 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategycited by 73
  26. 2024DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesiscited by 72
  27. 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentationcited by 71
  28. 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
  29. 2024Point Cloud Mamba: Point Cloud Learning via State Space Modelcited by 66
  30. 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detectioncited by 66
  31. 2024Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challengescited by 64
  32. 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Modelcited by 62
  33. 2024MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detectioncited by 60
  34. 2024State Space Model for New-Generation Network Alternative to Transformers: A Surveycited by 59
  35. 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
  36. 2024LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentationcited by 54
  37. 2024Vision Mamba: A Comprehensive Survey and Taxonomycited by 54
  38. 2024Vivim: a Video Vision Mamba for Medical Video Segmentationcited by 52

50 most cited of 969 All 969 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Visual Mamba: A Survey and New Outlooks
  2. 2024MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mamba
  3. 2026Spatial-Aware Reduction Framework: Towards Efficient and Faithful Visual State Space Models
  4. 2024A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion
  5. 20242DMamba: Efficient State Space Model for Image Representation with Applications on Giga-Pixel Whole Slide Image Classification
  6. 2024ZeroMamba: Exploring Visual State Space Model for Zero-Shot Learning