A Survey on Mamba Architecture for Vision Applications
On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones
Abstract (arXiv)
Transformers have become foundational for visual tasks such as object detection, semantic segmentation, and video understanding, but their quadratic complexity in attention mechanisms presents scalability challenges. To address these limitations, the Mamba architecture utilizes state-space models (SSMs) for linear scalability, efficient processing, and improved contextual awareness. This paper investigates Mamba architecture for visual domain applications and its recent advancements, including Vision Mamba (ViM) and VideoMamba, which introduce bidirectional scanning, selective scanning mechanisms, and spatiotemporal processing to enhance image and video understanding. Architectural innovations like position embeddings, cross-scan modules, and hierarchical designs further optimize the Mamba framework for global and local feature extraction. These advancements position Mamba as a promising architecture in computer vision research and applications.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 58 of its 69 references that are in the map. First posted on arXiv 11 Feb 2025.
Builds on
58 of 69 references.
Closest ancestors · 12
Same direction, newest first
- 2024Mamba2D: A Natively Multi-Dimensional State-Space Model for Vision Tasks20 Dec
- 2024EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality22 Nov
- 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion19 Oct
- 2024Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolution14 Oct
- 2024Famba-V: Fast Vision Mamba with Cross-Layer Token Fusion15 Sep
- 2024Neural Architecture Search based Global-local Vision Mamba for Palm-Vein Recognition11 Aug
- 2024VSSD: Vision Mamba with Non-Causal State Space Duality26 Jul
- 2024Mamba-R: Vision Mamba ALSO Needs Registers23 May
- 2024A Survey on Visual Mamba24 Apr
- 2024PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition26 Mar
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scan14 Mar
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model17 Jan
Other references · 46
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Mask R-CNNcited by 7,277
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021ViViT: A Video Vision Transformercited by 1,620
34 more
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
- 2022Token Merging: Your ViT But Fastercited by 1,021
- 2024VMamba: Visual State Space Modelcited by 969
- 2018Object Detection with Deep Learning: A Reviewcited by 528
- 2021XCiT: Cross-Covariance Image Transformerscited by 338
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
- 2024Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understandingcited by 108
- 2024MedMamba: Vision Mamba for Medical Image Classificationcited by 88
- 2022What Makes Convolutional Models Great on Long Sequence Modeling?cited by 87
- 2023Towards Accurate Post-Training Quantization for Vision Transformercited by 71
- 2024Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challengescited by 64
- 2023PuMer: Pruning and Merging Tokens for Efficient Vision Language Modelscited by 53
- 2024A Survey of Mambacited by 39
- 2024A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyondcited by 16
- 2024Depth-Wise Convolutions in Vision Transformers for Efficient Training on Small Datasetscited by 14
- 2023Edge-aware Multi-task Network for Integrating Quantification Segmentation and Uncertainty Prediction of Liver Tumor on Multi-modality Non-contrast MRIcited by 9
- 2020Time-aware Large Kernel Convolutionscited by 8
- 2024Shuffle Mamba: State Space Models with Random Shuffle for Multi-Modal Image Fusioncited by 7
- 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detectioncited by 6
- 2024FlowMamba: Learning Point Cloud Scene Flow with Global Motion Propagationcited by 5
- 2023Aphid Cluster Recognition and Detection in the Wild Using Deep Learning Modelscited by 4
- 2024Serialized Point Mamba: A Serialized Point Cloud Mamba Segmentation Modelcited by 4
- 2024MambaBEV: An EV-based 3D detection model with Mamba2cited by 4
- 2024A New Dataset and Comparative Study for Aphid Cluster Detection and Segmentation in Sorghum Fieldscited by 3
- 2024NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMscited by 3
- 2024MambaDETR: Query-based Temporal Modeling using State Space Model for Multi-View 3D Object Detectioncited by 3
- 2024MambaU-Lite: A Lightweight Model based on Mamba and Integrated Channel-Spatial Attention for Skin Lesion Segmentationcited by 2
- 2025MS-Temba: Multi-Scale Temporal Mamba for Understanding Long Untrimmed Videoscited by 2
- 2025MambaTron: Efficient Cross-Modal Point Cloud Enhancement using Aggregate Selective State Space Modelingcited by 2
- 2024Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mambacited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 3.
8 papers.
- 2025DRBD-Mamba for Robust and Efficient Brain Tumor Segmentation with Analytical Insightscited by 3
- 2025Mamba-Based Ensemble learning for White Blood Cell Classificationcited by 1
- 2025UNet with Self-Adaptive Mamba-Like Attention and Causal-Resonance Learning for Medical Image Segmentationcited by 1
- 2025Vision-Proprioception Fusion with Mamba2 in End-to-End Reinforcement Learning for Motion Controlcited by 0
- 2025MambaEye: A Size-Agnostic Visual Encoder with Causal Sequential Processingcited by 0
- 2026Beyond ZOH: Advanced Discretization Strategies for Vision Mambacited by 0
- 2026ViM-Q: Scalable Algorithm-Hardware Co-Design for Vision Mamba Model Inference on FPGAcited by 0
- 2026Following Motion for Sequential Modeling in Video Frame Interpolationcited by 0
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation24 Aug 2026
- 2026ViM-Q: Scalable Algorithm-Hardware Co-Design for Vision Mamba Model Inference on FPGA3 May 2026
- 2026Beyond ZOH: Advanced Discretization Strategies for Vision Mamba22 Apr 2026
- 2025MambaEye: A Size-Agnostic Visual Encoder with Causal Sequential Processing25 Nov 2025
- 2025DRBD-Mamba for Robust and Efficient Brain Tumor Segmentation with Analytical Insights16 Oct 2025
- 2025Vision-Proprioception Fusion with Mamba2 in End-to-End Reinforcement Learning for Motion Control9 Sep 2025
- 2025UNet with Self-Adaptive Mamba-Like Attention and Causal-Resonance Learning for Medical Image Segmentation21 May 2025
- 2025Mamba-Based Ensemble learning for White Blood Cell Classification15 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024Visual Mamba: A Survey and New Outlooks
- 2026SF-Mamba: Rethinking State Space Model for Vision
- 2024Mamba in Vision: A Comprehensive Survey of Techniques and Applications
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbone
- 2024MambaOut: Do We Really Need Mamba for Vision?
- 2026MFil-Mamba: Multi-Filter Scanning for Spatial Redundancy-Aware Visual State Space Models
- 2024Demystify Mamba in Vision: A Linear Attention Perspective
- 2025Fast Vision Mamba: Pooling Spatial Dimensions for Accelerated Processing