LiAuto-MindViT: A Hybrid Vision Backbone with Adaptive Bidirectional Mamba
On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones
Abstract (arXiv)
While Mamba-based models have shown strong potential for long sequence modeling, adapting them to vision is challenging due to the requirement of local neighborhood correlations and multi-directional spatial contexts for visual understanding. In this paper, we present LiAuto-MindViT, a novel hybrid vision backbone that synergizes the strengths of CNNs, Mamba, and Transformers. The core of our design is the Adaptive Bidirectional Mamba (ABM), which eliminates the directional bias of unidirectional SSMs through bidirectional selective scanning with learnable alpha blending, enabling content-adaptive directional fusion without the overhead of exhaustive multi-path routing. To further accelerate inference, we propose a deployment-friendly Reparameterized ConvSE (RepConvSE) module that leverages structural reparameterization to reduce latency and memory access overhead. Extensive experiments demonstrate that LiAuto-MindViT achieves state-of-the-art performance on image classification, object detection, and semantic segmentation while enabling efficient inference through reparameterization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 56 of its 70 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
56 of 70 references.
Closest ancestors · 10
Same direction, newest first
- 2024Adventurer: Optimizing Vision Mamba Architecture Designs for Efficiency10 Oct
- 2024QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model9 Oct
- 2024MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining1 Oct
- 2024VSSD: Vision Mamba with Non-Causal State Space Duality26 Jul
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbone10 Jul
- 2024PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition26 Mar
- 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference21 Mar
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba15 Mar
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scan14 Mar
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model17 Jan
Other references · 46
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
34 more
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2022A ConvNet for the 2020scited by 3,579
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2024VMamba: Visual State Space Modelcited by 969
- 2020Designing Network Design Spacescited by 960
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
- 2021MetaFormer Is Actually What You Need for Visioncited by 524
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 522
- 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
- 2021Conditional Positional Encodings for Vision Transformerscited by 406
- 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2019ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blockscited by 178
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
- 2022MetaFormer Baselines for Visioncited by 132
- 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2021Diverse Branch Block: Building a Convolution as an Inception-like Unitcited by 87
- 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Modelcited by 62
- 2018ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networkscited by 53
- 2024Falcon Mamba: The First Competitive Attention-free 7B Language Modelcited by 46
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 33
- 2024SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalizationcited by 17
- 2025On Denoising Walking Videos for Gait Recognitioncited by 14
- 2024DemosaicFormer: Coarse-to-Fine Demosaicing Network for HybridEVS Cameracited by 11
- 2025RePaViT: Scalable Vision Transformer Acceleration via Structural Reparameterization on Feedforward Network Layerscited by 5
- 2024PlainUSR: Chasing Faster ConvNet for Efficient Super-Resolutioncited by 4
- 2026EventGait: Towards Robust Gait Recognition with Event Streamscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VCMamba: Bridging Convolutions with Multi-Directional Mamba for Efficient Visual Representation
- 2025DA-Mamba: Domain Adaptive Hybrid Mamba-Transformer Based One-Stage Object Detection
- 2026SF-Mamba: Rethinking State Space Model for Vision
- 2025LBMamba: Locally Bi-directional Mamba
- 2024MambaOut: Do We Really Need Mamba for Vision?
- 2025MambaScope: Coarse-to-Fine Scoping for Efficient Vision Mamba
- 2024Visual Mamba: A Survey and New Outlooks
- 2026Vision Non-Causal Trapezoidal Mamba: Eliminating Directional Scanning in Vision SSMs with Second-Order Dynamics