mlsanityData to 13 Oct 2026

Nd-BiMamba2: A Unified Bidirectional Architecture for Multi-Dimensional Data Processing

arXiv 2411.15380 ↗First posted 22 Nov 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning models often require specially designed architectures to process data of different dimensions, such as 1D time series, 2D images, and 3D volumetric data. Existing bidirectional models mainly focus on sequential data, making it difficult to scale effectively to higher dimensions. To address this issue, we propose a novel multi-dimensional bidirectional neural network architecture, named Nd-BiMamba2, which efficiently handles 1D, 2D, and 3D data. Nd-BiMamba2 is based on the Mamba2 module and introduces innovative bidirectional processing mechanisms and adaptive padding strategies to capture bidirectional information in multi-dimensional data while maintaining computational efficiency. Unlike existing methods that require designing specific architectures for different dimensional data, Nd-BiMamba2 adopts a unified architecture with a modular design, simplifying development and maintenance costs. To verify the portability and flexibility of Nd-BiMamba2, we successfully exported it to ONNX and TorchScript and tested it on different hardware platforms (e.g., CPU, GPU, and mobile devices). Experimental results show that Nd-BiMamba2 runs efficiently on multiple platforms, demonstrating its potential in practical applications. The code is open-source: https://github.com/Human9000/nd-Mamba2-torch

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 18 of its 22 references that are in the map. First posted on arXiv 22 Nov 2024.

Builds on

18 of 22 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,106
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
  7. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,658
  8. 2016WaveNet: A Generative Model for Raw Audiocited by 1,717
  9. 2020Rethinking Attention with Performerscited by 1,594
  10. 2020Linformer: Self-Attention with Linear Complexitycited by 1,469
  11. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,307
  12. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,219
6 more
  1. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 416
  2. 2017Gate-Variants of Gated Recurrent Unit (GRU) Neural Networkscited by 239
  3. 2020Stacked Bidirectional and Unidirectional LSTM Recurrent Neural Network for Forecasting Network-wide Traffic State with Missing Valuescited by 32
  4. 2024VSSD: Vision Mamba with Non-Causal State Space Dualitycited by 29
  5. 2023From CNN to Transformer: A Review of Medical Image Segmentation Modelscited by 22
  6. 2024Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classificationcited by 18

Built on by

Not cited yet.