mlsanityData to 7 Oct 2026

Shuffle Mamba: State Space Models with Random Shuffle for Multi-Modal Image Fusion

arXiv 2409.01728 ↗First posted 3 Sep 2024cs.CVcited by 7

On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing

Abstract (arXiv)

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity, most Mamba-based approaches use fixed scanning strategies, which can introduce biased prior information. To mitigate this issue, we propose a novel Bayesian-inspired scanning strategy called Random Shuffle, supplemented by a theoretically feasible inverse shuffle to maintain information coordination invariance, aiming to eliminate biases associated with fixed sequence scanning. Based on this transformation pair, we customized the Shuffle Mamba Framework, penetrating modality-aware information representation and cross-modality information interaction across spatial and channel axes to ensure robust interaction and an unbiased global receptive field for multi-modal image fusion. Furthermore, we develop a testing methodology based on Monte-Carlo averaging to ensure the model's output aligns more closely with expected results. Extensive experiments across multiple multi-modal image fusion tasks demonstrate the effectiveness of our proposed method, yielding excellent fusion quality compared to state-of-the-art alternatives. The code is available at https://github.com/caoke-963/Shuffle-Mamba.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 30 of its 82 references that are in the map. First posted on arXiv 3 Sep 2024.

Builds on

30 of 82 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024FusionMamba: Efficient Remote Sensing Image Fusion with State Space Model11 Apr
  2. 2024RS-Mamba for Large Remote Sensing Image Dense Prediction3 Apr
  3. 2024RSMamba: Remote Sensing Image Classification with State Space Model28 Mar

Other references · 27

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  3. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  4. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  5. 2024VMamba: Visual State Space Modelcited by 955
  6. 2022Simplified State Space Layers for Sequence Modelingcited by 776
  7. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
  8. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
  9. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  10. 2022Long Range Language Modeling via Gated State Spacescited by 265
  11. 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 235
  12. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
15 more
  1. 2024Pan-Mamba: Effective pan-sharpening with State Space Modelcited by 73
  2. 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Modelcited by 62
  3. 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
  4. 2017A Multi-Scale and Multi-Depth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpeningcited by 54
  5. 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
  6. 2024DGMamba: Domain Generalization via Generalized State Space Modelcited by 21
  7. 2022PanFormer: a Transformer Based Model for Pan-sharpeningcited by 18
  8. 2023PanFlowNet: A Flow-Based Deep Network for Pan-sharpeningcited by 16
  9. 2023ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss via Meta-Learningcited by 15
  10. 2024All-weather Multi-Modality Image Fusion: Unified Framework and 100k Benchmarkcited by 14
  11. 2024Frequency-Adaptive Pan-Sharpening with Mixture of Expertscited by 13
  12. 2024Simultaneous Tri-Modal Medical Image Fusion and Super-Resolution using Conditional Diffusion Modelcited by 13
  13. 2024TSJNet: A Multi-modality Target and Semantic Awareness Joint-driven Image Fusion Networkcited by 10
  14. 2024UMCFuse: A Unified Multiple Complex Scenes Infrared and Visible Image Fusion Frameworkcited by 9
  15. 2024Pan-denoising: Guided Hyperspectral Image Denoising via Weighted Represent Coefficient Total Variationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Self-supervised Multiplex Consensus Mamba for General Image Fusion
  2. 2025FusionFM: All-in-One Multi-Modal Image Fusion with Flow Matching
  3. 2026MambaVF: State Space Model for Efficient Video Fusion
  4. 2024Stochastic Layer-Wise Shuffle for Improving Vision Mamba Training
  5. 2026DIFF-MF: A Difference-Driven Channel-Spatial State Space Model for Multi-Modal Image Fusion
  6. 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion
  7. 2025MambaTrans: Multimodal Fusion Image Translation via Large Language Model Priors for Downstream Visual Tasks
  8. 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion