mlsanityData to 7 Oct 2026

MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion

arXiv 2406.18950 ↗First posted 27 Jun 2024eess.IV cs.CVcited by 15

On the map: State-space sequence models (S4, Mamba) → Mamba for medical image analysis

Abstract (arXiv)

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the target modality, which requires longer scanning times, from under-sampled k-space data using the fully-sampled reference modality with shorter scanning times as guidance. The primary challenge of this task is comprehensively and efficiently integrating complementary information from different modalities to achieve high-quality reconstruction. Existing methods struggle with this: 1) convolution-based models fail to capture long-range dependencies; 2) transformer-based models, while excelling in global feature modeling, struggle with quadratic computational complexity. To address this, we propose MMR-Mamba, a novel framework that thoroughly and efficiently integrates multi-modal features for MRI reconstruction, leveraging Mamba's capability to capture long-range dependencies with linear computational complexity while exploiting global properties of the Fourier domain. Specifically, we first design a Target modality-guided Cross Mamba (TCM) module in the spatial domain, which maximally restores the target modality information by selectively incorporating relevant information from the reference modality. Then, we introduce a Selective Frequency Fusion (SFF) module to efficiently integrate global information in the Fourier domain and recover high-frequency signals for the reconstruction of structural details. Furthermore, we devise an Adaptive Spatial-Frequency Fusion (ASFF) module, which mutually enhances the spatial and frequency domains by supplementing less informative channels from one domain with corresponding channels from the other.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Mamba for medical image analysis, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 37 of its 63 references that are in the map. First posted on arXiv 27 Jun 2024.

Builds on

37 of 63 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024MedMamba: Vision Mamba for Medical Image Classification6 Mar
  2. 2024MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation28 Feb
  3. 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation24 Jan
  4. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation9 Jan

Other references · 33

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  4. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  5. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  6. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  7. 2024VMamba: Visual State Space Modelcited by 955
  8. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 673
  9. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  10. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
  11. 2020FDA: Fourier Domain Adaptation for Semantic Segmentationcited by 540
  12. 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
21 more
  1. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
  2. 2021A Fourier-based Framework for Domain Generalizationcited by 287
  3. 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 284
  4. 2022Liquid Structural State-Space Modelscited by 134
  5. 2022How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projectionscited by 121
  6. 2018Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layerscited by 112
  7. 2024Pan-Mamba: Effective pan-sharpening with State Space Modelcited by 73
  8. 2020DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction with Deep T1 Priorcited by 72
  9. 2022ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformercited by 52
  10. 2019Multi-Contrast Super-Resolution MRI Through a Progressive Networkcited by 45
  11. 2023Toeplitz Neural Network for Sequence Modelingcited by 43
  12. 2021Multi-Contrast MRI Super-Resolution via a Multi-Stage Integration Networkcited by 42
  13. 2021Multi-Modal Transformer for Accelerated MR Imagingcited by 42
  14. 2022DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstructioncited by 30
  15. 2022Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolutioncited by 30
  16. 2018A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstructioncited by 22
  17. 2021Multi-Modal MRI Reconstruction Assisted with Spatial Alignment Networkcited by 16
  18. 2024CMViM: Contrastive Masked Vim Autoencoder for 3D Multi-modal Representation Learning for AD classificationcited by 15
  19. 2021Exploring Separable Attention for Multi-Contrast MR Image Super-Resolutioncited by 13
  20. 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 13
  21. 2023Image Reconstruction for Accelerated MR Scan with Faster Fourier Convolutional Neural Networkscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 9; 2026: 4.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025MM2CT: MR-to-CT translation for multi-modal image fusion with mamba
  2. 2025Spatial-Frequency Enhanced Mamba for Multi-Modal Image Fusion
  3. 2025HiFi-Mamba: Dual-Stream W-Laplacian Enhanced Mamba for High-Fidelity MRI Reconstruction
  4. 2024MambaRecon: MRI Reconstruction with Structured State Space Models
  5. 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion
  6. 2025FaRMamba: Frequency-based learning and Reconstruction aided Mamba for Medical Segmentation
  7. 2026Interactive Spatial-Frequency Fusion Mamba for Multi-Modal Image Fusion
  8. 2024A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyond