MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registration
On the map: State-space sequence models (S4, Mamba) → Mamba for medical image analysis
Abstract (arXiv)
Precise alignment of multi-modal images with inherent feature discrepancies poses a pivotal challenge in deformable image registration. Traditional learning-based approaches often consider registration networks as black boxes without interpretability. One core insight is that disentangling alignment features and non-alignment features across modalities bring benefits. Meanwhile, it is challenging for the prominent methods for image registration tasks, such as convolutional neural networks, to capture long-range dependencies by their local receptive fields. The methods often fail when the given image pair has a large misalignment due to the lack of effectively learning long-range dependencies and correspondence. In this paper, we propose MambaReg, a novel Mamba-based architecture that integrates Mamba's strong capability in capturing long sequences to address these challenges. With our proposed several sub-modules, MambaReg can effectively disentangle modality-independent features responsible for registration from modality-dependent, non-aligning features. By selectively attending to the relevant features, our network adeptly captures the correlation between multi-modal images, enabling focused deformation field prediction and precise image alignment. The Mamba-based architecture seamlessly integrates the local feature extraction power of convolutional layers with the long-range dependency modeling capabilities of Mamba. Experiments on public non-rigid RGB-IR image datasets demonstrate the superiority of our method, outperforming existing approaches in terms of registration accuracy and deformation field smoothness.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Mamba for medical image analysis, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 21 of its 36 references that are in the map. First posted on arXiv 3 Nov 2024.
Builds on
21 of 36 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2015Spatial Transformer Networkscited by 1,429
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 700
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
- 2017Unsupervised Deep Homography: A Fast and Robust Homography Estimation Modelcited by 75
9 more
- 2018Depth-aware CNN for RGB-D Segmentationcited by 74
- 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
- 2019Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representationscited by 52
- 2019Dual-Stream Pyramid Registration Networkcited by 52
- 2020CoMIR: Contrastive Multimodal Image Representation for Registrationcited by 45
- 2021LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimationcited by 28
- 2017Learned Convolutional Sparse Codingcited by 26
- 2020Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registrationcited by 25
- 2016A Deep Metric for Multimodal Registrationcited by 19
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration
- 2024VMambaMorph: a Multi-Modality Deformable Image Registration Framework based on Visual State Space Model with Cross-Scan Module
- 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion
- 2025Mamba-Based Modality Disentanglement Network for Multi-Contrast MRI Reconstruction
- 2024Mamba-R: Vision Mamba ALSO Needs Registers
- 2026Interpretable Unsupervised Deformable Image Registration via Confidence-bound Multi-Hop Visual Reasoning
- 2024MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
- 2024EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment