mlsanityData to 14 Oct 2026

MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registration

arXiv 2411.01399 ↗First posted 3 Nov 2024cs.CVcited by 1

On the map: State-space sequence models (S4, Mamba) → Mamba for medical image analysis

Abstract (arXiv)

Precise alignment of multi-modal images with inherent feature discrepancies poses a pivotal challenge in deformable image registration. Traditional learning-based approaches often consider registration networks as black boxes without interpretability. One core insight is that disentangling alignment features and non-alignment features across modalities bring benefits. Meanwhile, it is challenging for the prominent methods for image registration tasks, such as convolutional neural networks, to capture long-range dependencies by their local receptive fields. The methods often fail when the given image pair has a large misalignment due to the lack of effectively learning long-range dependencies and correspondence. In this paper, we propose MambaReg, a novel Mamba-based architecture that integrates Mamba's strong capability in capturing long sequences to address these challenges. With our proposed several sub-modules, MambaReg can effectively disentangle modality-independent features responsible for registration from modality-dependent, non-aligning features. By selectively attending to the relevant features, our network adeptly captures the correlation between multi-modal images, enabling focused deformation field prediction and precise image alignment. The Mamba-based architecture seamlessly integrates the local feature extraction power of convolutional layers with the long-range dependency modeling capabilities of Mamba. Experiments on public non-rigid RGB-IR image datasets demonstrate the superiority of our method, outperforming existing approaches in terms of registration accuracy and deformation field smoothness.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Mamba for medical image analysis, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 21 of its 36 references that are in the map. First posted on arXiv 3 Nov 2024.

Builds on

21 of 36 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  5. 2015Spatial Transformer Networkscited by 1,429
  6. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  7. 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 700
  8. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
  9. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  10. 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
  11. 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
  12. 2017Unsupervised Deep Homography: A Fast and Robust Homography Estimation Modelcited by 75
9 more
  1. 2018Depth-aware CNN for RGB-D Segmentationcited by 74
  2. 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
  3. 2019Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representationscited by 52
  4. 2019Dual-Stream Pyramid Registration Networkcited by 52
  5. 2020CoMIR: Contrastive Multimodal Image Representation for Registrationcited by 45
  6. 2021LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimationcited by 28
  7. 2017Learned Convolutional Sparse Codingcited by 26
  8. 2020Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registrationcited by 25
  9. 2016A Deep Metric for Multimodal Registrationcited by 19

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration
  2. 2024VMambaMorph: a Multi-Modality Deformable Image Registration Framework based on Visual State Space Model with Cross-Scan Module
  3. 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion
  4. 2025Mamba-Based Modality Disentanglement Network for Multi-Contrast MRI Reconstruction
  5. 2024Mamba-R: Vision Mamba ALSO Needs Registers
  6. 2026Interpretable Unsupervised Deformable Image Registration via Confidence-bound Multi-Hop Visual Reasoning
  7. 2024MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
  8. 2024EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment