# Mamba? Catch The Hype Or Rethink What Really Helps for Image Registration

arXiv: https://arxiv.org/abs/2407.19274 · HTML: https://mlsanity.com/paper/2407.19274/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba).
- Builds on 23 of its 40 references that are in the map.
- First posted on arXiv 27 Jul 2024.

## Placed in

- State-space sequence models (S4, Mamba) / [Vision Mamba backbones](https://mlsanity.com/ssm/vision-mamba-backbones/)

## Builds on (most cited first, 23 of 23)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://mlsanity.com/paper/2312.00752/) (2023)
- [RAFT: Recurrent All-Pairs Field Transforms for Optical Flow](https://mlsanity.com/paper/2003.12039/) (2020)
- [FlowNet: Learning Optical Flow with Convolutional Networks](https://mlsanity.com/paper/1504.06852/) (2015)
- [PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume](https://mlsanity.com/paper/1709.02371/) (2017)
- [VoxelMorph: A Learning Framework for Deformable Medical Image Registration](https://mlsanity.com/paper/1809.05231/) (2018)
- [Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning](https://mlsanity.com/paper/2112.04489/) (2021)
- [Recursive Cascaded Networks for Unsupervised Medical Image Registration](https://mlsanity.com/paper/1907.12353/) (2019)
- [Dual-Stream Pyramid Registration Network](https://mlsanity.com/paper/1909.11966/) (2019)
- [XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attention](https://mlsanity.com/paper/2206.07349/) (2022)
- [U-Net vs Transformer: Is U-Net Outdated in Medical Image Registration?](https://mlsanity.com/paper/2208.04939/) (2022)
- [Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration](https://mlsanity.com/paper/2406.00123/) (2024)
- [On Finite Difference Jacobian Computation in Deformable Image Registration](https://mlsanity.com/paper/2212.06060/) (2022)
- [Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration](https://mlsanity.com/paper/2307.03421/) (2023)
- [Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning](https://mlsanity.com/paper/2206.12596/) (2022)
- [Learning-based and unrolled motion-compensated reconstruction for cardiac MR CINE imaging](https://mlsanity.com/paper/2209.03671/) (2022)
- [Embedding Gradient-based Optimization in Image Registration Networks](https://mlsanity.com/paper/2112.03915/) (2021)
- [Motion-compensated MR CINE reconstruction with reconstruction-driven motion estimation](https://mlsanity.com/paper/2302.02504/) (2023)
- [Weakly-supervised Biomechanically-constrained CT/MRI Registration of the Spine](https://mlsanity.com/paper/2205.07568/) (2022)
- [Attention-aware non-rigid image registration for accelerated MR imaging](https://mlsanity.com/paper/2404.17621/) (2024)

## Built on by (most cited first, 9 of 9)

- [Beyond the LUMIR challenge: The pathway to foundational registration models](https://mlsanity.com/paper/2505.24160/) (2025)
- [Disentangling Progress in Medical Image Registration: Beyond Trend-Driven Architectures towards Domain-Specific Strategies](https://mlsanity.com/paper/2512.01913/) (2025)
- [TimeFlow: Temporal Conditioning for Longitudinal Brain MRI Registration and Aging Analysis](https://mlsanity.com/paper/2501.08667/) (2025)
- [Unsupervised learning of spatially varying regularization for diffeomorphic image registration](https://mlsanity.com/paper/2412.17982/) (2024)
- [The LUMirage: An independent evaluation of zero-shot performance in the LUMIR challenge](https://mlsanity.com/paper/2512.15505/) (2025)
- [A Scalable Distributed Framework for Multimodal GigaVoxel Image Registration](https://mlsanity.com/paper/2509.25044/) (2025)
- [Zero-shot Multi-Contrast Brain MRI Registration by Intensity Randomizing T1-weighted MRI (LUMIR25)](https://mlsanity.com/paper/2602.06292/) (2026)
- [The Right Prior for the Right Deformation: Rethinking Continuous Deformable Image Registration](https://mlsanity.com/paper/2608.16146/) (2026)
- [Is Deformable Image Registration Ready for Brain Metastasis Reirradiation Dose Accumulation? A Longitudinal MRI Benchmark of Registration Accuracy](https://mlsanity.com/paper/2608.28705/) (2026)

## Abstract (arXiv)

Our findings indicate that adopting "advanced" computational elements fails to significantly improve registration accuracy. Instead, well-established registration-specific designs offer fair improvements, enhancing results by a marginal 1.5% over the baseline. Our findings emphasize the importance of rigorous, unbiased evaluation and contribution disentanglement of all low- and high-level registration components, rather than simply following the computer vision trends with "more advanced" computational blocks. We advocate for simpler yet effective solutions and novel evaluation metrics that go beyond conventional registration accuracy, warranting further research across diverse organs and modalities. The code is available at urlhttps://github.com/BailiangJ/rethink-reg.
