mlsanityData to 7 Oct 2026

Revisiting Global Token Mixing in Task-Dependent MRI Restoration: Insights from Minimal Gated CNN Baselines

arXiv 2603.01449 ↗First posted 2 Mar 2026eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Global token mixing, implemented via self-attention or state-space sequence models, has become a popular model design choice for MRI restoration. However, MRI restoration tasks differ substantially in how their degradations vary over image and k-space domains, and in the degree to which global coupling is already imposed by physics-driven data consistency terms. In this work, we ask the question whether global token mixing is actually beneficial in each individual task across three representative settings: accelerated MRI reconstruction with explicit data consistency, MRI super-resolution with k-space center cropping, and denoising of clinical carotid MRI data with spatially heteroscedastic noise. To reduce confounding factors, we establish a controlled testbed comparing a minimal local gated CNN and its large-field variant, benchmarking them directly against state-of-the-art global models under aligned training and evaluation protocols. For accelerated MRI reconstruction, the minimal unrolled gated-CNN baseline is already highly competitive compared to recent token-mixing approaches in public reconstruction benchmarks, suggesting limited additional benefits when the forward model and data-consistency steps provide strong global constraints. For super-resolution, where low-frequency k-space data are largely preserved by the controlled low-pass degradation, local gated models remain competitive, and a lightweight large-field variant yields only modest improvements. In contrast, for denoising with pronounced spatially heteroscedastic noise, token-mixing models achieve the strongest overall performance, consistent with the need to estimate spatially varying reliability. In conclusion, our results demonstrate that the utility of global token mixing in MRI restoration is task-dependent, and it should be tailored to the underlying imaging physics and degradation structure.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 32 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

24 of 32 references.

References · 24

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  3. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  4. 2022Simple Baselines for Image Restorationcited by 701
  5. 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
  6. 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
  7. 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
  8. 2024MambaOut: Do We Really Need Mamba for Vision?cited by 142
  9. 2022Swin Transformer for Fast MRIcited by 56
  10. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  11. 2022ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformercited by 52
  12. 2020KiU-Net: Towards Accurate Segmentation of Biomedical Images using Over-complete Representationscited by 49
12 more
  1. 2023Xformer: Hybrid X-Shaped Transformer for Image Denoisingcited by 37
  2. 2024Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKVcited by 36
  3. 2022HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstructioncited by 30
  4. 2021Over-and-Under Complete Convolutional RNN for MRI Reconstructioncited by 29
  5. 2024MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimationcited by 19
  6. 2024Deform-Mamba Network for MRI Super-Resolutioncited by 17
  7. 2024MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusioncited by 15
  8. 2025LSNet: See Large, Focus Smallcited by 15
  9. 2024Progressive Divide-and-Conquer via Subsampling Decomposition for Accelerated MRIcited by 13
  10. 2024Exploring the Low-Pass Filtering Behavior in Image Super-Resolutioncited by 7
  11. 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversificationcited by 6
  12. 2025DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstructioncited by 3

Built on by

Not cited yet.