mlsanityData to 14 Oct 2026

Delta-WKV: A Novel Meta-in-Context Learner for MRI Super-Resolution

arXiv 2502.20852 ↗First posted 28 Feb 2025eess.IV cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Magnetic Resonance Imaging (MRI) Super-Resolution (SR) addresses the challenges such as long scan times and expensive equipment by enhancing image resolution from low-quality inputs acquired in shorter scan times in clinical settings. However, current SR techniques still have problems such as limited ability to capture both local and global static patterns effectively and efficiently. To address these limitations, we propose Delta-WKV, a novel MRI super-resolution model that combines Meta-in-Context Learning (MiCL) with the Delta rule to better recognize both local and global patterns in MRI images. This approach allows Delta-WKV to adjust weights dynamically during inference, improving pattern recognition with fewer parameters and less computational effort, without using state-space modeling. Additionally, inspired by Receptance Weighted Key Value (RWKV), Delta-WKV uses a quad-directional scanning mechanism with time-mixing and channel-mixing structures to capture long-range dependencies while maintaining high-frequency details. Tests on the IXI and fastMRI datasets show that Delta-WKV outperforms existing methods, improving PSNR by 0.06 dB and SSIM by 0.001, while reducing training and inference times by over 15%. These results demonstrate its efficiency and potential for clinical use with large datasets and high-resolution imaging.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 28 Feb 2025.

Builds on

13 of 23 references.

References · 13

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  4. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  5. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  6. 2024Parallelizing Linear Transformers with the Delta Rule over Sequence Lengthcited by 396
  7. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
  8. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  9. 2024Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrencecited by 159
  10. 2024Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architecturescited by 98
  11. 2022SwinFIR: Revisiting the SwinIR with Fast Fourier Convolution and Improved Training for Image Super-Resolutioncited by 68
  12. 2024Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractorscited by 13
1 more
  1. 2023Hybrid Transformer and CNN Attention Network for Stereo Image Super-resolutioncited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhance the Image: Super Resolution using Artificial Intelligence in MRI
  2. 2023InverseSR: 3D Brain MRI Super-Resolution Using a Latent Diffusion Model
  3. 2024Temporal and Spatial Super Resolution with Latent Diffusion Model in Medical MRI images
  4. 2026DRIFT: Difficulty-aware Rectified Flows for Through-plane MRI Super-Resolution
  5. 2025Distillation-Driven Diffusion Model for Multi-Scale MRI Super-Resolution: Make 1.5T MRI Great Again
  6. 2025Efficient Vision Mamba for MRI Super-Resolution via Hybrid Selective Scanning
  7. 2026Comparative Analysis of 3D Convolutional and 2.5D Slice-Conditioned U-Net Architectures for MRI Super-Resolution via Elucidated Diffusion Models
  8. 2026MoE-dqINR: A Unified Mixture-of-Experts Implicit Neural Representation Framework for Scan-Specific Dynamic and Quantitative MRI Reconstruction