# MAISY: Motion-Aware Image SYnthesis for Medical Image Motion Correction

arXiv: https://arxiv.org/abs/2505.04105 · HTML: https://mlsanity.com/paper/2505.04105/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 19 references that are in the map.
- First posted on arXiv 7 May 2025.

## Builds on (most cited first, 11 of 11)

- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Semantic Image Synthesis with Spatially-Adaptive Normalization](https://mlsanity.com/paper/1903.07291/) (2019)
- [High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs](https://mlsanity.com/paper/1711.11585/) (2017)
- [AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks](https://mlsanity.com/paper/1911.11897/) (2019)
- [Understanding SSIM](https://mlsanity.com/paper/2006.13846/) (2020)
- [How to Fool Radiologists with Generative Adversarial Networks? A Visual Turing Test for Lung Cancer Diagnosis](https://mlsanity.com/paper/1710.09762/) (2017)
- [Motion Corrected Multishot MRI Reconstruction Using Generative Networks with Sensitivity Encoding](https://mlsanity.com/paper/1902.07430/) (2019)
- [Learning MRI Artifact Removal With Unpaired Data](https://mlsanity.com/paper/2110.04604/) (2021)
- [Unsupervised Adversarial Correction of Rigid MR Motion Artifacts](https://mlsanity.com/paper/1910.05597/) (2019)
- [MoCoNet: Motion Correction in 3D MPRAGE images using a Convolutional Neural Network approach](https://mlsanity.com/paper/1807.10831/) (2018)

## Abstract (arXiv)

Patient motion during medical image acquisition causes blurring, ghosting, and distorts organs, which makes image interpretation challenging. Current state-of-the-art algorithms using Generative Adversarial Network (GAN)-based methods with their ability to learn the mappings between corrupted images and their ground truth via Structural Similarity Index Measure (SSIM) loss effectively generate motion-free images. However, we identified the following limitations: (i) they mainly focus on global structural characteristics and therefore overlook localized features that often carry critical pathological information, and (ii) the SSIM loss function struggles to handle images with varying pixel intensities, luminance factors, and variance. In this study, we propose Motion-Aware Image SYnthesis (MAISY) which initially characterize motion and then uses it for correction by: (a) leveraging the foundation model Segment Anything Model (SAM), to dynamically learn spatial patterns along anatomical boundaries where motion artifacts are most pronounced and, (b) introducing the Variance-Selective SSIM (VS-SSIM) loss which adaptively emphasizes spatial regions with high pixel variance to preserve essential anatomical details during artifact correction. Experiments on chest and head CT datasets demonstrate that our model outperformed the state-of-the-art counterparts, with Peak Signal-to-Noise Ratio (PSNR) increasing by 40%, SSIM by 10%, and Dice by 16%.
