mlsanityData to 7 Oct 2026

SA-CycleGAN-2.5D: Self-Attention CycleGAN with Tri-Planar Context for Multi-Site MRI Harmonization

arXiv 2603.17219 ↗First posted 17 Mar 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-site neuroimaging analysis is fundamentally confounded by scanner-induced covariate shifts, where the marginal distribution of voxel intensities P(x) varies non-linearly across acquisition protocols while the conditional anatomy P(y|x) remains constant. This is particularly detrimental to radiomic reproducibility, where acquisition variance often exceeds biological pathology variance. Existing statistical harmonization methods (e.g., ComBat) operate in feature space, precluding spatial downstream tasks, while standard deep learning approaches are theoretically bounded by local effective receptive fields (ERF), failing to model the global intensity correlations characteristic of field-strength bias. We propose SA-CycleGAN-2.5D, a domain adaptation framework motivated by the HDelta H-divergence bound of Ben-David et al., integrating three architectural innovations: (1) A 2.5D tri-planar manifold injection preserving through-plane gradients nablaz at O(HW) complexity; (2) A U-ResNet generator with dense voxel-to-voxel self-attention, surpassing the O(√L) receptive field limit of CNNs to model global scanner field biases; and (3) A spectrally-normalized discriminator constraining the Lipschitz constant (KD ≤ 1) for stable adversarial optimization. Evaluated on 654 glioma patients across two institutional domains (BraTS and UPenn-GBM), our method reduces Maximum Mean Discrepancy (MMD) by 99.1% (1.729 → 0.015) and degrades domain classifier accuracy to near-chance (59.7%). Ablation confirms that global attention is statistically essential (Cohen's d = 1.32, p < 0.001) for the harder heterogeneous-to-homogeneous translation direction. By bridging 2D efficiency and 3D consistency, our framework yields voxel-level harmonized images that preserve tumor pathophysiology, enabling reproducible multi-center radiomic analysis.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 44 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

18 of 44 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  6. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  7. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  8. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  9. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  10. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  11. 2016Least Squares Generative Adversarial Networkscited by 1,000
  12. 2018Self-Attention Generative Adversarial Networkscited by 809
6 more
  1. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  2. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
  3. 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 133
  4. 2016Image biomarker standardisation initiativecited by 61
  5. 2014A New 2.5D Representation for Lymph Node Detection using Random Sets of Deep Convolutional Neural Network Observationscited by 56
  6. 2022HACA3: A Unified Approach for Multi-site MR Image Harmonizationcited by 17

Built on by

Not cited yet.