Now You Have My Healthy Attention: A U-DiT for Brain-MRI Inpainting
Not on the map. Why?
Abstract (arXiv)
The ASNR-MICCAI BraTS Local Synthesis (Inpainting) task asks for the anatomically plausible completion of healthy brain tissue within a masked region of a T1-weighted MRI, providing a tumor-free anatomical reference for downstream analysis. As the task is scored by distortion metrics (SSIM, PSNR, MSE), we build a deterministic regression model and focus on giving it inductive biases tailored to inpainting. Our network follows the U-DiT principle of performing self-attention on a downsampled token grid: a volumetric encoder-decoder imports long-range context through a downsampled global self-attention block with three-dimensional rotary position embeddings, while convolutions and skip connections preserve high-frequency detail. Two ideas drive our results. First, we constrain the attention so that occluded ("void") tokens attend only to known-healthy tokens of the same volume, with a learned bias toward each query's contralateral homologue, forcing the completion to be inferred from observed anatomy rather than from other unknown regions. Second, we add a contralateral-symmetry input that supplies the mirrored healthy hemisphere as a patient-specific prior; since the brain is approximately bilaterally symmetric and lesions are typically unilateral, this prior improves the distortion metrics at matched structural similarity. On the official BraTS-2026 validation leaderboard our submission reaches a mean healthy-region SSIM of 0.864, PSNR of 24.7,dB and MSE of 4.6×10-3 over 219 cases. We further analyse the residual smoothness inherent to distortion-optimal regression and discuss its implications for anatomical realism.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
17 of 26 references.
References · 17
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 280
- 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformerscited by 118
- 2021MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluationcited by 88
- 2024U-DiTs: Downsample Tokens in U-Shaped Diffusion Transformerscited by 54
- 2024Denoising Diffusion Models for 3D Healthy Brain Tissue Inpaintingcited by 22
5 more
- 2025fastWDM3D: Fast and Accurate 3D Healthy Tissue Inpaintingcited by 8
- 2024Brain Tumour Removing and Missing Modality Generation using 3D WDMcited by 4
- 2024Symmetry Awareness Encoded Deep Learning Framework for Brain Imaging Analysiscited by 3
- 2025Robust 3D Brain MRI Inpainting with Random Masking Augmentationcited by 3
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesiscited by 1
Built on by
Not cited yet.