mlsanityData to 7 Oct 2026

A Systematic Benchmark of Intraoperative Ultrasound-to-MR Synthesis for Brain Tumour Surgery

arXiv 2606.00630 ↗First posted 30 May 2026cs.CV stat.MLcited by 2

Not on the map. Why?

Abstract (arXiv)

Intraoperative ultrasound (ioUS) is a versatile, cost-effective modality in brain tumour surgery, but its interpretation is difficult: acquisition planes are non-standard, artefacts are modality-specific, and its appearance differs markedly from the preoperative MRI on which surgical-planning tools, segmentation models and the surgeon's experience rely. Synthesising MRI-like images from ioUS could let this MRI-based infrastructure be reused intraoperatively without an extra scan. Most prior work evaluates a single architecture in isolation; to our knowledge, no benchmark has spanned architectural paradigms, inference regimes and downstream-task endpoints under a common protocol. We address this gap on the public ReMIND data set (76 patients; 153 paired ioUS/T2w and 104 paired ioUS/FLAIR studies; 60/16 patient-level train/held-out split). Six generators (four GAN baselines: Pix2Pix, SwinPix2Pix, CycleGAN, CUT; the transformer-augmented ResViT; and the few-step diffusion model SynDiff) were each trained under four inference regimes (2D, 2.5D, 2D + 3D-refinement, full-3D) and two targets (T2w only; T2w + FLAIR multi-task), yielding 48 experiments. Image-fidelity metrics (SSIM, PSNR, MAE, LPIPS) were complemented by an nnU-Net v2 downstream segmentation evaluation (tumour and resection cavity) and by subgroup analyses by histological grade and reoperation. No architecture dominated every axis, and, critically, perceptual quality tracked downstream utility most closely (LPIPS, r=-0.66, p<0.001), whereas higher SSIM was associated with worse utility (r=-0.64, p<0.001); SynDiff-2.5D best preserved downstream segmentation (U_Dice=0.55). Perceptual and downstream-task metrics should therefore be reported alongside or in preference to global SSIM, and architecture choice conditioned on surgical phase, patient history and clinical objective.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 48 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

23 of 48 references.

References · 23

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  3. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
  4. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  5. 2016Least Squares Generative Adversarial Networkscited by 1,000
  6. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  7. 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
  8. 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 137
  9. 2020Self-Supervised Ultrasound to MRI Fetal Brain Image Synthesiscited by 18
  10. 2019Evaluation of MRI to ultrasound registration methods for brain shift correction: The CuRIOUS2018 Challengecited by 16
  11. 2023Unified Brain MR-Ultrasound Synthesis using Multi-Modal Hierarchical Representationscited by 13
  12. 2024Unified Cross-Modal Medical Image Synthesis with Hierarchical Mixture of Product-of-Expertscited by 8
11 more
  1. 2024Patient-Specific Real-Time Segmentation in Trackerless Brain Ultrasoundcited by 7
  2. 2024Learning to Match 2D Keypoints Across Preoperative MR and Intraoperative Ultrasoundcited by 5
  3. 2025Learn2Reg 2024: New Benchmark Datasets Driving Progress on New Challengescited by 5
  4. 2024Unsupervised Multimodal 3D Medical Image Registration with Multilevel Correlation Balanced Optimizationcited by 4
  5. 2025Translation of Fetal Brain Ultrasound Images into Pseudo-MRI Images using Artificial Intelligencecited by 3
  6. 2025A 3D Cross-modal Keypoint Descriptor for MR-US Matching and Registrationcited by 3
  7. 2026Unsupervised MR-US Multimodal Image Registration with Multilevel Correlation Pyramidal Optimizationcited by 3
  8. 2019Anatomy-Aware Self-supervised Fetal MRI Synthesis from Unpaired Ultrasound Imagescited by 2
  9. 2023BrainVoxGen: Deep learning framework for synthesis of Ultrasound to MRIcited by 2
  10. 2025Influence of High-Performance Image-to-Image Translation Networks on Clinical Visual Assessment and Outcome Prediction: Utilizing Ultrasound to MRI Translation in Prostate Cancercited by 1
  11. 2025Coarse-to-Fine Joint Registration of MR and Ultrasound Images via Imaging Style Transfercited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Cross Modality Image Translation In Medical Imaging Using Generative Frameworks
  2. 2026Abdominal Ultrasound Simulation from Semantic Labels using Paired Label-to-Physics-Based Image Translation
  3. 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
  4. 2025Benchmarking GANs, Diffusion Models, and Flow Matching for T1w-to-T2w MRI Translation
  5. 2025OpenUS: A Fully Open-Source Foundation Model for Ultrasound Image Analysis via Self-Adaptive Masked Contrastive Learning
  6. 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis
  7. 2026TuLaBM: Tumor-Biased Latent Bridge Matching for Contrast-Enhanced MRI Synthesis
  8. 2025Regression is all you need for medical image translation