mlsanityData to 14 Oct 2026

Federated Transformer-GNN for Privacy-Preserving Brain Tumor Localization with Modality-Level Explainability

arXiv 2601.15042 ↗First posted 21 Jan 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning models for brain tumor analysis require large and diverse datasets that are often siloed across healthcare institutions due to privacy regulations. We present a federated learning framework for brain tumor localization that enables multi-institutional collaboration without sharing sensitive patient data. Our method extends a hybrid Transformer-Graph Neural Network architecture derived from prior decoder-free supervoxel GNNs and is deployed within CAFEINtextsuperscripttextregistered, CERN's federated learning platform designed for healthcare environments. We provide an explainability analysis through Transformer attention mechanisms that reveals which MRI modalities drive the model predictions. Experiments on the BraTS dataset demonstrate a key finding: while isolated training on individual client data triggers early stopping well before reaching full training capacity, federated learning enables continued model improvement by leveraging distributed data, ultimately matching centralized performance. This result provides strong justification for federated learning when dealing with complex tasks and high-dimensional input data, as aggregating knowledge from multiple institutions significantly benefits the learning process. Our explainability analysis, validated through rigorous statistical testing on the full test set (paired t-tests with Bonferroni correction), reveals that deeper network layers significantly increase attention to T2 and FLAIR modalities (p<0.001, Cohen's d=1.50), aligning with clinical practice.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

20 of 30 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2019Advances and Open Problems in Federated Learningcited by 3,046
  6. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  7. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  8. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  9. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,229
  10. 2021How Attentive are Graph Attention Networks?cited by 835
  11. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
  12. 2020Benchmarking Graph Neural Networkscited by 680
8 more
  1. 2020The Future of Digital Health with Federated Learningcited by 633
  2. 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 511
  3. 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 328
  4. 2021TransBTS: Multimodal Brain Tumor Segmentation Using Transformercited by 265
  5. 2022Transformers in Medical Imaging: A Surveycited by 245
  6. 2018Disease Prediction using Graph Convolutional Networks: Application to Autism Spectrum Disorder and Alzheimer's Diseasecited by 99
  7. 2021Transparency of Deep Neural Networks for Medical Image Analysis: A Review of Interpretability Methodscited by 83
  8. 2024A Federated Learning Platform as a Service for Advancing Stroke Management in European Clinical Centerscited by 3

Built on by

Not cited yet.