Self-pruning Graph Neural Network for Predicting Inflammatory Disease Activity in Multiple Sclerosis from Brain MR Images
Not on the map. Why?
Abstract (arXiv)
Multiple Sclerosis (MS) is a severe neurological disease characterized by inflammatory lesions in the central nervous system. Hence, predicting inflammatory disease activity is crucial for disease assessment and treatment. However, MS lesions can occur throughout the brain and vary in shape, size and total count among patients. The high variance in lesion load and locations makes it challenging for machine learning methods to learn a globally effective representation of whole-brain MRI scans to assess and predict disease. Technically it is non-trivial to incorporate essential biomarkers such as lesion load or spatial proximity. Our work represents the first attempt to utilize graph neural networks (GNN) to aggregate these biomarkers for a novel global representation. We propose a two-stage MS inflammatory disease activity prediction approach. First, a 3D segmentation network detects lesions, and a self-supervised algorithm extracts their image features. Second, the detected lesions are used to build a patient graph. The lesions act as nodes in the graph and are initialized with image features extracted in the first stage. Finally, the lesions are connected based on their spatial proximity and the inflammatory disease activity prediction is formulated as a graph classification task. Furthermore, we propose a self-pruning strategy to auto-select the most critical lesions for prediction. Our proposed method outperforms the existing baseline by a large margin (AUCs of 0.67 vs. 0.61 and 0.66 vs. 0.60 for one-year and two-year inflammatory disease activity, respectively). Finally, our proposed method enjoys inherent explainability by assigning an importance score to each lesion for the overall prediction. Code is available at https://github.com/chinmay5/ms_ida.git
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 32 references that are in the map. First posted on arXiv 31 Aug 2023.
Builds on
17 of 32 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 261
- 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
5 more
- 2021Mixed Transformer U-Net For Medical Image Segmentationcited by 95
- 2018Multi-View Graph Convolutional Network and Its Applications on Neuroimage Analysis for Parkinson's Diseasecited by 19
- 2021Imbalance-Aware Self-Supervised Learning for 3D Radiomic Representationscited by 12
- 2023ViT-AE++: Improving Vision Transformer Autoencoder for Self-supervised Medical Image Representationscited by 12
- 2022Personalized Prediction of Future Lesion Activity and Treatment Effect in Multiple Sclerosis from Baseline MRIcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.