mlsanityData to 14 Oct 2026

Axial multi-layer perceptron architecture for automatic segmentation of choroid plexus in multiple sclerosis

arXiv 2109.03778 ↗First posted 8 Sep 2021eess.IV cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Choroid plexuses (CP) are structures of the ventricles of the brain which produce most of the cerebrospinal fluid (CSF). Several postmortem and in vivo studies have pointed towards their role in the inflammatory process in multiple sclerosis (MS). Automatic segmentation of CP from MRI thus has high value for studying their characteristics in large cohorts of patients. To the best of our knowledge, the only freely available tool for CP segmentation is FreeSurfer but its accuracy for this specific structure is poor. In this paper, we propose to automatically segment CP from non-contrast enhanced T1-weighted MRI. To that end, we introduce a new model called "Axial-MLP" based on an assembly of Axial multi-layer perceptrons (MLPs). This is inspired by recent works which showed that the self-attention layers of Transformers can be replaced with MLPs. This approach is systematically compared with a standard 3D U-Net, nnU-Net, Freesurfer and FastSurfer. For our experiments, we make use of a dataset of 141 subjects (44 controls and 97 patients with MS). We show that all the tested deep learning (DL) methods outperform FreeSurfer (Dice around 0.7 for DL vs 0.33 for FreeSurfer). Axial-MLP is competitive with U-Nets even though it is slightly less accurate. The conclusions of our paper are two-fold: 1) the studied deep learning methods could be useful tools to study CP in large cohorts of MS patients; 2)~Axial-MLP is a potentially viable alternative to convolutional neural networks for such tasks, although it could benefit from further improvements.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 8 Sep 2021.

Builds on

20 of 40 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2016Layer Normalizationcited by 5,669
  7. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  8. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  9. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  10. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  11. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  12. 2019Axial Attention in Multidimensional Transformerscited by 358
8 more
  1. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
  2. 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
  3. 2014Efficient Object Localization Using Convolutional Networkscited by 227
  4. 2021CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentationcited by 227
  5. 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 177
  6. 2019FastSurfer -- A fast and accurate deep learning based neuroimaging pipelinecited by 112
  7. 2019Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluationcited by 107
  8. 2021Do You Even Need Attention? A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNetcited by 61

Built on by

Not cited yet.