mlsanityData to 7 Oct 2026

AGA3DNet: Anatomy-Guided Gaussian Priors with Multi-view xLSTM for 3D Brain MRI Subtype Classification

arXiv 2605.07142 ↗First posted 8 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate 3D brain MRI subtype classification benefits from both localized anatomical cues and long-range contextual reasoning. We present AGA3DNet, a report-grounded framework that incorporates brief anatomical phrases extracted from radiology reports as a soft anatomical prior channel and fuses it with a lightweight 3D CNN and multi-view xLSTM aggregation. Specifically, extracted anatomical phrases are mapped to atlas-defined regions and converted into smooth spatial priors using a signed-distance transform followed by Gaussian weighting, providing interpretable, anatomy-grounded guidance without requiring dense voxel annotations. We evaluate AGA3DNet on a retrospective institutional brain MRI cohort for abnormal subtype discrimination and compare against reproducible 3D classification baselines. AGA3DNet achieves improved overall balance across performance metrics and supports clinically interpretable localization through the prior channel. We discuss limitations related to single-cohort evaluation and the lack of large-scale public brain MRI datasets paired with radiology reports under broadly usable terms.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

19 of 37 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  6. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  7. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  8. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  9. 2024xLSTM: Extended Long Short-Term Memorycited by 320
  10. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
  11. 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
  12. 2025MedSAM2: Segment Anything in 3D Medical Images and Videoscited by 88
7 more
  1. 2024MedMamba: Vision Mamba for Medical Image Classificationcited by 86
  2. 2024nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with State Space Modelcited by 45
  3. 2024EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Recordscited by 31
  4. 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reportingcited by 17
  5. 2021Longer Version for "Deep Context-Encoding Network for Retinal Image Captioning"cited by 16
  6. 2025Towards Generalisable Foundation Models for Brain MRIcited by 8
  7. 2025Decipher-MR: A Vision-Language Foundation Model for 3D MRI Representationscited by 4

Built on by

Not cited yet.