mlsanityData to 7 Oct 2026

Swin fMRI Transformer Predicts Early Neurodevelopmental Outcomes from Neonatal fMRI

arXiv 2412.07783 ↗First posted 25 Nov 2024q-bio.NC cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Brain development in the first few months of human life is a critical phase characterized by rapid structural growth and functional organization. Accurately predicting developmental outcomes during this time is crucial for identifying delays and enabling timely interventions. This study introduces the SwiFT (Swin 4D fMRI Transformer) model, designed to predict Bayley-III composite scores using neonatal fMRI from the Developing Human Connectome Project (dHCP). To enhance predictive accuracy, we apply dimensionality reduction via group independent component analysis (ICA) and pretrain SwiFT on large adult fMRI datasets to address the challenges of limited neonatal data. Our analysis shows that SwiFT significantly outperforms baseline models in predicting cognitive, motor, and language outcomes, leveraging both single-label and multi-label prediction strategies. The model's attention-based architecture processes spatiotemporal data end-to-end, delivering superior predictive performance. Additionally, we use Integrated Gradients with Smoothgrad sQuare (IG-SQ) to interpret predictions, identifying neural spatial representations linked to early cognitive and behavioral development. These findings underscore the potential of Transformer models to advance neurodevelopmental research and clinical practice.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 36 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

5 of 36 references.

References · 5

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
  3. 2021TCLR: Temporal Contrastive Learning for Video Representationcited by 136
  4. 2018Local Explanation Methods for Deep Neural Networks Lack Sensitivity to Parameter Valuescited by 40
  5. 2023SwiFT: Swin 4D fMRI Transformercited by 36

Built on by

Not cited yet.